00:00:00.000 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v22.11" build number 973 00:00:00.000 originally caused by: 00:00:00.000 Started by upstream project "nightly-trigger" build number 3640 00:00:00.000 originally caused by: 00:00:00.000 Started by timer 00:00:00.035 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.036 The recommended git tool is: git 00:00:00.036 using credential 00000000-0000-0000-0000-000000000002 00:00:00.038 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.056 Fetching changes from the remote Git repository 00:00:00.058 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.088 Using shallow fetch with depth 1 00:00:00.088 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.088 > git --version # timeout=10 00:00:00.123 > git --version # 'git version 2.39.2' 00:00:00.123 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.164 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.164 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:02.549 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:02.561 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:02.571 Checking out Revision b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf (FETCH_HEAD) 00:00:02.571 > git config core.sparsecheckout # timeout=10 00:00:02.582 > git read-tree -mu HEAD # timeout=10 00:00:02.596 > git checkout -f b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf # timeout=5 00:00:02.613 Commit message: "jenkins/jjb-config: Ignore OS version mismatch under freebsd" 00:00:02.613 > git rev-list --no-walk b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf # timeout=10 00:00:02.697 [Pipeline] Start of Pipeline 00:00:02.710 [Pipeline] library 00:00:02.712 Loading library shm_lib@master 00:00:02.712 Library shm_lib@master is cached. Copying from home. 00:00:02.729 [Pipeline] node 00:00:02.737 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:02.739 [Pipeline] { 00:00:02.750 [Pipeline] catchError 00:00:02.752 [Pipeline] { 00:00:02.763 [Pipeline] wrap 00:00:02.769 [Pipeline] { 00:00:02.775 [Pipeline] stage 00:00:02.776 [Pipeline] { (Prologue) 00:00:02.983 [Pipeline] sh 00:00:03.270 + logger -p user.info -t JENKINS-CI 00:00:03.288 [Pipeline] echo 00:00:03.289 Node: GP11 00:00:03.297 [Pipeline] sh 00:00:03.596 [Pipeline] setCustomBuildProperty 00:00:03.606 [Pipeline] echo 00:00:03.608 Cleanup processes 00:00:03.613 [Pipeline] sh 00:00:03.897 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:03.897 993387 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:03.911 [Pipeline] sh 00:00:04.196 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:04.196 ++ grep -v 'sudo pgrep' 00:00:04.196 ++ awk '{print $1}' 00:00:04.196 + sudo kill -9 00:00:04.196 + true 00:00:04.211 [Pipeline] cleanWs 00:00:04.222 [WS-CLEANUP] Deleting project workspace... 00:00:04.222 [WS-CLEANUP] Deferred wipeout is used... 00:00:04.229 [WS-CLEANUP] done 00:00:04.233 [Pipeline] setCustomBuildProperty 00:00:04.248 [Pipeline] sh 00:00:04.531 + sudo git config --global --replace-all safe.directory '*' 00:00:04.642 [Pipeline] httpRequest 00:00:05.329 [Pipeline] echo 00:00:05.330 Sorcerer 10.211.164.20 is alive 00:00:05.337 [Pipeline] retry 00:00:05.339 [Pipeline] { 00:00:05.350 [Pipeline] httpRequest 00:00:05.354 HttpMethod: GET 00:00:05.354 URL: http://10.211.164.20/packages/jbp_b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf.tar.gz 00:00:05.355 Sending request to url: http://10.211.164.20/packages/jbp_b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf.tar.gz 00:00:05.359 Response Code: HTTP/1.1 200 OK 00:00:05.359 Success: Status code 200 is in the accepted range: 200,404 00:00:05.360 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf.tar.gz 00:00:06.095 [Pipeline] } 00:00:06.109 [Pipeline] // retry 00:00:06.114 [Pipeline] sh 00:00:06.397 + tar --no-same-owner -xf jbp_b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf.tar.gz 00:00:06.411 [Pipeline] httpRequest 00:00:06.777 [Pipeline] echo 00:00:06.778 Sorcerer 10.211.164.20 is alive 00:00:06.785 [Pipeline] retry 00:00:06.786 [Pipeline] { 00:00:06.799 [Pipeline] httpRequest 00:00:06.804 HttpMethod: GET 00:00:06.804 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:06.807 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:06.823 Response Code: HTTP/1.1 200 OK 00:00:06.824 Success: Status code 200 is in the accepted range: 200,404 00:00:06.824 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:32.806 [Pipeline] } 00:00:32.822 [Pipeline] // retry 00:00:32.829 [Pipeline] sh 00:00:33.117 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:36.437 [Pipeline] sh 00:00:36.725 + git -C spdk log --oneline -n5 00:00:36.725 c13c99a5e test: Various fixes for Fedora40 00:00:36.725 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:00:36.725 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:00:36.725 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:00:36.725 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:00:36.746 [Pipeline] withCredentials 00:00:36.758 > git --version # timeout=10 00:00:36.772 > git --version # 'git version 2.39.2' 00:00:36.791 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:00:36.793 [Pipeline] { 00:00:36.802 [Pipeline] retry 00:00:36.804 [Pipeline] { 00:00:36.821 [Pipeline] sh 00:00:37.107 + git ls-remote http://dpdk.org/git/dpdk-stable v22.11.4 00:00:37.120 [Pipeline] } 00:00:37.138 [Pipeline] // retry 00:00:37.143 [Pipeline] } 00:00:37.160 [Pipeline] // withCredentials 00:00:37.171 [Pipeline] httpRequest 00:00:37.570 [Pipeline] echo 00:00:37.572 Sorcerer 10.211.164.20 is alive 00:00:37.582 [Pipeline] retry 00:00:37.584 [Pipeline] { 00:00:37.598 [Pipeline] httpRequest 00:00:37.603 HttpMethod: GET 00:00:37.603 URL: http://10.211.164.20/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:37.604 Sending request to url: http://10.211.164.20/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:37.616 Response Code: HTTP/1.1 200 OK 00:00:37.617 Success: Status code 200 is in the accepted range: 200,404 00:00:37.617 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:59.303 [Pipeline] } 00:00:59.362 [Pipeline] // retry 00:00:59.382 [Pipeline] sh 00:00:59.663 + tar --no-same-owner -xf dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:01.578 [Pipeline] sh 00:01:01.867 + git -C dpdk log --oneline -n5 00:01:01.867 caf0f5d395 version: 22.11.4 00:01:01.867 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:01.867 dc9c799c7d vhost: fix missing spinlock unlock 00:01:01.867 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:01.867 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:01.878 [Pipeline] } 00:01:01.892 [Pipeline] // stage 00:01:01.902 [Pipeline] stage 00:01:01.904 [Pipeline] { (Prepare) 00:01:01.926 [Pipeline] writeFile 00:01:01.945 [Pipeline] sh 00:01:02.230 + logger -p user.info -t JENKINS-CI 00:01:02.245 [Pipeline] sh 00:01:02.534 + logger -p user.info -t JENKINS-CI 00:01:02.548 [Pipeline] sh 00:01:02.838 + cat autorun-spdk.conf 00:01:02.838 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:02.838 SPDK_TEST_NVMF=1 00:01:02.838 SPDK_TEST_NVME_CLI=1 00:01:02.838 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:02.838 SPDK_TEST_NVMF_NICS=e810 00:01:02.838 SPDK_TEST_VFIOUSER=1 00:01:02.838 SPDK_RUN_UBSAN=1 00:01:02.838 NET_TYPE=phy 00:01:02.838 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:02.838 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:02.846 RUN_NIGHTLY=1 00:01:02.851 [Pipeline] readFile 00:01:02.877 [Pipeline] withEnv 00:01:02.880 [Pipeline] { 00:01:02.894 [Pipeline] sh 00:01:03.183 + set -ex 00:01:03.183 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:03.183 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:03.183 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:03.183 ++ SPDK_TEST_NVMF=1 00:01:03.183 ++ SPDK_TEST_NVME_CLI=1 00:01:03.183 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:03.183 ++ SPDK_TEST_NVMF_NICS=e810 00:01:03.183 ++ SPDK_TEST_VFIOUSER=1 00:01:03.183 ++ SPDK_RUN_UBSAN=1 00:01:03.183 ++ NET_TYPE=phy 00:01:03.183 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:03.183 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:03.183 ++ RUN_NIGHTLY=1 00:01:03.183 + case $SPDK_TEST_NVMF_NICS in 00:01:03.183 + DRIVERS=ice 00:01:03.183 + [[ tcp == \r\d\m\a ]] 00:01:03.183 + [[ -n ice ]] 00:01:03.183 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:03.183 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:03.183 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:03.183 rmmod: ERROR: Module irdma is not currently loaded 00:01:03.183 rmmod: ERROR: Module i40iw is not currently loaded 00:01:03.183 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:03.183 + true 00:01:03.183 + for D in $DRIVERS 00:01:03.183 + sudo modprobe ice 00:01:03.183 + exit 0 00:01:03.193 [Pipeline] } 00:01:03.208 [Pipeline] // withEnv 00:01:03.213 [Pipeline] } 00:01:03.225 [Pipeline] // stage 00:01:03.234 [Pipeline] catchError 00:01:03.235 [Pipeline] { 00:01:03.249 [Pipeline] timeout 00:01:03.249 Timeout set to expire in 1 hr 0 min 00:01:03.251 [Pipeline] { 00:01:03.264 [Pipeline] stage 00:01:03.266 [Pipeline] { (Tests) 00:01:03.279 [Pipeline] sh 00:01:03.567 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:03.567 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:03.567 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:03.567 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:03.567 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:03.567 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:03.567 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:03.567 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:03.567 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:03.567 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:03.567 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:03.567 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:03.567 + source /etc/os-release 00:01:03.567 ++ NAME='Fedora Linux' 00:01:03.567 ++ VERSION='39 (Cloud Edition)' 00:01:03.567 ++ ID=fedora 00:01:03.567 ++ VERSION_ID=39 00:01:03.567 ++ VERSION_CODENAME= 00:01:03.567 ++ PLATFORM_ID=platform:f39 00:01:03.567 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:03.567 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:03.567 ++ LOGO=fedora-logo-icon 00:01:03.567 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:03.567 ++ HOME_URL=https://fedoraproject.org/ 00:01:03.567 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:03.567 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:03.567 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:03.567 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:03.567 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:03.567 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:03.567 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:03.567 ++ SUPPORT_END=2024-11-12 00:01:03.567 ++ VARIANT='Cloud Edition' 00:01:03.567 ++ VARIANT_ID=cloud 00:01:03.567 + uname -a 00:01:03.567 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:03.567 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:04.506 Hugepages 00:01:04.506 node hugesize free / total 00:01:04.506 node0 1048576kB 0 / 0 00:01:04.506 node0 2048kB 0 / 0 00:01:04.506 node1 1048576kB 0 / 0 00:01:04.506 node1 2048kB 0 / 0 00:01:04.506 00:01:04.506 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:04.506 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:04.506 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:04.506 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:04.506 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:04.506 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:04.506 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:04.506 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:04.506 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:04.506 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:04.506 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:04.506 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:04.506 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:04.506 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:04.506 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:04.506 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:04.506 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:04.506 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:04.506 + rm -f /tmp/spdk-ld-path 00:01:04.506 + source autorun-spdk.conf 00:01:04.506 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:04.506 ++ SPDK_TEST_NVMF=1 00:01:04.506 ++ SPDK_TEST_NVME_CLI=1 00:01:04.506 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:04.506 ++ SPDK_TEST_NVMF_NICS=e810 00:01:04.506 ++ SPDK_TEST_VFIOUSER=1 00:01:04.506 ++ SPDK_RUN_UBSAN=1 00:01:04.506 ++ NET_TYPE=phy 00:01:04.506 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:04.506 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:04.506 ++ RUN_NIGHTLY=1 00:01:04.506 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:04.506 + [[ -n '' ]] 00:01:04.506 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:04.506 + for M in /var/spdk/build-*-manifest.txt 00:01:04.506 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:04.506 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:04.506 + for M in /var/spdk/build-*-manifest.txt 00:01:04.506 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:04.506 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:04.506 + for M in /var/spdk/build-*-manifest.txt 00:01:04.506 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:04.506 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:04.506 ++ uname 00:01:04.506 + [[ Linux == \L\i\n\u\x ]] 00:01:04.506 + sudo dmesg -T 00:01:04.765 + sudo dmesg --clear 00:01:04.765 + dmesg_pid=994105 00:01:04.765 + [[ Fedora Linux == FreeBSD ]] 00:01:04.765 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:04.765 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:04.765 + sudo dmesg -Tw 00:01:04.765 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:04.765 + [[ -x /usr/src/fio-static/fio ]] 00:01:04.765 + export FIO_BIN=/usr/src/fio-static/fio 00:01:04.765 + FIO_BIN=/usr/src/fio-static/fio 00:01:04.765 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:04.765 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:04.765 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:04.765 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:04.765 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:04.765 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:04.765 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:04.765 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:04.765 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:04.765 Test configuration: 00:01:04.765 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:04.765 SPDK_TEST_NVMF=1 00:01:04.765 SPDK_TEST_NVME_CLI=1 00:01:04.765 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:04.765 SPDK_TEST_NVMF_NICS=e810 00:01:04.765 SPDK_TEST_VFIOUSER=1 00:01:04.765 SPDK_RUN_UBSAN=1 00:01:04.765 NET_TYPE=phy 00:01:04.765 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:04.765 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:04.765 RUN_NIGHTLY=1 01:43:38 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:04.765 01:43:38 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:04.765 01:43:38 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:04.765 01:43:38 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:04.765 01:43:38 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:04.765 01:43:38 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:04.765 01:43:38 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:04.765 01:43:38 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:04.765 01:43:38 -- paths/export.sh@5 -- $ export PATH 00:01:04.765 01:43:38 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:04.765 01:43:38 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:04.765 01:43:38 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:04.765 01:43:38 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1731890618.XXXXXX 00:01:04.765 01:43:38 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1731890618.iE1IZh 00:01:04.765 01:43:38 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:04.765 01:43:38 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:01:04.765 01:43:38 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:04.765 01:43:38 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:04.765 01:43:38 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:04.765 01:43:38 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:04.765 01:43:38 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:04.765 01:43:38 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:04.765 01:43:38 -- common/autotest_common.sh@10 -- $ set +x 00:01:04.765 01:43:39 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:04.765 01:43:39 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:04.765 01:43:39 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:04.765 01:43:39 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:04.765 01:43:39 -- spdk/autobuild.sh@16 -- $ date -u 00:01:04.765 Mon Nov 18 12:43:39 AM UTC 2024 00:01:04.765 01:43:39 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:04.765 LTS-67-gc13c99a5e 00:01:04.765 01:43:39 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:04.765 01:43:39 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:04.765 01:43:39 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:04.765 01:43:39 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:04.765 01:43:39 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:04.765 01:43:39 -- common/autotest_common.sh@10 -- $ set +x 00:01:04.765 ************************************ 00:01:04.765 START TEST ubsan 00:01:04.766 ************************************ 00:01:04.766 01:43:39 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:04.766 using ubsan 00:01:04.766 00:01:04.766 real 0m0.000s 00:01:04.766 user 0m0.000s 00:01:04.766 sys 0m0.000s 00:01:04.766 01:43:39 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:04.766 01:43:39 -- common/autotest_common.sh@10 -- $ set +x 00:01:04.766 ************************************ 00:01:04.766 END TEST ubsan 00:01:04.766 ************************************ 00:01:04.766 01:43:39 -- spdk/autobuild.sh@27 -- $ '[' -n v22.11.4 ']' 00:01:04.766 01:43:39 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:04.766 01:43:39 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:04.766 01:43:39 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:04.766 01:43:39 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:04.766 01:43:39 -- common/autotest_common.sh@10 -- $ set +x 00:01:04.766 ************************************ 00:01:04.766 START TEST build_native_dpdk 00:01:04.766 ************************************ 00:01:04.766 01:43:39 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:04.766 01:43:39 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:04.766 01:43:39 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:04.766 01:43:39 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:04.766 01:43:39 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:04.766 01:43:39 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:04.766 01:43:39 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:04.766 01:43:39 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:04.766 01:43:39 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:04.766 01:43:39 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:04.766 01:43:39 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:04.766 01:43:39 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:04.766 01:43:39 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:04.766 01:43:39 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:04.766 01:43:39 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:04.766 01:43:39 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:04.766 01:43:39 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:04.766 01:43:39 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:04.766 01:43:39 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:04.766 01:43:39 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:04.766 01:43:39 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:04.766 caf0f5d395 version: 22.11.4 00:01:04.766 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:04.766 dc9c799c7d vhost: fix missing spinlock unlock 00:01:04.766 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:04.766 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:04.766 01:43:39 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:04.766 01:43:39 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:04.766 01:43:39 -- common/autobuild_common.sh@87 -- $ dpdk_ver=22.11.4 00:01:04.766 01:43:39 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:04.766 01:43:39 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:04.766 01:43:39 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:04.766 01:43:39 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:04.766 01:43:39 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:04.766 01:43:39 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:04.766 01:43:39 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:04.766 01:43:39 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:04.766 01:43:39 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:04.766 01:43:39 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:04.766 01:43:39 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:04.766 01:43:39 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:04.766 01:43:39 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:04.766 01:43:39 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:04.766 01:43:39 -- common/autobuild_common.sh@169 -- $ lt 22.11.4 21.11.0 00:01:04.766 01:43:39 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 21.11.0 00:01:04.766 01:43:39 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:04.766 01:43:39 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:04.766 01:43:39 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:04.766 01:43:39 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:04.766 01:43:39 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:04.766 01:43:39 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:04.766 01:43:39 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:04.766 01:43:39 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:04.766 01:43:39 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:04.766 01:43:39 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:04.766 01:43:39 -- scripts/common.sh@343 -- $ case "$op" in 00:01:04.766 01:43:39 -- scripts/common.sh@344 -- $ : 1 00:01:04.766 01:43:39 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:04.766 01:43:39 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:04.766 01:43:39 -- scripts/common.sh@364 -- $ decimal 22 00:01:04.766 01:43:39 -- scripts/common.sh@352 -- $ local d=22 00:01:04.766 01:43:39 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:04.766 01:43:39 -- scripts/common.sh@354 -- $ echo 22 00:01:04.766 01:43:39 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:04.766 01:43:39 -- scripts/common.sh@365 -- $ decimal 21 00:01:04.766 01:43:39 -- scripts/common.sh@352 -- $ local d=21 00:01:04.766 01:43:39 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:04.766 01:43:39 -- scripts/common.sh@354 -- $ echo 21 00:01:04.766 01:43:39 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:04.766 01:43:39 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:04.766 01:43:39 -- scripts/common.sh@366 -- $ return 1 00:01:04.766 01:43:39 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:04.766 patching file config/rte_config.h 00:01:04.766 Hunk #1 succeeded at 60 (offset 1 line). 00:01:04.766 01:43:39 -- common/autobuild_common.sh@176 -- $ lt 22.11.4 24.07.0 00:01:04.766 01:43:39 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 24.07.0 00:01:04.766 01:43:39 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:04.766 01:43:39 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:04.766 01:43:39 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:04.766 01:43:39 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:04.766 01:43:39 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:04.766 01:43:39 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:04.766 01:43:39 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:04.766 01:43:39 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:04.766 01:43:39 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:04.766 01:43:39 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:04.766 01:43:39 -- scripts/common.sh@343 -- $ case "$op" in 00:01:04.766 01:43:39 -- scripts/common.sh@344 -- $ : 1 00:01:04.766 01:43:39 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:04.766 01:43:39 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:04.766 01:43:39 -- scripts/common.sh@364 -- $ decimal 22 00:01:04.766 01:43:39 -- scripts/common.sh@352 -- $ local d=22 00:01:04.766 01:43:39 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:04.766 01:43:39 -- scripts/common.sh@354 -- $ echo 22 00:01:04.766 01:43:39 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:04.766 01:43:39 -- scripts/common.sh@365 -- $ decimal 24 00:01:04.766 01:43:39 -- scripts/common.sh@352 -- $ local d=24 00:01:04.766 01:43:39 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:04.766 01:43:39 -- scripts/common.sh@354 -- $ echo 24 00:01:04.766 01:43:39 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:04.766 01:43:39 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:04.766 01:43:39 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:04.766 01:43:39 -- scripts/common.sh@367 -- $ return 0 00:01:04.766 01:43:39 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:04.766 patching file lib/pcapng/rte_pcapng.c 00:01:04.766 Hunk #1 succeeded at 110 (offset -18 lines). 00:01:04.766 01:43:39 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:04.766 01:43:39 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:04.766 01:43:39 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:04.766 01:43:39 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:04.766 01:43:39 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:10.066 The Meson build system 00:01:10.066 Version: 1.5.0 00:01:10.066 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:10.066 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:10.066 Build type: native build 00:01:10.066 Program cat found: YES (/usr/bin/cat) 00:01:10.066 Project name: DPDK 00:01:10.066 Project version: 22.11.4 00:01:10.066 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:10.066 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:10.066 Host machine cpu family: x86_64 00:01:10.066 Host machine cpu: x86_64 00:01:10.066 Message: ## Building in Developer Mode ## 00:01:10.066 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:10.066 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:10.066 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:10.066 Program objdump found: YES (/usr/bin/objdump) 00:01:10.066 Program python3 found: YES (/usr/bin/python3) 00:01:10.066 Program cat found: YES (/usr/bin/cat) 00:01:10.066 config/meson.build:83: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:10.066 Checking for size of "void *" : 8 00:01:10.066 Checking for size of "void *" : 8 (cached) 00:01:10.066 Library m found: YES 00:01:10.066 Library numa found: YES 00:01:10.066 Has header "numaif.h" : YES 00:01:10.066 Library fdt found: NO 00:01:10.066 Library execinfo found: NO 00:01:10.066 Has header "execinfo.h" : YES 00:01:10.066 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:10.066 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:10.066 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:10.066 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:10.066 Run-time dependency openssl found: YES 3.1.1 00:01:10.066 Run-time dependency libpcap found: YES 1.10.4 00:01:10.066 Has header "pcap.h" with dependency libpcap: YES 00:01:10.066 Compiler for C supports arguments -Wcast-qual: YES 00:01:10.066 Compiler for C supports arguments -Wdeprecated: YES 00:01:10.066 Compiler for C supports arguments -Wformat: YES 00:01:10.066 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:10.066 Compiler for C supports arguments -Wformat-security: NO 00:01:10.066 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:10.066 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:10.066 Compiler for C supports arguments -Wnested-externs: YES 00:01:10.066 Compiler for C supports arguments -Wold-style-definition: YES 00:01:10.066 Compiler for C supports arguments -Wpointer-arith: YES 00:01:10.066 Compiler for C supports arguments -Wsign-compare: YES 00:01:10.067 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:10.067 Compiler for C supports arguments -Wundef: YES 00:01:10.067 Compiler for C supports arguments -Wwrite-strings: YES 00:01:10.067 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:10.067 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:10.067 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:10.067 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:10.067 Compiler for C supports arguments -mavx512f: YES 00:01:10.067 Checking if "AVX512 checking" compiles: YES 00:01:10.067 Fetching value of define "__SSE4_2__" : 1 00:01:10.067 Fetching value of define "__AES__" : 1 00:01:10.067 Fetching value of define "__AVX__" : 1 00:01:10.067 Fetching value of define "__AVX2__" : (undefined) 00:01:10.067 Fetching value of define "__AVX512BW__" : (undefined) 00:01:10.067 Fetching value of define "__AVX512CD__" : (undefined) 00:01:10.067 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:10.067 Fetching value of define "__AVX512F__" : (undefined) 00:01:10.067 Fetching value of define "__AVX512VL__" : (undefined) 00:01:10.067 Fetching value of define "__PCLMUL__" : 1 00:01:10.067 Fetching value of define "__RDRND__" : 1 00:01:10.067 Fetching value of define "__RDSEED__" : (undefined) 00:01:10.067 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:10.067 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:10.067 Message: lib/kvargs: Defining dependency "kvargs" 00:01:10.067 Message: lib/telemetry: Defining dependency "telemetry" 00:01:10.067 Checking for function "getentropy" : YES 00:01:10.067 Message: lib/eal: Defining dependency "eal" 00:01:10.067 Message: lib/ring: Defining dependency "ring" 00:01:10.067 Message: lib/rcu: Defining dependency "rcu" 00:01:10.067 Message: lib/mempool: Defining dependency "mempool" 00:01:10.067 Message: lib/mbuf: Defining dependency "mbuf" 00:01:10.067 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:10.067 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:10.067 Compiler for C supports arguments -mpclmul: YES 00:01:10.067 Compiler for C supports arguments -maes: YES 00:01:10.067 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:10.067 Compiler for C supports arguments -mavx512bw: YES 00:01:10.067 Compiler for C supports arguments -mavx512dq: YES 00:01:10.067 Compiler for C supports arguments -mavx512vl: YES 00:01:10.067 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:10.067 Compiler for C supports arguments -mavx2: YES 00:01:10.067 Compiler for C supports arguments -mavx: YES 00:01:10.067 Message: lib/net: Defining dependency "net" 00:01:10.067 Message: lib/meter: Defining dependency "meter" 00:01:10.067 Message: lib/ethdev: Defining dependency "ethdev" 00:01:10.067 Message: lib/pci: Defining dependency "pci" 00:01:10.067 Message: lib/cmdline: Defining dependency "cmdline" 00:01:10.067 Message: lib/metrics: Defining dependency "metrics" 00:01:10.067 Message: lib/hash: Defining dependency "hash" 00:01:10.067 Message: lib/timer: Defining dependency "timer" 00:01:10.067 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:10.067 Compiler for C supports arguments -mavx2: YES (cached) 00:01:10.067 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:10.067 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:10.067 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:10.067 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:10.067 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:10.067 Message: lib/acl: Defining dependency "acl" 00:01:10.067 Message: lib/bbdev: Defining dependency "bbdev" 00:01:10.067 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:10.067 Run-time dependency libelf found: YES 0.191 00:01:10.067 Message: lib/bpf: Defining dependency "bpf" 00:01:10.067 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:10.067 Message: lib/compressdev: Defining dependency "compressdev" 00:01:10.067 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:10.067 Message: lib/distributor: Defining dependency "distributor" 00:01:10.067 Message: lib/efd: Defining dependency "efd" 00:01:10.067 Message: lib/eventdev: Defining dependency "eventdev" 00:01:10.067 Message: lib/gpudev: Defining dependency "gpudev" 00:01:10.067 Message: lib/gro: Defining dependency "gro" 00:01:10.067 Message: lib/gso: Defining dependency "gso" 00:01:10.067 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:10.067 Message: lib/jobstats: Defining dependency "jobstats" 00:01:10.067 Message: lib/latencystats: Defining dependency "latencystats" 00:01:10.067 Message: lib/lpm: Defining dependency "lpm" 00:01:10.067 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:10.067 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:10.067 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:10.067 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:10.067 Message: lib/member: Defining dependency "member" 00:01:10.067 Message: lib/pcapng: Defining dependency "pcapng" 00:01:10.067 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:10.067 Message: lib/power: Defining dependency "power" 00:01:10.067 Message: lib/rawdev: Defining dependency "rawdev" 00:01:10.067 Message: lib/regexdev: Defining dependency "regexdev" 00:01:10.067 Message: lib/dmadev: Defining dependency "dmadev" 00:01:10.067 Message: lib/rib: Defining dependency "rib" 00:01:10.067 Message: lib/reorder: Defining dependency "reorder" 00:01:10.067 Message: lib/sched: Defining dependency "sched" 00:01:10.067 Message: lib/security: Defining dependency "security" 00:01:10.067 Message: lib/stack: Defining dependency "stack" 00:01:10.067 Has header "linux/userfaultfd.h" : YES 00:01:10.067 Message: lib/vhost: Defining dependency "vhost" 00:01:10.067 Message: lib/ipsec: Defining dependency "ipsec" 00:01:10.067 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:10.067 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:10.067 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:10.067 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:10.067 Message: lib/fib: Defining dependency "fib" 00:01:10.067 Message: lib/port: Defining dependency "port" 00:01:10.067 Message: lib/pdump: Defining dependency "pdump" 00:01:10.067 Message: lib/table: Defining dependency "table" 00:01:10.067 Message: lib/pipeline: Defining dependency "pipeline" 00:01:10.067 Message: lib/graph: Defining dependency "graph" 00:01:10.067 Message: lib/node: Defining dependency "node" 00:01:10.067 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:10.067 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:10.067 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:10.067 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:10.067 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:10.067 Compiler for C supports arguments -Wno-unused-value: YES 00:01:11.014 Compiler for C supports arguments -Wno-format: YES 00:01:11.014 Compiler for C supports arguments -Wno-format-security: YES 00:01:11.014 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:11.014 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:11.014 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:11.014 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:11.014 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:11.014 Compiler for C supports arguments -mavx2: YES (cached) 00:01:11.014 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:11.014 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:11.014 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:11.014 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:11.014 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:11.014 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:11.014 Configuring doxy-api.conf using configuration 00:01:11.014 Program sphinx-build found: NO 00:01:11.014 Configuring rte_build_config.h using configuration 00:01:11.014 Message: 00:01:11.014 ================= 00:01:11.014 Applications Enabled 00:01:11.014 ================= 00:01:11.014 00:01:11.014 apps: 00:01:11.014 dumpcap, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, test-crypto-perf, 00:01:11.014 test-eventdev, test-fib, test-flow-perf, test-gpudev, test-pipeline, test-pmd, test-regex, test-sad, 00:01:11.014 test-security-perf, 00:01:11.014 00:01:11.014 Message: 00:01:11.014 ================= 00:01:11.014 Libraries Enabled 00:01:11.014 ================= 00:01:11.014 00:01:11.014 libs: 00:01:11.014 kvargs, telemetry, eal, ring, rcu, mempool, mbuf, net, 00:01:11.014 meter, ethdev, pci, cmdline, metrics, hash, timer, acl, 00:01:11.014 bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, efd, 00:01:11.014 eventdev, gpudev, gro, gso, ip_frag, jobstats, latencystats, lpm, 00:01:11.014 member, pcapng, power, rawdev, regexdev, dmadev, rib, reorder, 00:01:11.014 sched, security, stack, vhost, ipsec, fib, port, pdump, 00:01:11.014 table, pipeline, graph, node, 00:01:11.014 00:01:11.014 Message: 00:01:11.014 =============== 00:01:11.014 Drivers Enabled 00:01:11.014 =============== 00:01:11.014 00:01:11.014 common: 00:01:11.014 00:01:11.014 bus: 00:01:11.014 pci, vdev, 00:01:11.014 mempool: 00:01:11.014 ring, 00:01:11.014 dma: 00:01:11.014 00:01:11.014 net: 00:01:11.014 i40e, 00:01:11.014 raw: 00:01:11.014 00:01:11.014 crypto: 00:01:11.014 00:01:11.014 compress: 00:01:11.014 00:01:11.014 regex: 00:01:11.014 00:01:11.014 vdpa: 00:01:11.014 00:01:11.014 event: 00:01:11.014 00:01:11.014 baseband: 00:01:11.014 00:01:11.014 gpu: 00:01:11.014 00:01:11.014 00:01:11.014 Message: 00:01:11.014 ================= 00:01:11.014 Content Skipped 00:01:11.014 ================= 00:01:11.014 00:01:11.014 apps: 00:01:11.014 00:01:11.014 libs: 00:01:11.014 kni: explicitly disabled via build config (deprecated lib) 00:01:11.014 flow_classify: explicitly disabled via build config (deprecated lib) 00:01:11.014 00:01:11.014 drivers: 00:01:11.014 common/cpt: not in enabled drivers build config 00:01:11.014 common/dpaax: not in enabled drivers build config 00:01:11.014 common/iavf: not in enabled drivers build config 00:01:11.014 common/idpf: not in enabled drivers build config 00:01:11.014 common/mvep: not in enabled drivers build config 00:01:11.014 common/octeontx: not in enabled drivers build config 00:01:11.014 bus/auxiliary: not in enabled drivers build config 00:01:11.014 bus/dpaa: not in enabled drivers build config 00:01:11.014 bus/fslmc: not in enabled drivers build config 00:01:11.014 bus/ifpga: not in enabled drivers build config 00:01:11.014 bus/vmbus: not in enabled drivers build config 00:01:11.014 common/cnxk: not in enabled drivers build config 00:01:11.014 common/mlx5: not in enabled drivers build config 00:01:11.014 common/qat: not in enabled drivers build config 00:01:11.014 common/sfc_efx: not in enabled drivers build config 00:01:11.014 mempool/bucket: not in enabled drivers build config 00:01:11.014 mempool/cnxk: not in enabled drivers build config 00:01:11.014 mempool/dpaa: not in enabled drivers build config 00:01:11.014 mempool/dpaa2: not in enabled drivers build config 00:01:11.014 mempool/octeontx: not in enabled drivers build config 00:01:11.014 mempool/stack: not in enabled drivers build config 00:01:11.014 dma/cnxk: not in enabled drivers build config 00:01:11.014 dma/dpaa: not in enabled drivers build config 00:01:11.015 dma/dpaa2: not in enabled drivers build config 00:01:11.015 dma/hisilicon: not in enabled drivers build config 00:01:11.015 dma/idxd: not in enabled drivers build config 00:01:11.015 dma/ioat: not in enabled drivers build config 00:01:11.015 dma/skeleton: not in enabled drivers build config 00:01:11.015 net/af_packet: not in enabled drivers build config 00:01:11.015 net/af_xdp: not in enabled drivers build config 00:01:11.015 net/ark: not in enabled drivers build config 00:01:11.015 net/atlantic: not in enabled drivers build config 00:01:11.015 net/avp: not in enabled drivers build config 00:01:11.015 net/axgbe: not in enabled drivers build config 00:01:11.015 net/bnx2x: not in enabled drivers build config 00:01:11.015 net/bnxt: not in enabled drivers build config 00:01:11.015 net/bonding: not in enabled drivers build config 00:01:11.015 net/cnxk: not in enabled drivers build config 00:01:11.015 net/cxgbe: not in enabled drivers build config 00:01:11.015 net/dpaa: not in enabled drivers build config 00:01:11.015 net/dpaa2: not in enabled drivers build config 00:01:11.015 net/e1000: not in enabled drivers build config 00:01:11.015 net/ena: not in enabled drivers build config 00:01:11.015 net/enetc: not in enabled drivers build config 00:01:11.015 net/enetfec: not in enabled drivers build config 00:01:11.015 net/enic: not in enabled drivers build config 00:01:11.015 net/failsafe: not in enabled drivers build config 00:01:11.015 net/fm10k: not in enabled drivers build config 00:01:11.015 net/gve: not in enabled drivers build config 00:01:11.015 net/hinic: not in enabled drivers build config 00:01:11.015 net/hns3: not in enabled drivers build config 00:01:11.015 net/iavf: not in enabled drivers build config 00:01:11.015 net/ice: not in enabled drivers build config 00:01:11.015 net/idpf: not in enabled drivers build config 00:01:11.015 net/igc: not in enabled drivers build config 00:01:11.015 net/ionic: not in enabled drivers build config 00:01:11.015 net/ipn3ke: not in enabled drivers build config 00:01:11.015 net/ixgbe: not in enabled drivers build config 00:01:11.015 net/kni: not in enabled drivers build config 00:01:11.015 net/liquidio: not in enabled drivers build config 00:01:11.015 net/mana: not in enabled drivers build config 00:01:11.015 net/memif: not in enabled drivers build config 00:01:11.015 net/mlx4: not in enabled drivers build config 00:01:11.015 net/mlx5: not in enabled drivers build config 00:01:11.015 net/mvneta: not in enabled drivers build config 00:01:11.015 net/mvpp2: not in enabled drivers build config 00:01:11.015 net/netvsc: not in enabled drivers build config 00:01:11.015 net/nfb: not in enabled drivers build config 00:01:11.015 net/nfp: not in enabled drivers build config 00:01:11.015 net/ngbe: not in enabled drivers build config 00:01:11.015 net/null: not in enabled drivers build config 00:01:11.015 net/octeontx: not in enabled drivers build config 00:01:11.015 net/octeon_ep: not in enabled drivers build config 00:01:11.015 net/pcap: not in enabled drivers build config 00:01:11.015 net/pfe: not in enabled drivers build config 00:01:11.015 net/qede: not in enabled drivers build config 00:01:11.015 net/ring: not in enabled drivers build config 00:01:11.015 net/sfc: not in enabled drivers build config 00:01:11.015 net/softnic: not in enabled drivers build config 00:01:11.015 net/tap: not in enabled drivers build config 00:01:11.015 net/thunderx: not in enabled drivers build config 00:01:11.015 net/txgbe: not in enabled drivers build config 00:01:11.015 net/vdev_netvsc: not in enabled drivers build config 00:01:11.015 net/vhost: not in enabled drivers build config 00:01:11.015 net/virtio: not in enabled drivers build config 00:01:11.015 net/vmxnet3: not in enabled drivers build config 00:01:11.015 raw/cnxk_bphy: not in enabled drivers build config 00:01:11.015 raw/cnxk_gpio: not in enabled drivers build config 00:01:11.015 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:11.015 raw/ifpga: not in enabled drivers build config 00:01:11.015 raw/ntb: not in enabled drivers build config 00:01:11.015 raw/skeleton: not in enabled drivers build config 00:01:11.015 crypto/armv8: not in enabled drivers build config 00:01:11.015 crypto/bcmfs: not in enabled drivers build config 00:01:11.015 crypto/caam_jr: not in enabled drivers build config 00:01:11.015 crypto/ccp: not in enabled drivers build config 00:01:11.015 crypto/cnxk: not in enabled drivers build config 00:01:11.015 crypto/dpaa_sec: not in enabled drivers build config 00:01:11.015 crypto/dpaa2_sec: not in enabled drivers build config 00:01:11.015 crypto/ipsec_mb: not in enabled drivers build config 00:01:11.015 crypto/mlx5: not in enabled drivers build config 00:01:11.015 crypto/mvsam: not in enabled drivers build config 00:01:11.015 crypto/nitrox: not in enabled drivers build config 00:01:11.015 crypto/null: not in enabled drivers build config 00:01:11.015 crypto/octeontx: not in enabled drivers build config 00:01:11.015 crypto/openssl: not in enabled drivers build config 00:01:11.015 crypto/scheduler: not in enabled drivers build config 00:01:11.015 crypto/uadk: not in enabled drivers build config 00:01:11.015 crypto/virtio: not in enabled drivers build config 00:01:11.015 compress/isal: not in enabled drivers build config 00:01:11.015 compress/mlx5: not in enabled drivers build config 00:01:11.015 compress/octeontx: not in enabled drivers build config 00:01:11.015 compress/zlib: not in enabled drivers build config 00:01:11.015 regex/mlx5: not in enabled drivers build config 00:01:11.015 regex/cn9k: not in enabled drivers build config 00:01:11.015 vdpa/ifc: not in enabled drivers build config 00:01:11.015 vdpa/mlx5: not in enabled drivers build config 00:01:11.015 vdpa/sfc: not in enabled drivers build config 00:01:11.015 event/cnxk: not in enabled drivers build config 00:01:11.015 event/dlb2: not in enabled drivers build config 00:01:11.015 event/dpaa: not in enabled drivers build config 00:01:11.015 event/dpaa2: not in enabled drivers build config 00:01:11.015 event/dsw: not in enabled drivers build config 00:01:11.015 event/opdl: not in enabled drivers build config 00:01:11.015 event/skeleton: not in enabled drivers build config 00:01:11.015 event/sw: not in enabled drivers build config 00:01:11.015 event/octeontx: not in enabled drivers build config 00:01:11.015 baseband/acc: not in enabled drivers build config 00:01:11.015 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:11.015 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:11.015 baseband/la12xx: not in enabled drivers build config 00:01:11.015 baseband/null: not in enabled drivers build config 00:01:11.015 baseband/turbo_sw: not in enabled drivers build config 00:01:11.015 gpu/cuda: not in enabled drivers build config 00:01:11.015 00:01:11.015 00:01:11.015 Build targets in project: 316 00:01:11.015 00:01:11.015 DPDK 22.11.4 00:01:11.015 00:01:11.015 User defined options 00:01:11.015 libdir : lib 00:01:11.015 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:11.015 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:11.015 c_link_args : 00:01:11.015 enable_docs : false 00:01:11.015 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:11.015 enable_kmods : false 00:01:11.015 machine : native 00:01:11.015 tests : false 00:01:11.015 00:01:11.015 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:11.015 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:11.015 01:43:45 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:11.015 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:11.015 [1/745] Generating lib/rte_telemetry_def with a custom command 00:01:11.015 [2/745] Generating lib/rte_kvargs_mingw with a custom command 00:01:11.015 [3/745] Generating lib/rte_kvargs_def with a custom command 00:01:11.015 [4/745] Generating lib/rte_telemetry_mingw with a custom command 00:01:11.015 [5/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:11.015 [6/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:11.015 [7/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:11.015 [8/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:11.015 [9/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:11.015 [10/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:11.275 [11/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:11.275 [12/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:11.275 [13/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:11.275 [14/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:11.275 [15/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:11.275 [16/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:11.275 [17/745] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:11.275 [18/745] Linking static target lib/librte_kvargs.a 00:01:11.275 [19/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:11.275 [20/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:11.276 [21/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:11.276 [22/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:11.276 [23/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:11.276 [24/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:11.276 [25/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:11.276 [26/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:11.276 [27/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:11.276 [28/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:11.276 [29/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:11.276 [30/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:11.276 [31/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_log.c.o 00:01:11.276 [32/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:11.276 [33/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:11.276 [34/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:11.276 [35/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:11.276 [36/745] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:11.276 [37/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:11.276 [38/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:11.276 [39/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:11.276 [40/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:11.276 [41/745] Generating lib/rte_eal_def with a custom command 00:01:11.276 [42/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:11.276 [43/745] Generating lib/rte_eal_mingw with a custom command 00:01:11.276 [44/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:11.276 [45/745] Generating lib/rte_ring_def with a custom command 00:01:11.276 [46/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:11.276 [47/745] Generating lib/rte_ring_mingw with a custom command 00:01:11.276 [48/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:11.276 [49/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:11.276 [50/745] Generating lib/rte_rcu_def with a custom command 00:01:11.276 [51/745] Generating lib/rte_rcu_mingw with a custom command 00:01:11.276 [52/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:11.276 [53/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:11.276 [54/745] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:11.538 [55/745] Generating lib/rte_mempool_def with a custom command 00:01:11.538 [56/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:11.538 [57/745] Generating lib/rte_mempool_mingw with a custom command 00:01:11.538 [58/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_log.c.o 00:01:11.538 [59/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:11.538 [60/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:11.538 [61/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:11.538 [62/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:11.538 [63/745] Generating lib/rte_mbuf_mingw with a custom command 00:01:11.538 [64/745] Generating lib/rte_mbuf_def with a custom command 00:01:11.538 [65/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:11.538 [66/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:11.538 [67/745] Generating lib/rte_net_def with a custom command 00:01:11.538 [68/745] Generating lib/rte_net_mingw with a custom command 00:01:11.538 [69/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:11.538 [70/745] Generating lib/rte_meter_def with a custom command 00:01:11.538 [71/745] Generating lib/rte_meter_mingw with a custom command 00:01:11.538 [72/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:11.538 [73/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:11.538 [74/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:11.538 [75/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:11.538 [76/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:11.538 [77/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:11.538 [78/745] Generating lib/rte_ethdev_def with a custom command 00:01:11.538 [79/745] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.538 [80/745] Generating lib/rte_ethdev_mingw with a custom command 00:01:11.538 [81/745] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:11.538 [82/745] Linking target lib/librte_kvargs.so.23.0 00:01:11.538 [83/745] Linking static target lib/librte_ring.a 00:01:11.538 [84/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:11.799 [85/745] Generating lib/rte_pci_def with a custom command 00:01:11.799 [86/745] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:11.799 [87/745] Linking static target lib/librte_meter.a 00:01:11.799 [88/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:11.799 [89/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:11.799 [90/745] Generating lib/rte_pci_mingw with a custom command 00:01:11.799 [91/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:11.799 [92/745] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:11.799 [93/745] Linking static target lib/librte_pci.a 00:01:11.799 [94/745] Generating symbol file lib/librte_kvargs.so.23.0.p/librte_kvargs.so.23.0.symbols 00:01:11.799 [95/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:12.061 [96/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:12.061 [97/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:12.061 [98/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:12.061 [99/745] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.061 [100/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:12.061 [101/745] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.061 [102/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:12.061 [103/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:12.061 [104/745] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.061 [105/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:12.061 [106/745] Generating lib/rte_cmdline_def with a custom command 00:01:12.061 [107/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:12.061 [108/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:12.061 [109/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:12.061 [110/745] Linking static target lib/librte_telemetry.a 00:01:12.061 [111/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:12.061 [112/745] Generating lib/rte_cmdline_mingw with a custom command 00:01:12.061 [113/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:12.061 [114/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:12.061 [115/745] Generating lib/rte_metrics_def with a custom command 00:01:12.322 [116/745] Generating lib/rte_metrics_mingw with a custom command 00:01:12.322 [117/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:12.322 [118/745] Generating lib/rte_hash_mingw with a custom command 00:01:12.322 [119/745] Generating lib/rte_hash_def with a custom command 00:01:12.322 [120/745] Generating lib/rte_timer_def with a custom command 00:01:12.322 [121/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:12.322 [122/745] Generating lib/rte_timer_mingw with a custom command 00:01:12.322 [123/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:12.322 [124/745] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:12.584 [125/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:12.584 [126/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:12.584 [127/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:12.584 [128/745] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:12.584 [129/745] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:12.584 [130/745] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:12.584 [131/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:12.584 [132/745] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:12.584 [133/745] Generating lib/rte_acl_mingw with a custom command 00:01:12.584 [134/745] Generating lib/rte_acl_def with a custom command 00:01:12.584 [135/745] Generating lib/rte_bbdev_mingw with a custom command 00:01:12.584 [136/745] Generating lib/rte_bbdev_def with a custom command 00:01:12.584 [137/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:12.584 [138/745] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.584 [139/745] Generating lib/rte_bitratestats_mingw with a custom command 00:01:12.584 [140/745] Generating lib/rte_bitratestats_def with a custom command 00:01:12.843 [141/745] Linking target lib/librte_telemetry.so.23.0 00:01:12.843 [142/745] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:12.843 [143/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:12.843 [144/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:12.843 [145/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:12.843 [146/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:12.843 [147/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:12.843 [148/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:12.843 [149/745] Generating lib/rte_bpf_def with a custom command 00:01:12.843 [150/745] Generating lib/rte_bpf_mingw with a custom command 00:01:12.843 [151/745] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:12.843 [152/745] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:12.843 [153/745] Generating lib/rte_cfgfile_def with a custom command 00:01:12.843 [154/745] Generating lib/rte_cfgfile_mingw with a custom command 00:01:12.843 [155/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:12.843 [156/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:12.843 [157/745] Generating symbol file lib/librte_telemetry.so.23.0.p/librte_telemetry.so.23.0.symbols 00:01:13.107 [158/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:13.107 [159/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:13.107 [160/745] Generating lib/rte_compressdev_def with a custom command 00:01:13.107 [161/745] Generating lib/rte_compressdev_mingw with a custom command 00:01:13.107 [162/745] Generating lib/rte_cryptodev_mingw with a custom command 00:01:13.107 [163/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:13.107 [164/745] Generating lib/rte_cryptodev_def with a custom command 00:01:13.107 [165/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:13.107 [166/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:13.107 [167/745] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:13.107 [168/745] Linking static target lib/librte_rcu.a 00:01:13.107 [169/745] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:13.107 [170/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:13.107 [171/745] Linking static target lib/librte_timer.a 00:01:13.107 [172/745] Linking static target lib/librte_cmdline.a 00:01:13.107 [173/745] Generating lib/rte_distributor_mingw with a custom command 00:01:13.107 [174/745] Generating lib/rte_distributor_def with a custom command 00:01:13.107 [175/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:13.107 [176/745] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:13.107 [177/745] Generating lib/rte_efd_def with a custom command 00:01:13.107 [178/745] Linking static target lib/librte_net.a 00:01:13.107 [179/745] Generating lib/rte_efd_mingw with a custom command 00:01:13.107 [180/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:13.369 [181/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:13.369 [182/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:13.369 [183/745] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:13.369 [184/745] Linking static target lib/librte_metrics.a 00:01:13.369 [185/745] Linking static target lib/librte_cfgfile.a 00:01:13.369 [186/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:13.369 [187/745] Linking static target lib/librte_mempool.a 00:01:13.632 [188/745] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.632 [189/745] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:13.632 [190/745] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.632 [191/745] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.632 [192/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:13.632 [193/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:13.925 [194/745] Linking static target lib/librte_eal.a 00:01:13.925 [195/745] Generating lib/rte_eventdev_def with a custom command 00:01:13.925 [196/745] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:13.925 [197/745] Generating lib/rte_eventdev_mingw with a custom command 00:01:13.925 [198/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:13.925 [199/745] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.925 [200/745] Generating lib/rte_gpudev_def with a custom command 00:01:13.925 [201/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:13.925 [202/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:13.925 [203/745] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.925 [204/745] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:13.925 [205/745] Generating lib/rte_gpudev_mingw with a custom command 00:01:13.925 [206/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:13.925 [207/745] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:13.925 [208/745] Linking static target lib/librte_bitratestats.a 00:01:13.925 [209/745] Generating lib/rte_gro_def with a custom command 00:01:13.925 [210/745] Generating lib/rte_gro_mingw with a custom command 00:01:14.198 [211/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:14.198 [212/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:14.198 [213/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:14.198 [214/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:14.198 [215/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:14.198 [216/745] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.198 [217/745] Generating lib/rte_gso_mingw with a custom command 00:01:14.198 [218/745] Generating lib/rte_gso_def with a custom command 00:01:14.489 [219/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:14.489 [220/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:14.489 [221/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:14.489 [222/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:14.489 [223/745] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.489 [224/745] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:14.489 [225/745] Linking static target lib/librte_bbdev.a 00:01:14.489 [226/745] Generating lib/rte_ip_frag_def with a custom command 00:01:14.489 [227/745] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.489 [228/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:14.489 [229/745] Generating lib/rte_ip_frag_mingw with a custom command 00:01:14.489 [230/745] Generating lib/rte_jobstats_def with a custom command 00:01:14.757 [231/745] Generating lib/rte_jobstats_mingw with a custom command 00:01:14.757 [232/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:14.757 [233/745] Generating lib/rte_latencystats_def with a custom command 00:01:14.757 [234/745] Generating lib/rte_latencystats_mingw with a custom command 00:01:14.757 [235/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:14.757 [236/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:14.757 [237/745] Linking static target lib/librte_compressdev.a 00:01:14.757 [238/745] Generating lib/rte_lpm_def with a custom command 00:01:14.757 [239/745] Generating lib/rte_lpm_mingw with a custom command 00:01:14.757 [240/745] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:14.757 [241/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:14.757 [242/745] Linking static target lib/librte_jobstats.a 00:01:15.017 [243/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:15.017 [244/745] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:15.017 [245/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:15.278 [246/745] Linking static target lib/librte_distributor.a 00:01:15.278 [247/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:15.278 [248/745] Generating lib/rte_member_def with a custom command 00:01:15.278 [249/745] Generating lib/rte_member_mingw with a custom command 00:01:15.278 [250/745] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:15.278 [251/745] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:15.278 [252/745] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:15.278 [253/745] Generating lib/rte_pcapng_def with a custom command 00:01:15.278 [254/745] Generating lib/rte_pcapng_mingw with a custom command 00:01:15.543 [255/745] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:15.543 [256/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:15.543 [257/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:15.543 [258/745] Linking static target lib/librte_bpf.a 00:01:15.543 [259/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:15.543 [260/745] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:15.543 [261/745] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:15.543 [262/745] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:15.543 [263/745] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:15.543 [264/745] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:15.543 [265/745] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:15.543 [266/745] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:15.543 [267/745] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:15.543 [268/745] Generating lib/rte_power_def with a custom command 00:01:15.543 [269/745] Generating lib/rte_power_mingw with a custom command 00:01:15.543 [270/745] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:15.543 [271/745] Generating lib/rte_rawdev_def with a custom command 00:01:15.543 [272/745] Linking static target lib/librte_gpudev.a 00:01:15.543 [273/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:15.543 [274/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:15.543 [275/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:15.543 [276/745] Generating lib/rte_rawdev_mingw with a custom command 00:01:15.808 [277/745] Linking static target lib/librte_gro.a 00:01:15.808 [278/745] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:15.808 [279/745] Generating lib/rte_regexdev_def with a custom command 00:01:15.809 [280/745] Generating lib/rte_regexdev_mingw with a custom command 00:01:15.809 [281/745] Generating lib/rte_dmadev_def with a custom command 00:01:15.809 [282/745] Generating lib/rte_dmadev_mingw with a custom command 00:01:15.809 [283/745] Generating lib/rte_rib_def with a custom command 00:01:15.809 [284/745] Generating lib/rte_rib_mingw with a custom command 00:01:15.809 [285/745] Generating lib/rte_reorder_def with a custom command 00:01:15.809 [286/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:15.809 [287/745] Compiling C object lib/librte_power.a.p/power_rte_power_empty_poll.c.o 00:01:16.071 [288/745] Generating lib/rte_reorder_mingw with a custom command 00:01:16.071 [289/745] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.071 [290/745] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.071 [291/745] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:16.071 [292/745] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:16.071 [293/745] Generating lib/rte_sched_def with a custom command 00:01:16.071 [294/745] Generating lib/rte_sched_mingw with a custom command 00:01:16.071 [295/745] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.071 [296/745] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:16.071 [297/745] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:16.071 [298/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:16.071 [299/745] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:16.071 [300/745] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:16.071 [301/745] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:16.071 [302/745] Generating lib/rte_security_mingw with a custom command 00:01:16.071 [303/745] Generating lib/rte_security_def with a custom command 00:01:16.071 [304/745] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:16.071 [305/745] Linking static target lib/librte_latencystats.a 00:01:16.334 [306/745] Generating lib/rte_stack_def with a custom command 00:01:16.334 [307/745] Generating lib/rte_stack_mingw with a custom command 00:01:16.334 [308/745] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:16.334 [309/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:16.334 [310/745] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:16.334 [311/745] Linking static target lib/librte_rawdev.a 00:01:16.334 [312/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:16.334 [313/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:16.334 [314/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:16.334 [315/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:16.334 [316/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:16.334 [317/745] Linking static target lib/librte_stack.a 00:01:16.334 [318/745] Generating lib/rte_vhost_mingw with a custom command 00:01:16.334 [319/745] Generating lib/rte_vhost_def with a custom command 00:01:16.334 [320/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:16.334 [321/745] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:16.334 [322/745] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:16.334 [323/745] Linking static target lib/librte_dmadev.a 00:01:16.595 [324/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:16.595 [325/745] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.595 [326/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:16.595 [327/745] Linking static target lib/librte_ip_frag.a 00:01:16.595 [328/745] Generating lib/rte_ipsec_def with a custom command 00:01:16.595 [329/745] Generating lib/rte_ipsec_mingw with a custom command 00:01:16.595 [330/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:16.595 [331/745] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.858 [332/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:16.858 [333/745] Compiling C object lib/librte_power.a.p/power_rte_power_intel_uncore.c.o 00:01:16.858 [334/745] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.858 [335/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:16.858 [336/745] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.126 [337/745] Generating lib/rte_fib_def with a custom command 00:01:17.126 [338/745] Generating lib/rte_fib_mingw with a custom command 00:01:17.126 [339/745] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.126 [340/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:17.126 [341/745] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:17.126 [342/745] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:17.126 [343/745] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:17.126 [344/745] Linking static target lib/librte_gso.a 00:01:17.126 [345/745] Linking static target lib/librte_regexdev.a 00:01:17.388 [346/745] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.388 [347/745] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:17.388 [348/745] Linking static target lib/librte_efd.a 00:01:17.388 [349/745] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.388 [350/745] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:17.649 [351/745] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:17.649 [352/745] Linking static target lib/librte_pcapng.a 00:01:17.649 [353/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:17.649 [354/745] Linking static target lib/librte_lpm.a 00:01:17.649 [355/745] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:17.649 [356/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:17.649 [357/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:17.649 [358/745] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:17.649 [359/745] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:17.649 [360/745] Linking static target lib/librte_reorder.a 00:01:17.649 [361/745] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.914 [362/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:17.914 [363/745] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:17.914 [364/745] Generating lib/rte_port_def with a custom command 00:01:17.914 [365/745] Generating lib/rte_port_mingw with a custom command 00:01:17.914 [366/745] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:17.914 [367/745] Generating lib/rte_pdump_def with a custom command 00:01:17.914 [368/745] Generating lib/rte_pdump_mingw with a custom command 00:01:17.914 [369/745] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:17.914 [370/745] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:17.914 [371/745] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:17.914 [372/745] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:17.914 [373/745] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:18.176 [374/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:18.176 [375/745] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.176 [376/745] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:18.176 [377/745] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.176 [378/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:18.176 [379/745] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:18.176 [380/745] Linking static target lib/librte_security.a 00:01:18.176 [381/745] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.176 [382/745] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:18.176 [383/745] Linking static target lib/librte_power.a 00:01:18.176 [384/745] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:18.176 [385/745] Linking static target lib/acl/libavx2_tmp.a 00:01:18.176 [386/745] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.176 [387/745] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:18.437 [388/745] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:18.437 [389/745] Linking static target lib/acl/libavx512_tmp.a 00:01:18.437 [390/745] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:18.437 [391/745] Linking static target lib/librte_acl.a 00:01:18.437 [392/745] Linking static target lib/librte_hash.a 00:01:18.437 [393/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:18.437 [394/745] Linking static target lib/librte_rib.a 00:01:18.437 [395/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:18.703 [396/745] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:18.703 [397/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:18.703 [398/745] Generating lib/rte_table_def with a custom command 00:01:18.703 [399/745] Generating lib/rte_table_mingw with a custom command 00:01:18.968 [400/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:18.968 [401/745] Linking static target lib/librte_ethdev.a 00:01:18.968 [402/745] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.968 [403/745] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.968 [404/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:19.231 [405/745] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.231 [406/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:19.231 [407/745] Linking static target lib/librte_mbuf.a 00:01:19.231 [408/745] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:19.231 [409/745] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:19.231 [410/745] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:19.231 [411/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:19.231 [412/745] Generating lib/rte_pipeline_mingw with a custom command 00:01:19.231 [413/745] Generating lib/rte_pipeline_def with a custom command 00:01:19.231 [414/745] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:19.231 [415/745] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:19.492 [416/745] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:19.492 [417/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:19.492 [418/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:19.492 [419/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:19.492 [420/745] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:19.492 [421/745] Linking static target lib/librte_fib.a 00:01:19.492 [422/745] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:19.492 [423/745] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.492 [424/745] Generating lib/rte_graph_def with a custom command 00:01:19.492 [425/745] Generating lib/rte_graph_mingw with a custom command 00:01:19.492 [426/745] Linking static target lib/librte_member.a 00:01:19.752 [427/745] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.752 [428/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:19.752 [429/745] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:19.752 [430/745] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:19.752 [431/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:19.752 [432/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:19.752 [433/745] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:19.752 [434/745] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:19.752 [435/745] Generating lib/rte_node_def with a custom command 00:01:20.018 [436/745] Generating lib/rte_node_mingw with a custom command 00:01:20.018 [437/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:20.018 [438/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:20.018 [439/745] Linking static target lib/librte_eventdev.a 00:01:20.018 [440/745] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.018 [441/745] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.018 [442/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:20.018 [443/745] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.018 [444/745] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:20.018 [445/745] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:20.018 [446/745] Generating drivers/rte_bus_pci_def with a custom command 00:01:20.018 [447/745] Linking static target lib/librte_sched.a 00:01:20.018 [448/745] Generating drivers/rte_bus_pci_mingw with a custom command 00:01:20.018 [449/745] Generating drivers/rte_bus_vdev_def with a custom command 00:01:20.277 [450/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:20.277 [451/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:20.277 [452/745] Generating drivers/rte_bus_vdev_mingw with a custom command 00:01:20.277 [453/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:20.277 [454/745] Generating drivers/rte_mempool_ring_def with a custom command 00:01:20.277 [455/745] Generating drivers/rte_mempool_ring_mingw with a custom command 00:01:20.277 [456/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:20.277 [457/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:20.277 [458/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:20.277 [459/745] Linking static target lib/librte_cryptodev.a 00:01:20.277 [460/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:20.539 [461/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:20.539 [462/745] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:20.539 [463/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:20.539 [464/745] Linking static target lib/librte_pdump.a 00:01:20.539 [465/745] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:20.539 [466/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:20.539 [467/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:20.539 [468/745] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:20.539 [469/745] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:20.539 [470/745] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:20.800 [471/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:20.800 [472/745] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:20.800 [473/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:20.800 [474/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:20.800 [475/745] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.800 [476/745] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:20.800 [477/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:20.800 [478/745] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:20.800 [479/745] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:20.800 [480/745] Generating drivers/rte_net_i40e_def with a custom command 00:01:21.062 [481/745] Generating drivers/rte_net_i40e_mingw with a custom command 00:01:21.062 [482/745] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.062 [483/745] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:21.062 [484/745] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:21.062 [485/745] Linking static target drivers/librte_bus_vdev.a 00:01:21.062 [486/745] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:21.062 [487/745] Compiling C object drivers/librte_bus_vdev.so.23.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:21.062 [488/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:21.062 [489/745] Linking static target lib/librte_table.a 00:01:21.062 [490/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:21.062 [491/745] Linking static target lib/librte_ipsec.a 00:01:21.062 [492/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:21.325 [493/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:21.325 [494/745] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:21.325 [495/745] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.588 [496/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:21.588 [497/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:21.588 [498/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:21.588 [499/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:21.850 [500/745] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.850 [501/745] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:21.850 [502/745] Linking static target lib/librte_graph.a 00:01:21.850 [503/745] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:21.850 [504/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:21.850 [505/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:21.850 [506/745] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:21.850 [507/745] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:21.850 [508/745] Linking static target drivers/librte_bus_pci.a 00:01:21.850 [509/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:21.850 [510/745] Compiling C object drivers/librte_bus_pci.so.23.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:21.850 [511/745] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:21.850 [512/745] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:22.113 [513/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:22.113 [514/745] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.377 [515/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:22.641 [516/745] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.641 [517/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:22.641 [518/745] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:22.641 [519/745] Linking static target lib/librte_port.a 00:01:22.641 [520/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:22.903 [521/745] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.903 [522/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:22.903 [523/745] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:22.903 [524/745] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:22.903 [525/745] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:22.903 [526/745] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:23.166 [527/745] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.166 [528/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:23.166 [529/745] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:23.166 [530/745] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:23.166 [531/745] Linking static target drivers/librte_mempool_ring.a 00:01:23.428 [532/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:23.428 [533/745] Compiling C object drivers/librte_mempool_ring.so.23.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:23.428 [534/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:23.428 [535/745] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:23.428 [536/745] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:23.428 [537/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:23.428 [538/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:23.428 [539/745] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.697 [540/745] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.697 [541/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:23.962 [542/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:23.962 [543/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:24.224 [544/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:24.224 [545/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:24.224 [546/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:24.224 [547/745] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:24.224 [548/745] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:24.224 [549/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:24.487 [550/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:24.487 [551/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:24.487 [552/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:24.748 [553/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:25.006 [554/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:25.006 [555/745] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:25.006 [556/745] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:25.006 [557/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:25.267 [558/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:25.267 [559/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:25.529 [560/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:25.529 [561/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:25.529 [562/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:25.529 [563/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:25.529 [564/745] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:25.529 [565/745] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.791 [566/745] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:25.791 [567/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:25.791 [568/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:25.791 [569/745] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:25.791 [570/745] Linking target lib/librte_eal.so.23.0 00:01:25.791 [571/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:25.791 [572/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:26.054 [573/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:26.054 [574/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:26.054 [575/745] Generating symbol file lib/librte_eal.so.23.0.p/librte_eal.so.23.0.symbols 00:01:26.054 [576/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:26.054 [577/745] Linking target lib/librte_ring.so.23.0 00:01:26.054 [578/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:26.054 [579/745] Linking target lib/librte_meter.so.23.0 00:01:26.317 [580/745] Linking target lib/librte_pci.so.23.0 00:01:26.317 [581/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:26.317 [582/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:26.317 [583/745] Generating symbol file lib/librte_ring.so.23.0.p/librte_ring.so.23.0.symbols 00:01:26.317 [584/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:26.317 [585/745] Linking target lib/librte_timer.so.23.0 00:01:26.317 [586/745] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.317 [587/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:26.317 [588/745] Generating symbol file lib/librte_meter.so.23.0.p/librte_meter.so.23.0.symbols 00:01:26.317 [589/745] Linking target lib/librte_acl.so.23.0 00:01:26.317 [590/745] Linking target lib/librte_rcu.so.23.0 00:01:26.317 [591/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:26.317 [592/745] Linking target lib/librte_mempool.so.23.0 00:01:26.317 [593/745] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:26.317 [594/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:26.317 [595/745] Linking target lib/librte_cfgfile.so.23.0 00:01:26.317 [596/745] Linking target lib/librte_jobstats.so.23.0 00:01:26.317 [597/745] Linking target lib/librte_rawdev.so.23.0 00:01:26.579 [598/745] Generating symbol file lib/librte_pci.so.23.0.p/librte_pci.so.23.0.symbols 00:01:26.579 [599/745] Linking target lib/librte_dmadev.so.23.0 00:01:26.579 [600/745] Linking target lib/librte_stack.so.23.0 00:01:26.579 [601/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:26.579 [602/745] Linking target lib/librte_graph.so.23.0 00:01:26.579 [603/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:26.579 [604/745] Linking target drivers/librte_bus_vdev.so.23.0 00:01:26.579 [605/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:26.579 [606/745] Linking target drivers/librte_bus_pci.so.23.0 00:01:26.579 [607/745] Generating symbol file lib/librte_timer.so.23.0.p/librte_timer.so.23.0.symbols 00:01:26.579 [608/745] Generating symbol file lib/librte_rcu.so.23.0.p/librte_rcu.so.23.0.symbols 00:01:26.579 [609/745] Generating symbol file lib/librte_mempool.so.23.0.p/librte_mempool.so.23.0.symbols 00:01:26.579 [610/745] Generating symbol file lib/librte_acl.so.23.0.p/librte_acl.so.23.0.symbols 00:01:26.839 [611/745] Linking target lib/librte_rib.so.23.0 00:01:26.839 [612/745] Linking target lib/librte_mbuf.so.23.0 00:01:26.839 [613/745] Generating symbol file lib/librte_dmadev.so.23.0.p/librte_dmadev.so.23.0.symbols 00:01:26.839 [614/745] Generating symbol file lib/librte_graph.so.23.0.p/librte_graph.so.23.0.symbols 00:01:26.839 [615/745] Generating symbol file drivers/librte_bus_vdev.so.23.0.p/librte_bus_vdev.so.23.0.symbols 00:01:26.839 [616/745] Generating symbol file drivers/librte_bus_pci.so.23.0.p/librte_bus_pci.so.23.0.symbols 00:01:26.839 [617/745] Linking target drivers/librte_mempool_ring.so.23.0 00:01:26.839 [618/745] Generating symbol file lib/librte_mbuf.so.23.0.p/librte_mbuf.so.23.0.symbols 00:01:26.839 [619/745] Generating symbol file lib/librte_rib.so.23.0.p/librte_rib.so.23.0.symbols 00:01:27.102 [620/745] Linking target lib/librte_bbdev.so.23.0 00:01:27.102 [621/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:27.102 [622/745] Linking target lib/librte_net.so.23.0 00:01:27.102 [623/745] Linking target lib/librte_compressdev.so.23.0 00:01:27.102 [624/745] Linking target lib/librte_cryptodev.so.23.0 00:01:27.102 [625/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:27.102 [626/745] Linking target lib/librte_distributor.so.23.0 00:01:27.102 [627/745] Linking target lib/librte_gpudev.so.23.0 00:01:27.102 [628/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:27.364 [629/745] Linking target lib/librte_regexdev.so.23.0 00:01:27.364 [630/745] Generating symbol file lib/librte_net.so.23.0.p/librte_net.so.23.0.symbols 00:01:27.364 [631/745] Linking target lib/librte_reorder.so.23.0 00:01:27.364 [632/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:27.364 [633/745] Linking target lib/librte_sched.so.23.0 00:01:27.364 [634/745] Linking target lib/librte_fib.so.23.0 00:01:27.364 [635/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:27.364 [636/745] Generating symbol file lib/librte_cryptodev.so.23.0.p/librte_cryptodev.so.23.0.symbols 00:01:27.364 [637/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:27.364 [638/745] Linking target lib/librte_cmdline.so.23.0 00:01:27.364 [639/745] Linking target lib/librte_ethdev.so.23.0 00:01:27.364 [640/745] Linking target lib/librte_hash.so.23.0 00:01:27.364 [641/745] Linking target lib/librte_security.so.23.0 00:01:27.364 [642/745] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:27.364 [643/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:27.623 [644/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:27.623 [645/745] Generating symbol file lib/librte_sched.so.23.0.p/librte_sched.so.23.0.symbols 00:01:27.623 [646/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:27.623 [647/745] Generating symbol file lib/librte_hash.so.23.0.p/librte_hash.so.23.0.symbols 00:01:27.623 [648/745] Generating symbol file lib/librte_ethdev.so.23.0.p/librte_ethdev.so.23.0.symbols 00:01:27.623 [649/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:27.623 [650/745] Generating symbol file lib/librte_security.so.23.0.p/librte_security.so.23.0.symbols 00:01:27.623 [651/745] Linking target lib/librte_lpm.so.23.0 00:01:27.623 [652/745] Linking target lib/librte_efd.so.23.0 00:01:27.623 [653/745] Linking target lib/librte_metrics.so.23.0 00:01:27.623 [654/745] Linking target lib/librte_member.so.23.0 00:01:27.623 [655/745] Linking target lib/librte_gso.so.23.0 00:01:27.623 [656/745] Linking target lib/librte_gro.so.23.0 00:01:27.623 [657/745] Linking target lib/librte_ip_frag.so.23.0 00:01:27.623 [658/745] Linking target lib/librte_pcapng.so.23.0 00:01:27.623 [659/745] Linking target lib/librte_bpf.so.23.0 00:01:27.623 [660/745] Linking target lib/librte_eventdev.so.23.0 00:01:27.623 [661/745] Linking target lib/librte_power.so.23.0 00:01:27.881 [662/745] Linking target lib/librte_ipsec.so.23.0 00:01:27.882 [663/745] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:27.882 [664/745] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:27.882 [665/745] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:27.882 [666/745] Generating symbol file lib/librte_lpm.so.23.0.p/librte_lpm.so.23.0.symbols 00:01:27.882 [667/745] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:27.882 [668/745] Generating symbol file lib/librte_metrics.so.23.0.p/librte_metrics.so.23.0.symbols 00:01:27.882 [669/745] Generating symbol file lib/librte_ip_frag.so.23.0.p/librte_ip_frag.so.23.0.symbols 00:01:27.882 [670/745] Generating symbol file lib/librte_pcapng.so.23.0.p/librte_pcapng.so.23.0.symbols 00:01:27.882 [671/745] Generating symbol file lib/librte_bpf.so.23.0.p/librte_bpf.so.23.0.symbols 00:01:27.882 [672/745] Linking target lib/librte_bitratestats.so.23.0 00:01:27.882 [673/745] Generating symbol file lib/librte_eventdev.so.23.0.p/librte_eventdev.so.23.0.symbols 00:01:27.882 [674/745] Linking target lib/librte_latencystats.so.23.0 00:01:27.882 [675/745] Linking target lib/librte_pdump.so.23.0 00:01:28.140 [676/745] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:28.140 [677/745] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:28.140 [678/745] Linking target lib/librte_port.so.23.0 00:01:28.140 [679/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:28.140 [680/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:28.140 [681/745] Generating symbol file lib/librte_port.so.23.0.p/librte_port.so.23.0.symbols 00:01:28.140 [682/745] Linking target lib/librte_table.so.23.0 00:01:28.399 [683/745] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:28.399 [684/745] Generating symbol file lib/librte_table.so.23.0.p/librte_table.so.23.0.symbols 00:01:28.399 [685/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:28.399 [686/745] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:28.399 [687/745] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:28.399 [688/745] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:28.399 [689/745] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:28.399 [690/745] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:28.657 [691/745] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:28.657 [692/745] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:28.916 [693/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:28.916 [694/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:28.916 [695/745] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:28.916 [696/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:29.174 [697/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:29.432 [698/745] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:29.432 [699/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:29.432 [700/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:29.432 [701/745] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:29.690 [702/745] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:01:29.948 [703/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:01:29.948 [704/745] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:29.948 [705/745] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:29.948 [706/745] Compiling C object drivers/librte_net_i40e.so.23.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:29.948 [707/745] Linking static target drivers/librte_net_i40e.a 00:01:30.206 [708/745] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:01:30.206 [709/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:01:30.464 [710/745] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:01:30.464 [711/745] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.464 [712/745] Linking target drivers/librte_net_i40e.so.23.0 00:01:31.837 [713/745] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:01:31.837 [714/745] Linking static target lib/librte_node.a 00:01:31.837 [715/745] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:01:31.837 [716/745] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.095 [717/745] Linking target lib/librte_node.so.23.0 00:01:32.662 [718/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:01:32.920 [719/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:01:41.031 [720/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:13.104 [721/745] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:13.104 [722/745] Linking static target lib/librte_vhost.a 00:02:13.104 [723/745] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:13.104 [724/745] Linking target lib/librte_vhost.so.23.0 00:02:28.052 [725/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:28.052 [726/745] Linking static target lib/librte_pipeline.a 00:02:28.052 [727/745] Linking target app/dpdk-proc-info 00:02:28.052 [728/745] Linking target app/dpdk-test-fib 00:02:28.052 [729/745] Linking target app/dpdk-test-sad 00:02:28.052 [730/745] Linking target app/dpdk-test-pipeline 00:02:28.052 [731/745] Linking target app/dpdk-test-flow-perf 00:02:28.052 [732/745] Linking target app/dpdk-test-cmdline 00:02:28.052 [733/745] Linking target app/dpdk-test-gpudev 00:02:28.052 [734/745] Linking target app/dpdk-test-security-perf 00:02:28.052 [735/745] Linking target app/dpdk-test-regex 00:02:28.052 [736/745] Linking target app/dpdk-pdump 00:02:28.052 [737/745] Linking target app/dpdk-dumpcap 00:02:28.052 [738/745] Linking target app/dpdk-test-acl 00:02:28.052 [739/745] Linking target app/dpdk-test-bbdev 00:02:28.052 [740/745] Linking target app/dpdk-test-crypto-perf 00:02:28.052 [741/745] Linking target app/dpdk-test-eventdev 00:02:28.052 [742/745] Linking target app/dpdk-test-compress-perf 00:02:28.052 [743/745] Linking target app/dpdk-testpmd 00:02:28.993 [744/745] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:28.993 [745/745] Linking target lib/librte_pipeline.so.23.0 00:02:28.993 01:45:03 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:28.993 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:28.993 [0/1] Installing files. 00:02:29.568 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/flow_classify.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/ipv4_rules_file.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:29.569 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.570 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.571 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.572 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/kni.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:29.573 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:29.574 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.574 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:30.147 Installing lib/librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:30.147 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:30.147 Installing lib/librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:30.147 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:30.147 Installing drivers/librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:30.147 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:30.147 Installing drivers/librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:30.147 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:30.147 Installing drivers/librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:30.147 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:30.147 Installing drivers/librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:30.147 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.147 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.148 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.149 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_empty_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_intel_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.150 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:30.151 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:30.151 Installing symlink pointing to librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.23 00:02:30.151 Installing symlink pointing to librte_kvargs.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:30.151 Installing symlink pointing to librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.23 00:02:30.151 Installing symlink pointing to librte_telemetry.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:30.151 Installing symlink pointing to librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.23 00:02:30.151 Installing symlink pointing to librte_eal.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:30.151 Installing symlink pointing to librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.23 00:02:30.151 Installing symlink pointing to librte_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:30.151 Installing symlink pointing to librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.23 00:02:30.151 Installing symlink pointing to librte_rcu.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:30.151 Installing symlink pointing to librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.23 00:02:30.151 Installing symlink pointing to librte_mempool.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:30.151 Installing symlink pointing to librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.23 00:02:30.151 Installing symlink pointing to librte_mbuf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:30.151 Installing symlink pointing to librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.23 00:02:30.151 Installing symlink pointing to librte_net.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:30.151 Installing symlink pointing to librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.23 00:02:30.151 Installing symlink pointing to librte_meter.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:30.151 Installing symlink pointing to librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.23 00:02:30.151 Installing symlink pointing to librte_ethdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:30.151 Installing symlink pointing to librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.23 00:02:30.151 Installing symlink pointing to librte_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:30.151 Installing symlink pointing to librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.23 00:02:30.151 Installing symlink pointing to librte_cmdline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:30.151 Installing symlink pointing to librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.23 00:02:30.151 Installing symlink pointing to librte_metrics.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:30.151 Installing symlink pointing to librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.23 00:02:30.151 Installing symlink pointing to librte_hash.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:30.151 Installing symlink pointing to librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.23 00:02:30.151 Installing symlink pointing to librte_timer.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:30.151 Installing symlink pointing to librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.23 00:02:30.151 Installing symlink pointing to librte_acl.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:30.151 Installing symlink pointing to librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.23 00:02:30.151 Installing symlink pointing to librte_bbdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:30.152 Installing symlink pointing to librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.23 00:02:30.152 Installing symlink pointing to librte_bitratestats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:30.152 Installing symlink pointing to librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.23 00:02:30.152 Installing symlink pointing to librte_bpf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:30.152 Installing symlink pointing to librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.23 00:02:30.152 Installing symlink pointing to librte_cfgfile.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:30.152 Installing symlink pointing to librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.23 00:02:30.152 Installing symlink pointing to librte_compressdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:30.152 Installing symlink pointing to librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.23 00:02:30.152 Installing symlink pointing to librte_cryptodev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:30.152 Installing symlink pointing to librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.23 00:02:30.152 Installing symlink pointing to librte_distributor.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:30.152 Installing symlink pointing to librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.23 00:02:30.152 Installing symlink pointing to librte_efd.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:30.152 Installing symlink pointing to librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.23 00:02:30.152 Installing symlink pointing to librte_eventdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:30.152 Installing symlink pointing to librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.23 00:02:30.152 Installing symlink pointing to librte_gpudev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:30.152 Installing symlink pointing to librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.23 00:02:30.152 Installing symlink pointing to librte_gro.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:30.152 Installing symlink pointing to librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.23 00:02:30.152 Installing symlink pointing to librte_gso.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:30.152 Installing symlink pointing to librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.23 00:02:30.152 Installing symlink pointing to librte_ip_frag.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:30.152 Installing symlink pointing to librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.23 00:02:30.152 Installing symlink pointing to librte_jobstats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:30.152 Installing symlink pointing to librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.23 00:02:30.152 Installing symlink pointing to librte_latencystats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:30.152 Installing symlink pointing to librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.23 00:02:30.152 Installing symlink pointing to librte_lpm.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:30.152 Installing symlink pointing to librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.23 00:02:30.152 Installing symlink pointing to librte_member.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:30.152 Installing symlink pointing to librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.23 00:02:30.152 Installing symlink pointing to librte_pcapng.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:30.152 Installing symlink pointing to librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.23 00:02:30.152 Installing symlink pointing to librte_power.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:30.152 Installing symlink pointing to librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.23 00:02:30.152 Installing symlink pointing to librte_rawdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:30.152 Installing symlink pointing to librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.23 00:02:30.152 Installing symlink pointing to librte_regexdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:30.152 Installing symlink pointing to librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.23 00:02:30.152 Installing symlink pointing to librte_dmadev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:30.152 Installing symlink pointing to librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.23 00:02:30.152 Installing symlink pointing to librte_rib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:30.152 Installing symlink pointing to librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.23 00:02:30.152 Installing symlink pointing to librte_reorder.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:30.152 Installing symlink pointing to librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.23 00:02:30.152 Installing symlink pointing to librte_sched.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:30.152 Installing symlink pointing to librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.23 00:02:30.152 Installing symlink pointing to librte_security.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:30.152 Installing symlink pointing to librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.23 00:02:30.152 Installing symlink pointing to librte_stack.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:30.152 Installing symlink pointing to librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.23 00:02:30.152 Installing symlink pointing to librte_vhost.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:30.152 Installing symlink pointing to librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.23 00:02:30.152 Installing symlink pointing to librte_ipsec.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:30.152 Installing symlink pointing to librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.23 00:02:30.152 Installing symlink pointing to librte_fib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:30.152 Installing symlink pointing to librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.23 00:02:30.152 Installing symlink pointing to librte_port.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:30.152 Installing symlink pointing to librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.23 00:02:30.152 Installing symlink pointing to librte_pdump.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:30.152 Installing symlink pointing to librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.23 00:02:30.152 Installing symlink pointing to librte_table.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:30.152 Installing symlink pointing to librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.23 00:02:30.152 Installing symlink pointing to librte_pipeline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:30.152 Installing symlink pointing to librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.23 00:02:30.152 Installing symlink pointing to librte_graph.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:30.152 Installing symlink pointing to librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.23 00:02:30.152 Installing symlink pointing to librte_node.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:30.152 Installing symlink pointing to librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23 00:02:30.152 Installing symlink pointing to librte_bus_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:02:30.152 Installing symlink pointing to librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23 00:02:30.152 Installing symlink pointing to librte_bus_vdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:02:30.152 Installing symlink pointing to librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23 00:02:30.152 Installing symlink pointing to librte_mempool_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:02:30.152 Installing symlink pointing to librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23 00:02:30.152 './librte_bus_pci.so' -> 'dpdk/pmds-23.0/librte_bus_pci.so' 00:02:30.152 './librte_bus_pci.so.23' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23' 00:02:30.152 './librte_bus_pci.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23.0' 00:02:30.152 './librte_bus_vdev.so' -> 'dpdk/pmds-23.0/librte_bus_vdev.so' 00:02:30.152 './librte_bus_vdev.so.23' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23' 00:02:30.152 './librte_bus_vdev.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23.0' 00:02:30.152 './librte_mempool_ring.so' -> 'dpdk/pmds-23.0/librte_mempool_ring.so' 00:02:30.152 './librte_mempool_ring.so.23' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23' 00:02:30.152 './librte_mempool_ring.so.23.0' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23.0' 00:02:30.152 './librte_net_i40e.so' -> 'dpdk/pmds-23.0/librte_net_i40e.so' 00:02:30.152 './librte_net_i40e.so.23' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23' 00:02:30.152 './librte_net_i40e.so.23.0' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23.0' 00:02:30.152 Installing symlink pointing to librte_net_i40e.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:02:30.152 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-23.0' 00:02:30.152 01:45:04 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:30.152 01:45:04 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:30.152 01:45:04 -- common/autobuild_common.sh@203 -- $ cat 00:02:30.153 01:45:04 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:30.153 00:02:30.153 real 1m25.357s 00:02:30.153 user 14m26.198s 00:02:30.153 sys 1m49.280s 00:02:30.153 01:45:04 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:30.153 01:45:04 -- common/autotest_common.sh@10 -- $ set +x 00:02:30.153 ************************************ 00:02:30.153 END TEST build_native_dpdk 00:02:30.153 ************************************ 00:02:30.153 01:45:04 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:30.153 01:45:04 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:30.153 01:45:04 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:30.153 01:45:04 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:30.153 01:45:04 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:30.153 01:45:04 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:30.153 01:45:04 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:30.153 01:45:04 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:30.153 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:30.412 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:30.412 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:30.412 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:30.670 Using 'verbs' RDMA provider 00:02:40.917 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:02:50.907 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:02:50.907 Creating mk/config.mk...done. 00:02:50.907 Creating mk/cc.flags.mk...done. 00:02:50.907 Type 'make' to build. 00:02:50.907 01:45:23 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:02:50.907 01:45:23 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:02:50.907 01:45:23 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:02:50.907 01:45:23 -- common/autotest_common.sh@10 -- $ set +x 00:02:50.907 ************************************ 00:02:50.907 START TEST make 00:02:50.907 ************************************ 00:02:50.907 01:45:23 -- common/autotest_common.sh@1114 -- $ make -j48 00:02:50.907 make[1]: Nothing to be done for 'all'. 00:02:51.481 The Meson build system 00:02:51.481 Version: 1.5.0 00:02:51.481 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:02:51.481 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:51.481 Build type: native build 00:02:51.481 Project name: libvfio-user 00:02:51.481 Project version: 0.0.1 00:02:51.481 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:02:51.481 C linker for the host machine: gcc ld.bfd 2.40-14 00:02:51.481 Host machine cpu family: x86_64 00:02:51.481 Host machine cpu: x86_64 00:02:51.481 Run-time dependency threads found: YES 00:02:51.481 Library dl found: YES 00:02:51.481 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:02:51.481 Run-time dependency json-c found: YES 0.17 00:02:51.481 Run-time dependency cmocka found: YES 1.1.7 00:02:51.481 Program pytest-3 found: NO 00:02:51.481 Program flake8 found: NO 00:02:51.481 Program misspell-fixer found: NO 00:02:51.481 Program restructuredtext-lint found: NO 00:02:51.481 Program valgrind found: YES (/usr/bin/valgrind) 00:02:51.481 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:02:51.481 Compiler for C supports arguments -Wmissing-declarations: YES 00:02:51.481 Compiler for C supports arguments -Wwrite-strings: YES 00:02:51.481 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:02:51.481 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:02:51.481 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:02:51.481 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:02:51.481 Build targets in project: 8 00:02:51.481 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:02:51.481 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:02:51.481 00:02:51.481 libvfio-user 0.0.1 00:02:51.481 00:02:51.481 User defined options 00:02:51.481 buildtype : debug 00:02:51.481 default_library: shared 00:02:51.481 libdir : /usr/local/lib 00:02:51.481 00:02:51.481 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:02:52.431 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:02:52.694 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:02:52.694 [2/37] Compiling C object samples/null.p/null.c.o 00:02:52.694 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:02:52.694 [4/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:02:52.694 [5/37] Compiling C object samples/lspci.p/lspci.c.o 00:02:52.694 [6/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:02:52.694 [7/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:02:52.694 [8/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:02:52.694 [9/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:02:52.694 [10/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:02:52.694 [11/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:02:52.694 [12/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:02:52.958 [13/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:02:52.958 [14/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:02:52.958 [15/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:02:52.958 [16/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:02:52.958 [17/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:02:52.958 [18/37] Compiling C object test/unit_tests.p/mocks.c.o 00:02:52.958 [19/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:02:52.958 [20/37] Compiling C object samples/server.p/server.c.o 00:02:52.958 [21/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:02:52.958 [22/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:02:52.958 [23/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:02:52.958 [24/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:02:52.958 [25/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:02:52.958 [26/37] Compiling C object samples/client.p/client.c.o 00:02:52.958 [27/37] Linking target samples/client 00:02:52.958 [28/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:02:53.218 [29/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:02:53.218 [30/37] Linking target test/unit_tests 00:02:53.218 [31/37] Linking target lib/libvfio-user.so.0.0.1 00:02:53.479 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:02:53.479 [33/37] Linking target samples/server 00:02:53.479 [34/37] Linking target samples/gpio-pci-idio-16 00:02:53.479 [35/37] Linking target samples/null 00:02:53.479 [36/37] Linking target samples/lspci 00:02:53.479 [37/37] Linking target samples/shadow_ioeventfd_server 00:02:53.479 INFO: autodetecting backend as ninja 00:02:53.479 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:53.479 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:54.426 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:02:54.426 ninja: no work to do. 00:03:04.396 CC lib/log/log.o 00:03:04.396 CC lib/log/log_flags.o 00:03:04.396 CC lib/ut_mock/mock.o 00:03:04.396 CC lib/log/log_deprecated.o 00:03:04.396 CC lib/ut/ut.o 00:03:04.654 LIB libspdk_ut_mock.a 00:03:04.654 SO libspdk_ut_mock.so.5.0 00:03:04.654 LIB libspdk_log.a 00:03:04.654 LIB libspdk_ut.a 00:03:04.654 SO libspdk_log.so.6.1 00:03:04.654 SO libspdk_ut.so.1.0 00:03:04.654 SYMLINK libspdk_ut_mock.so 00:03:04.654 SYMLINK libspdk_ut.so 00:03:04.654 SYMLINK libspdk_log.so 00:03:04.912 CC lib/dma/dma.o 00:03:04.912 CXX lib/trace_parser/trace.o 00:03:04.912 CC lib/ioat/ioat.o 00:03:04.912 CC lib/util/base64.o 00:03:04.912 CC lib/util/bit_array.o 00:03:04.912 CC lib/util/cpuset.o 00:03:04.912 CC lib/util/crc16.o 00:03:04.912 CC lib/util/crc32.o 00:03:04.912 CC lib/util/crc32c.o 00:03:04.912 CC lib/util/crc32_ieee.o 00:03:04.912 CC lib/util/crc64.o 00:03:04.912 CC lib/util/dif.o 00:03:04.912 CC lib/util/fd.o 00:03:04.912 CC lib/util/file.o 00:03:04.912 CC lib/util/hexlify.o 00:03:04.912 CC lib/util/iov.o 00:03:04.912 CC lib/util/math.o 00:03:04.912 CC lib/util/pipe.o 00:03:04.912 CC lib/util/strerror_tls.o 00:03:04.912 CC lib/util/string.o 00:03:04.912 CC lib/util/uuid.o 00:03:04.912 CC lib/util/fd_group.o 00:03:04.912 CC lib/util/xor.o 00:03:04.912 CC lib/util/zipf.o 00:03:04.912 CC lib/vfio_user/host/vfio_user_pci.o 00:03:04.912 CC lib/vfio_user/host/vfio_user.o 00:03:04.912 LIB libspdk_dma.a 00:03:04.912 SO libspdk_dma.so.3.0 00:03:05.170 SYMLINK libspdk_dma.so 00:03:05.170 LIB libspdk_ioat.a 00:03:05.170 SO libspdk_ioat.so.6.0 00:03:05.170 SYMLINK libspdk_ioat.so 00:03:05.170 LIB libspdk_vfio_user.a 00:03:05.170 SO libspdk_vfio_user.so.4.0 00:03:05.170 SYMLINK libspdk_vfio_user.so 00:03:05.428 LIB libspdk_util.a 00:03:05.428 SO libspdk_util.so.8.0 00:03:05.428 SYMLINK libspdk_util.so 00:03:05.686 CC lib/vmd/vmd.o 00:03:05.686 CC lib/conf/conf.o 00:03:05.686 CC lib/vmd/led.o 00:03:05.686 CC lib/json/json_parse.o 00:03:05.686 CC lib/idxd/idxd.o 00:03:05.686 CC lib/env_dpdk/env.o 00:03:05.686 CC lib/json/json_util.o 00:03:05.686 CC lib/rdma/common.o 00:03:05.686 CC lib/idxd/idxd_user.o 00:03:05.686 CC lib/env_dpdk/memory.o 00:03:05.686 CC lib/json/json_write.o 00:03:05.686 CC lib/rdma/rdma_verbs.o 00:03:05.686 CC lib/idxd/idxd_kernel.o 00:03:05.686 CC lib/env_dpdk/pci.o 00:03:05.686 CC lib/env_dpdk/init.o 00:03:05.686 CC lib/env_dpdk/threads.o 00:03:05.686 CC lib/env_dpdk/pci_ioat.o 00:03:05.686 CC lib/env_dpdk/pci_virtio.o 00:03:05.686 CC lib/env_dpdk/pci_vmd.o 00:03:05.686 CC lib/env_dpdk/pci_idxd.o 00:03:05.686 CC lib/env_dpdk/pci_event.o 00:03:05.686 CC lib/env_dpdk/sigbus_handler.o 00:03:05.686 CC lib/env_dpdk/pci_dpdk.o 00:03:05.686 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:05.686 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:05.686 LIB libspdk_trace_parser.a 00:03:05.686 SO libspdk_trace_parser.so.4.0 00:03:05.944 SYMLINK libspdk_trace_parser.so 00:03:05.944 LIB libspdk_conf.a 00:03:05.944 SO libspdk_conf.so.5.0 00:03:05.944 LIB libspdk_rdma.a 00:03:05.944 LIB libspdk_json.a 00:03:05.944 SYMLINK libspdk_conf.so 00:03:05.944 SO libspdk_rdma.so.5.0 00:03:05.944 SO libspdk_json.so.5.1 00:03:05.944 SYMLINK libspdk_rdma.so 00:03:05.944 SYMLINK libspdk_json.so 00:03:06.202 CC lib/jsonrpc/jsonrpc_server.o 00:03:06.202 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:06.202 CC lib/jsonrpc/jsonrpc_client.o 00:03:06.202 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:06.202 LIB libspdk_idxd.a 00:03:06.202 SO libspdk_idxd.so.11.0 00:03:06.202 SYMLINK libspdk_idxd.so 00:03:06.202 LIB libspdk_vmd.a 00:03:06.460 SO libspdk_vmd.so.5.0 00:03:06.460 SYMLINK libspdk_vmd.so 00:03:06.460 LIB libspdk_jsonrpc.a 00:03:06.460 SO libspdk_jsonrpc.so.5.1 00:03:06.460 SYMLINK libspdk_jsonrpc.so 00:03:06.719 CC lib/rpc/rpc.o 00:03:06.719 LIB libspdk_rpc.a 00:03:06.719 SO libspdk_rpc.so.5.0 00:03:06.977 SYMLINK libspdk_rpc.so 00:03:06.977 CC lib/sock/sock.o 00:03:06.977 CC lib/sock/sock_rpc.o 00:03:06.977 CC lib/notify/notify.o 00:03:06.977 CC lib/trace/trace.o 00:03:06.977 CC lib/notify/notify_rpc.o 00:03:06.977 CC lib/trace/trace_flags.o 00:03:06.977 CC lib/trace/trace_rpc.o 00:03:07.236 LIB libspdk_notify.a 00:03:07.236 SO libspdk_notify.so.5.0 00:03:07.236 SYMLINK libspdk_notify.so 00:03:07.236 LIB libspdk_trace.a 00:03:07.236 SO libspdk_trace.so.9.0 00:03:07.236 SYMLINK libspdk_trace.so 00:03:07.495 LIB libspdk_sock.a 00:03:07.495 SO libspdk_sock.so.8.0 00:03:07.495 CC lib/thread/thread.o 00:03:07.495 CC lib/thread/iobuf.o 00:03:07.495 SYMLINK libspdk_sock.so 00:03:07.495 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:07.495 CC lib/nvme/nvme_ctrlr.o 00:03:07.495 CC lib/nvme/nvme_fabric.o 00:03:07.495 CC lib/nvme/nvme_ns_cmd.o 00:03:07.495 CC lib/nvme/nvme_ns.o 00:03:07.495 CC lib/nvme/nvme_pcie_common.o 00:03:07.495 CC lib/nvme/nvme_pcie.o 00:03:07.495 CC lib/nvme/nvme_qpair.o 00:03:07.495 CC lib/nvme/nvme.o 00:03:07.495 CC lib/nvme/nvme_quirks.o 00:03:07.495 CC lib/nvme/nvme_transport.o 00:03:07.495 CC lib/nvme/nvme_discovery.o 00:03:07.495 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:07.495 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:07.495 CC lib/nvme/nvme_tcp.o 00:03:07.495 CC lib/nvme/nvme_opal.o 00:03:07.495 CC lib/nvme/nvme_io_msg.o 00:03:07.495 CC lib/nvme/nvme_poll_group.o 00:03:07.495 CC lib/nvme/nvme_zns.o 00:03:07.495 CC lib/nvme/nvme_cuse.o 00:03:07.495 CC lib/nvme/nvme_vfio_user.o 00:03:07.495 CC lib/nvme/nvme_rdma.o 00:03:07.495 LIB libspdk_env_dpdk.a 00:03:07.754 SO libspdk_env_dpdk.so.13.0 00:03:07.754 SYMLINK libspdk_env_dpdk.so 00:03:09.130 LIB libspdk_thread.a 00:03:09.130 SO libspdk_thread.so.9.0 00:03:09.130 SYMLINK libspdk_thread.so 00:03:09.130 CC lib/accel/accel.o 00:03:09.130 CC lib/accel/accel_rpc.o 00:03:09.130 CC lib/virtio/virtio.o 00:03:09.130 CC lib/blob/blobstore.o 00:03:09.130 CC lib/init/json_config.o 00:03:09.130 CC lib/vfu_tgt/tgt_endpoint.o 00:03:09.130 CC lib/virtio/virtio_vhost_user.o 00:03:09.130 CC lib/accel/accel_sw.o 00:03:09.130 CC lib/blob/request.o 00:03:09.130 CC lib/init/subsystem.o 00:03:09.130 CC lib/vfu_tgt/tgt_rpc.o 00:03:09.130 CC lib/virtio/virtio_vfio_user.o 00:03:09.130 CC lib/init/subsystem_rpc.o 00:03:09.130 CC lib/blob/zeroes.o 00:03:09.130 CC lib/virtio/virtio_pci.o 00:03:09.130 CC lib/init/rpc.o 00:03:09.130 CC lib/blob/blob_bs_dev.o 00:03:09.389 LIB libspdk_init.a 00:03:09.389 SO libspdk_init.so.4.0 00:03:09.647 SYMLINK libspdk_init.so 00:03:09.647 LIB libspdk_vfu_tgt.a 00:03:09.647 LIB libspdk_virtio.a 00:03:09.647 SO libspdk_vfu_tgt.so.2.0 00:03:09.647 SO libspdk_virtio.so.6.0 00:03:09.647 SYMLINK libspdk_vfu_tgt.so 00:03:09.647 SYMLINK libspdk_virtio.so 00:03:09.647 CC lib/event/app.o 00:03:09.647 CC lib/event/reactor.o 00:03:09.647 CC lib/event/log_rpc.o 00:03:09.647 CC lib/event/app_rpc.o 00:03:09.647 CC lib/event/scheduler_static.o 00:03:09.905 LIB libspdk_nvme.a 00:03:09.905 SO libspdk_nvme.so.12.0 00:03:10.164 LIB libspdk_event.a 00:03:10.164 SO libspdk_event.so.12.0 00:03:10.164 SYMLINK libspdk_event.so 00:03:10.164 SYMLINK libspdk_nvme.so 00:03:10.164 LIB libspdk_accel.a 00:03:10.164 SO libspdk_accel.so.14.0 00:03:10.423 SYMLINK libspdk_accel.so 00:03:10.423 CC lib/bdev/bdev.o 00:03:10.423 CC lib/bdev/bdev_rpc.o 00:03:10.423 CC lib/bdev/bdev_zone.o 00:03:10.423 CC lib/bdev/part.o 00:03:10.423 CC lib/bdev/scsi_nvme.o 00:03:12.322 LIB libspdk_blob.a 00:03:12.322 SO libspdk_blob.so.10.1 00:03:12.322 SYMLINK libspdk_blob.so 00:03:12.322 CC lib/blobfs/blobfs.o 00:03:12.322 CC lib/blobfs/tree.o 00:03:12.322 CC lib/lvol/lvol.o 00:03:12.888 LIB libspdk_bdev.a 00:03:12.888 LIB libspdk_blobfs.a 00:03:12.888 SO libspdk_bdev.so.14.0 00:03:12.888 SO libspdk_blobfs.so.9.0 00:03:13.151 SYMLINK libspdk_blobfs.so 00:03:13.151 SYMLINK libspdk_bdev.so 00:03:13.151 LIB libspdk_lvol.a 00:03:13.151 SO libspdk_lvol.so.9.1 00:03:13.151 SYMLINK libspdk_lvol.so 00:03:13.151 CC lib/scsi/dev.o 00:03:13.151 CC lib/nbd/nbd.o 00:03:13.151 CC lib/nvmf/ctrlr.o 00:03:13.151 CC lib/scsi/lun.o 00:03:13.151 CC lib/nbd/nbd_rpc.o 00:03:13.151 CC lib/scsi/port.o 00:03:13.151 CC lib/ublk/ublk.o 00:03:13.151 CC lib/nvmf/ctrlr_discovery.o 00:03:13.151 CC lib/ftl/ftl_core.o 00:03:13.151 CC lib/scsi/scsi.o 00:03:13.151 CC lib/ublk/ublk_rpc.o 00:03:13.151 CC lib/nvmf/ctrlr_bdev.o 00:03:13.151 CC lib/ftl/ftl_init.o 00:03:13.151 CC lib/scsi/scsi_bdev.o 00:03:13.151 CC lib/nvmf/subsystem.o 00:03:13.151 CC lib/ftl/ftl_layout.o 00:03:13.151 CC lib/scsi/scsi_pr.o 00:03:13.151 CC lib/ftl/ftl_debug.o 00:03:13.151 CC lib/scsi/scsi_rpc.o 00:03:13.151 CC lib/nvmf/nvmf.o 00:03:13.151 CC lib/scsi/task.o 00:03:13.151 CC lib/ftl/ftl_io.o 00:03:13.151 CC lib/nvmf/nvmf_rpc.o 00:03:13.151 CC lib/ftl/ftl_sb.o 00:03:13.151 CC lib/nvmf/transport.o 00:03:13.151 CC lib/ftl/ftl_l2p.o 00:03:13.151 CC lib/nvmf/tcp.o 00:03:13.151 CC lib/ftl/ftl_nv_cache.o 00:03:13.151 CC lib/ftl/ftl_l2p_flat.o 00:03:13.151 CC lib/nvmf/vfio_user.o 00:03:13.151 CC lib/ftl/ftl_band.o 00:03:13.151 CC lib/nvmf/rdma.o 00:03:13.151 CC lib/ftl/ftl_writer.o 00:03:13.151 CC lib/ftl/ftl_band_ops.o 00:03:13.151 CC lib/ftl/ftl_reloc.o 00:03:13.151 CC lib/ftl/ftl_rq.o 00:03:13.151 CC lib/ftl/ftl_l2p_cache.o 00:03:13.151 CC lib/ftl/ftl_p2l.o 00:03:13.151 CC lib/ftl/mngt/ftl_mngt.o 00:03:13.151 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:13.151 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:13.151 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:13.151 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:13.151 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:13.151 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:13.151 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:13.151 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:13.151 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:13.411 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:13.411 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:13.411 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:13.411 CC lib/ftl/utils/ftl_conf.o 00:03:13.411 CC lib/ftl/utils/ftl_md.o 00:03:13.670 CC lib/ftl/utils/ftl_mempool.o 00:03:13.670 CC lib/ftl/utils/ftl_bitmap.o 00:03:13.670 CC lib/ftl/utils/ftl_property.o 00:03:13.670 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:13.670 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:13.670 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:13.670 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:13.670 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:13.670 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:13.670 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:13.670 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:13.670 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:13.670 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:13.670 CC lib/ftl/base/ftl_base_dev.o 00:03:13.670 CC lib/ftl/base/ftl_base_bdev.o 00:03:13.670 CC lib/ftl/ftl_trace.o 00:03:13.928 LIB libspdk_nbd.a 00:03:13.928 SO libspdk_nbd.so.6.0 00:03:13.928 SYMLINK libspdk_nbd.so 00:03:13.928 LIB libspdk_scsi.a 00:03:14.188 SO libspdk_scsi.so.8.0 00:03:14.188 SYMLINK libspdk_scsi.so 00:03:14.188 LIB libspdk_ublk.a 00:03:14.188 SO libspdk_ublk.so.2.0 00:03:14.188 SYMLINK libspdk_ublk.so 00:03:14.188 CC lib/iscsi/conn.o 00:03:14.188 CC lib/vhost/vhost.o 00:03:14.188 CC lib/iscsi/init_grp.o 00:03:14.188 CC lib/vhost/vhost_rpc.o 00:03:14.188 CC lib/iscsi/iscsi.o 00:03:14.188 CC lib/vhost/vhost_scsi.o 00:03:14.188 CC lib/iscsi/md5.o 00:03:14.188 CC lib/vhost/vhost_blk.o 00:03:14.188 CC lib/iscsi/param.o 00:03:14.188 CC lib/vhost/rte_vhost_user.o 00:03:14.188 CC lib/iscsi/portal_grp.o 00:03:14.188 CC lib/iscsi/tgt_node.o 00:03:14.188 CC lib/iscsi/iscsi_subsystem.o 00:03:14.188 CC lib/iscsi/iscsi_rpc.o 00:03:14.188 CC lib/iscsi/task.o 00:03:14.447 LIB libspdk_ftl.a 00:03:14.705 SO libspdk_ftl.so.8.0 00:03:14.964 SYMLINK libspdk_ftl.so 00:03:15.529 LIB libspdk_vhost.a 00:03:15.529 SO libspdk_vhost.so.7.1 00:03:15.529 SYMLINK libspdk_vhost.so 00:03:15.787 LIB libspdk_nvmf.a 00:03:15.787 LIB libspdk_iscsi.a 00:03:15.787 SO libspdk_nvmf.so.17.0 00:03:15.787 SO libspdk_iscsi.so.7.0 00:03:15.787 SYMLINK libspdk_iscsi.so 00:03:16.083 SYMLINK libspdk_nvmf.so 00:03:16.083 CC module/env_dpdk/env_dpdk_rpc.o 00:03:16.083 CC module/vfu_device/vfu_virtio.o 00:03:16.083 CC module/vfu_device/vfu_virtio_blk.o 00:03:16.083 CC module/vfu_device/vfu_virtio_scsi.o 00:03:16.083 CC module/vfu_device/vfu_virtio_rpc.o 00:03:16.083 CC module/blob/bdev/blob_bdev.o 00:03:16.083 CC module/accel/iaa/accel_iaa.o 00:03:16.083 CC module/accel/error/accel_error.o 00:03:16.083 CC module/sock/posix/posix.o 00:03:16.083 CC module/accel/ioat/accel_ioat.o 00:03:16.083 CC module/scheduler/gscheduler/gscheduler.o 00:03:16.083 CC module/accel/iaa/accel_iaa_rpc.o 00:03:16.083 CC module/accel/error/accel_error_rpc.o 00:03:16.083 CC module/accel/ioat/accel_ioat_rpc.o 00:03:16.083 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:16.083 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:16.083 CC module/accel/dsa/accel_dsa.o 00:03:16.083 CC module/accel/dsa/accel_dsa_rpc.o 00:03:16.374 LIB libspdk_env_dpdk_rpc.a 00:03:16.374 SO libspdk_env_dpdk_rpc.so.5.0 00:03:16.374 SYMLINK libspdk_env_dpdk_rpc.so 00:03:16.374 LIB libspdk_scheduler_gscheduler.a 00:03:16.375 LIB libspdk_scheduler_dpdk_governor.a 00:03:16.375 SO libspdk_scheduler_gscheduler.so.3.0 00:03:16.375 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:16.375 LIB libspdk_accel_error.a 00:03:16.375 LIB libspdk_accel_ioat.a 00:03:16.375 LIB libspdk_scheduler_dynamic.a 00:03:16.375 SO libspdk_accel_error.so.1.0 00:03:16.375 LIB libspdk_accel_iaa.a 00:03:16.375 SO libspdk_accel_ioat.so.5.0 00:03:16.375 SYMLINK libspdk_scheduler_gscheduler.so 00:03:16.375 SO libspdk_scheduler_dynamic.so.3.0 00:03:16.375 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:16.375 SO libspdk_accel_iaa.so.2.0 00:03:16.375 LIB libspdk_accel_dsa.a 00:03:16.375 SYMLINK libspdk_accel_error.so 00:03:16.375 SYMLINK libspdk_accel_ioat.so 00:03:16.375 SYMLINK libspdk_scheduler_dynamic.so 00:03:16.375 LIB libspdk_blob_bdev.a 00:03:16.375 SO libspdk_accel_dsa.so.4.0 00:03:16.375 SYMLINK libspdk_accel_iaa.so 00:03:16.375 SO libspdk_blob_bdev.so.10.1 00:03:16.375 SYMLINK libspdk_accel_dsa.so 00:03:16.633 SYMLINK libspdk_blob_bdev.so 00:03:16.633 CC module/bdev/delay/vbdev_delay.o 00:03:16.633 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:16.633 CC module/blobfs/bdev/blobfs_bdev.o 00:03:16.633 CC module/bdev/null/bdev_null.o 00:03:16.633 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:16.633 CC module/bdev/gpt/gpt.o 00:03:16.633 CC module/bdev/malloc/bdev_malloc.o 00:03:16.633 CC module/bdev/null/bdev_null_rpc.o 00:03:16.633 CC module/bdev/gpt/vbdev_gpt.o 00:03:16.633 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:16.633 CC module/bdev/raid/bdev_raid.o 00:03:16.633 CC module/bdev/lvol/vbdev_lvol.o 00:03:16.633 CC module/bdev/passthru/vbdev_passthru.o 00:03:16.633 CC module/bdev/aio/bdev_aio.o 00:03:16.633 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:16.633 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:16.633 CC module/bdev/split/vbdev_split.o 00:03:16.633 CC module/bdev/raid/bdev_raid_rpc.o 00:03:16.633 CC module/bdev/raid/bdev_raid_sb.o 00:03:16.633 CC module/bdev/ftl/bdev_ftl.o 00:03:16.633 CC module/bdev/nvme/bdev_nvme.o 00:03:16.633 CC module/bdev/error/vbdev_error.o 00:03:16.633 CC module/bdev/split/vbdev_split_rpc.o 00:03:16.633 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:16.633 CC module/bdev/aio/bdev_aio_rpc.o 00:03:16.633 CC module/bdev/iscsi/bdev_iscsi.o 00:03:16.633 CC module/bdev/raid/raid0.o 00:03:16.633 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:16.633 CC module/bdev/error/vbdev_error_rpc.o 00:03:16.633 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:16.633 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:16.633 CC module/bdev/raid/raid1.o 00:03:16.633 CC module/bdev/nvme/nvme_rpc.o 00:03:16.633 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:16.633 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:16.633 CC module/bdev/raid/concat.o 00:03:16.633 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:16.633 CC module/bdev/nvme/bdev_mdns_client.o 00:03:16.633 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:16.633 CC module/bdev/nvme/vbdev_opal.o 00:03:16.633 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:16.633 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:16.892 LIB libspdk_vfu_device.a 00:03:16.892 SO libspdk_vfu_device.so.2.0 00:03:16.892 SYMLINK libspdk_vfu_device.so 00:03:17.150 LIB libspdk_blobfs_bdev.a 00:03:17.150 LIB libspdk_bdev_error.a 00:03:17.150 LIB libspdk_bdev_ftl.a 00:03:17.150 SO libspdk_blobfs_bdev.so.5.0 00:03:17.150 SO libspdk_bdev_error.so.5.0 00:03:17.150 LIB libspdk_sock_posix.a 00:03:17.150 SO libspdk_bdev_ftl.so.5.0 00:03:17.150 SO libspdk_sock_posix.so.5.0 00:03:17.150 LIB libspdk_bdev_split.a 00:03:17.150 SYMLINK libspdk_blobfs_bdev.so 00:03:17.150 SYMLINK libspdk_bdev_error.so 00:03:17.150 LIB libspdk_bdev_gpt.a 00:03:17.150 LIB libspdk_bdev_null.a 00:03:17.150 SO libspdk_bdev_split.so.5.0 00:03:17.150 SYMLINK libspdk_bdev_ftl.so 00:03:17.150 SO libspdk_bdev_gpt.so.5.0 00:03:17.150 SO libspdk_bdev_null.so.5.0 00:03:17.150 LIB libspdk_bdev_aio.a 00:03:17.150 SYMLINK libspdk_sock_posix.so 00:03:17.150 SYMLINK libspdk_bdev_split.so 00:03:17.150 SO libspdk_bdev_aio.so.5.0 00:03:17.150 SYMLINK libspdk_bdev_gpt.so 00:03:17.150 SYMLINK libspdk_bdev_null.so 00:03:17.150 LIB libspdk_bdev_delay.a 00:03:17.150 LIB libspdk_bdev_passthru.a 00:03:17.150 SYMLINK libspdk_bdev_aio.so 00:03:17.150 LIB libspdk_bdev_zone_block.a 00:03:17.150 SO libspdk_bdev_passthru.so.5.0 00:03:17.150 SO libspdk_bdev_delay.so.5.0 00:03:17.408 SO libspdk_bdev_zone_block.so.5.0 00:03:17.408 LIB libspdk_bdev_iscsi.a 00:03:17.408 LIB libspdk_bdev_malloc.a 00:03:17.408 SYMLINK libspdk_bdev_passthru.so 00:03:17.408 SYMLINK libspdk_bdev_delay.so 00:03:17.408 SO libspdk_bdev_iscsi.so.5.0 00:03:17.408 SO libspdk_bdev_malloc.so.5.0 00:03:17.408 SYMLINK libspdk_bdev_zone_block.so 00:03:17.408 LIB libspdk_bdev_lvol.a 00:03:17.408 SYMLINK libspdk_bdev_iscsi.so 00:03:17.408 SYMLINK libspdk_bdev_malloc.so 00:03:17.408 SO libspdk_bdev_lvol.so.5.0 00:03:17.408 SYMLINK libspdk_bdev_lvol.so 00:03:17.408 LIB libspdk_bdev_virtio.a 00:03:17.408 SO libspdk_bdev_virtio.so.5.0 00:03:17.666 SYMLINK libspdk_bdev_virtio.so 00:03:17.666 LIB libspdk_bdev_raid.a 00:03:17.666 SO libspdk_bdev_raid.so.5.0 00:03:17.926 SYMLINK libspdk_bdev_raid.so 00:03:18.864 LIB libspdk_bdev_nvme.a 00:03:19.122 SO libspdk_bdev_nvme.so.6.0 00:03:19.122 SYMLINK libspdk_bdev_nvme.so 00:03:19.381 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:19.381 CC module/event/subsystems/iobuf/iobuf.o 00:03:19.381 CC module/event/subsystems/vmd/vmd.o 00:03:19.381 CC module/event/subsystems/sock/sock.o 00:03:19.381 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:19.381 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:19.381 CC module/event/subsystems/scheduler/scheduler.o 00:03:19.381 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:19.381 LIB libspdk_event_sock.a 00:03:19.381 LIB libspdk_event_vhost_blk.a 00:03:19.381 LIB libspdk_event_scheduler.a 00:03:19.381 LIB libspdk_event_vmd.a 00:03:19.381 LIB libspdk_event_vfu_tgt.a 00:03:19.639 SO libspdk_event_sock.so.4.0 00:03:19.639 SO libspdk_event_vhost_blk.so.2.0 00:03:19.639 LIB libspdk_event_iobuf.a 00:03:19.639 SO libspdk_event_scheduler.so.3.0 00:03:19.639 SO libspdk_event_vfu_tgt.so.2.0 00:03:19.639 SO libspdk_event_vmd.so.5.0 00:03:19.639 SO libspdk_event_iobuf.so.2.0 00:03:19.639 SYMLINK libspdk_event_sock.so 00:03:19.639 SYMLINK libspdk_event_vhost_blk.so 00:03:19.639 SYMLINK libspdk_event_scheduler.so 00:03:19.639 SYMLINK libspdk_event_vfu_tgt.so 00:03:19.639 SYMLINK libspdk_event_vmd.so 00:03:19.639 SYMLINK libspdk_event_iobuf.so 00:03:19.639 CC module/event/subsystems/accel/accel.o 00:03:19.898 LIB libspdk_event_accel.a 00:03:19.898 SO libspdk_event_accel.so.5.0 00:03:19.898 SYMLINK libspdk_event_accel.so 00:03:20.156 CC module/event/subsystems/bdev/bdev.o 00:03:20.156 LIB libspdk_event_bdev.a 00:03:20.156 SO libspdk_event_bdev.so.5.0 00:03:20.414 SYMLINK libspdk_event_bdev.so 00:03:20.414 CC module/event/subsystems/scsi/scsi.o 00:03:20.414 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:20.414 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:20.414 CC module/event/subsystems/ublk/ublk.o 00:03:20.414 CC module/event/subsystems/nbd/nbd.o 00:03:20.414 LIB libspdk_event_nbd.a 00:03:20.414 LIB libspdk_event_ublk.a 00:03:20.672 LIB libspdk_event_scsi.a 00:03:20.672 SO libspdk_event_nbd.so.5.0 00:03:20.672 SO libspdk_event_ublk.so.2.0 00:03:20.672 SO libspdk_event_scsi.so.5.0 00:03:20.672 SYMLINK libspdk_event_ublk.so 00:03:20.672 SYMLINK libspdk_event_nbd.so 00:03:20.672 SYMLINK libspdk_event_scsi.so 00:03:20.672 LIB libspdk_event_nvmf.a 00:03:20.672 SO libspdk_event_nvmf.so.5.0 00:03:20.672 SYMLINK libspdk_event_nvmf.so 00:03:20.672 CC module/event/subsystems/iscsi/iscsi.o 00:03:20.672 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:20.931 LIB libspdk_event_vhost_scsi.a 00:03:20.931 LIB libspdk_event_iscsi.a 00:03:20.931 SO libspdk_event_vhost_scsi.so.2.0 00:03:20.931 SO libspdk_event_iscsi.so.5.0 00:03:20.931 SYMLINK libspdk_event_vhost_scsi.so 00:03:20.931 SYMLINK libspdk_event_iscsi.so 00:03:20.931 SO libspdk.so.5.0 00:03:20.931 SYMLINK libspdk.so 00:03:21.196 CXX app/trace/trace.o 00:03:21.196 CC app/spdk_lspci/spdk_lspci.o 00:03:21.196 CC app/spdk_nvme_identify/identify.o 00:03:21.196 CC app/trace_record/trace_record.o 00:03:21.196 CC app/spdk_top/spdk_top.o 00:03:21.196 CC app/spdk_nvme_discover/discovery_aer.o 00:03:21.196 CC app/spdk_nvme_perf/perf.o 00:03:21.196 TEST_HEADER include/spdk/accel.h 00:03:21.196 CC test/rpc_client/rpc_client_test.o 00:03:21.196 TEST_HEADER include/spdk/accel_module.h 00:03:21.196 TEST_HEADER include/spdk/assert.h 00:03:21.196 TEST_HEADER include/spdk/barrier.h 00:03:21.196 TEST_HEADER include/spdk/base64.h 00:03:21.196 TEST_HEADER include/spdk/bdev.h 00:03:21.196 TEST_HEADER include/spdk/bdev_module.h 00:03:21.196 TEST_HEADER include/spdk/bdev_zone.h 00:03:21.196 TEST_HEADER include/spdk/bit_array.h 00:03:21.196 TEST_HEADER include/spdk/bit_pool.h 00:03:21.196 TEST_HEADER include/spdk/blob_bdev.h 00:03:21.196 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:21.196 TEST_HEADER include/spdk/blobfs.h 00:03:21.196 TEST_HEADER include/spdk/blob.h 00:03:21.196 TEST_HEADER include/spdk/conf.h 00:03:21.196 TEST_HEADER include/spdk/config.h 00:03:21.196 TEST_HEADER include/spdk/cpuset.h 00:03:21.196 CC app/spdk_dd/spdk_dd.o 00:03:21.196 TEST_HEADER include/spdk/crc16.h 00:03:21.196 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:21.196 CC app/nvmf_tgt/nvmf_main.o 00:03:21.196 TEST_HEADER include/spdk/crc32.h 00:03:21.196 CC app/iscsi_tgt/iscsi_tgt.o 00:03:21.196 TEST_HEADER include/spdk/crc64.h 00:03:21.196 TEST_HEADER include/spdk/dif.h 00:03:21.196 CC app/vhost/vhost.o 00:03:21.196 TEST_HEADER include/spdk/dma.h 00:03:21.196 TEST_HEADER include/spdk/endian.h 00:03:21.196 CC examples/ioat/perf/perf.o 00:03:21.196 TEST_HEADER include/spdk/env_dpdk.h 00:03:21.196 CC examples/ioat/verify/verify.o 00:03:21.196 CC examples/nvme/hello_world/hello_world.o 00:03:21.196 TEST_HEADER include/spdk/env.h 00:03:21.196 CC examples/util/zipf/zipf.o 00:03:21.196 CC examples/vmd/led/led.o 00:03:21.196 CC app/fio/nvme/fio_plugin.o 00:03:21.196 TEST_HEADER include/spdk/event.h 00:03:21.196 CC examples/idxd/perf/perf.o 00:03:21.196 CC examples/sock/hello_world/hello_sock.o 00:03:21.196 CC examples/vmd/lsvmd/lsvmd.o 00:03:21.196 TEST_HEADER include/spdk/fd_group.h 00:03:21.196 CC examples/nvme/reconnect/reconnect.o 00:03:21.196 TEST_HEADER include/spdk/fd.h 00:03:21.196 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:21.196 TEST_HEADER include/spdk/file.h 00:03:21.196 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:21.196 CC examples/nvme/hotplug/hotplug.o 00:03:21.196 CC examples/nvme/abort/abort.o 00:03:21.196 TEST_HEADER include/spdk/ftl.h 00:03:21.196 CC test/thread/poller_perf/poller_perf.o 00:03:21.196 CC examples/nvme/arbitration/arbitration.o 00:03:21.196 CC test/event/event_perf/event_perf.o 00:03:21.196 CC examples/accel/perf/accel_perf.o 00:03:21.196 TEST_HEADER include/spdk/gpt_spec.h 00:03:21.460 TEST_HEADER include/spdk/hexlify.h 00:03:21.460 TEST_HEADER include/spdk/histogram_data.h 00:03:21.460 TEST_HEADER include/spdk/idxd.h 00:03:21.460 CC app/spdk_tgt/spdk_tgt.o 00:03:21.460 TEST_HEADER include/spdk/idxd_spec.h 00:03:21.460 TEST_HEADER include/spdk/init.h 00:03:21.460 CC test/nvme/aer/aer.o 00:03:21.460 TEST_HEADER include/spdk/ioat.h 00:03:21.460 TEST_HEADER include/spdk/ioat_spec.h 00:03:21.460 TEST_HEADER include/spdk/iscsi_spec.h 00:03:21.460 TEST_HEADER include/spdk/json.h 00:03:21.460 TEST_HEADER include/spdk/jsonrpc.h 00:03:21.460 TEST_HEADER include/spdk/likely.h 00:03:21.460 TEST_HEADER include/spdk/log.h 00:03:21.460 TEST_HEADER include/spdk/lvol.h 00:03:21.460 CC examples/thread/thread/thread_ex.o 00:03:21.460 CC examples/blob/hello_world/hello_blob.o 00:03:21.460 CC examples/bdev/hello_world/hello_bdev.o 00:03:21.460 TEST_HEADER include/spdk/memory.h 00:03:21.460 TEST_HEADER include/spdk/mmio.h 00:03:21.460 CC test/bdev/bdevio/bdevio.o 00:03:21.460 CC test/accel/dif/dif.o 00:03:21.460 CC examples/nvmf/nvmf/nvmf.o 00:03:21.460 CC examples/bdev/bdevperf/bdevperf.o 00:03:21.460 TEST_HEADER include/spdk/nbd.h 00:03:21.460 CC examples/blob/cli/blobcli.o 00:03:21.460 TEST_HEADER include/spdk/notify.h 00:03:21.460 CC test/app/bdev_svc/bdev_svc.o 00:03:21.460 TEST_HEADER include/spdk/nvme.h 00:03:21.460 TEST_HEADER include/spdk/nvme_intel.h 00:03:21.460 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:21.460 CC app/fio/bdev/fio_plugin.o 00:03:21.460 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:21.460 CC test/dma/test_dma/test_dma.o 00:03:21.460 TEST_HEADER include/spdk/nvme_spec.h 00:03:21.460 CC test/env/mem_callbacks/mem_callbacks.o 00:03:21.460 TEST_HEADER include/spdk/nvme_zns.h 00:03:21.460 CC test/blobfs/mkfs/mkfs.o 00:03:21.460 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:21.460 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:21.460 TEST_HEADER include/spdk/nvmf.h 00:03:21.460 TEST_HEADER include/spdk/nvmf_spec.h 00:03:21.460 CC test/lvol/esnap/esnap.o 00:03:21.460 TEST_HEADER include/spdk/nvmf_transport.h 00:03:21.460 TEST_HEADER include/spdk/opal.h 00:03:21.460 TEST_HEADER include/spdk/opal_spec.h 00:03:21.460 TEST_HEADER include/spdk/pci_ids.h 00:03:21.460 TEST_HEADER include/spdk/pipe.h 00:03:21.460 TEST_HEADER include/spdk/queue.h 00:03:21.460 TEST_HEADER include/spdk/reduce.h 00:03:21.460 TEST_HEADER include/spdk/rpc.h 00:03:21.460 TEST_HEADER include/spdk/scheduler.h 00:03:21.460 TEST_HEADER include/spdk/scsi.h 00:03:21.460 TEST_HEADER include/spdk/scsi_spec.h 00:03:21.460 TEST_HEADER include/spdk/sock.h 00:03:21.460 TEST_HEADER include/spdk/stdinc.h 00:03:21.460 TEST_HEADER include/spdk/string.h 00:03:21.460 TEST_HEADER include/spdk/thread.h 00:03:21.460 TEST_HEADER include/spdk/trace.h 00:03:21.460 TEST_HEADER include/spdk/trace_parser.h 00:03:21.460 TEST_HEADER include/spdk/tree.h 00:03:21.460 TEST_HEADER include/spdk/ublk.h 00:03:21.460 LINK spdk_lspci 00:03:21.460 TEST_HEADER include/spdk/util.h 00:03:21.460 TEST_HEADER include/spdk/uuid.h 00:03:21.460 TEST_HEADER include/spdk/version.h 00:03:21.460 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:21.460 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:21.460 TEST_HEADER include/spdk/vhost.h 00:03:21.460 TEST_HEADER include/spdk/vmd.h 00:03:21.460 TEST_HEADER include/spdk/xor.h 00:03:21.460 TEST_HEADER include/spdk/zipf.h 00:03:21.460 CXX test/cpp_headers/accel.o 00:03:21.460 LINK event_perf 00:03:21.720 LINK lsvmd 00:03:21.720 LINK rpc_client_test 00:03:21.720 LINK spdk_nvme_discover 00:03:21.720 LINK led 00:03:21.720 LINK zipf 00:03:21.720 LINK poller_perf 00:03:21.720 LINK interrupt_tgt 00:03:21.720 LINK nvmf_tgt 00:03:21.720 LINK vhost 00:03:21.720 LINK cmb_copy 00:03:21.720 LINK iscsi_tgt 00:03:21.720 LINK spdk_trace_record 00:03:21.720 LINK ioat_perf 00:03:21.720 LINK bdev_svc 00:03:21.720 LINK verify 00:03:21.720 LINK spdk_tgt 00:03:21.720 LINK hello_world 00:03:21.720 LINK hello_sock 00:03:21.720 LINK mem_callbacks 00:03:21.720 LINK hotplug 00:03:21.720 LINK mkfs 00:03:21.720 LINK hello_blob 00:03:21.986 LINK hello_bdev 00:03:21.986 LINK thread 00:03:21.986 LINK aer 00:03:21.986 CXX test/cpp_headers/accel_module.o 00:03:21.986 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:21.986 LINK nvmf 00:03:21.986 LINK arbitration 00:03:21.986 CC test/event/reactor/reactor.o 00:03:21.986 LINK idxd_perf 00:03:21.986 LINK spdk_dd 00:03:21.986 LINK reconnect 00:03:21.986 CXX test/cpp_headers/assert.o 00:03:21.986 LINK spdk_trace 00:03:21.986 CC test/app/histogram_perf/histogram_perf.o 00:03:21.986 CC test/app/jsoncat/jsoncat.o 00:03:21.986 CC test/nvme/sgl/sgl.o 00:03:21.986 CC test/nvme/e2edp/nvme_dp.o 00:03:21.986 CC test/nvme/reset/reset.o 00:03:21.986 CXX test/cpp_headers/barrier.o 00:03:21.986 LINK abort 00:03:21.986 LINK dif 00:03:21.986 CC test/event/reactor_perf/reactor_perf.o 00:03:21.986 CXX test/cpp_headers/base64.o 00:03:21.986 CC test/env/vtophys/vtophys.o 00:03:21.986 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:21.986 CXX test/cpp_headers/bdev.o 00:03:22.252 LINK bdevio 00:03:22.252 LINK test_dma 00:03:22.252 CC test/app/stub/stub.o 00:03:22.252 CC test/event/app_repeat/app_repeat.o 00:03:22.252 CXX test/cpp_headers/bdev_module.o 00:03:22.252 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:22.252 LINK accel_perf 00:03:22.252 CXX test/cpp_headers/bdev_zone.o 00:03:22.252 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:22.252 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:22.252 CXX test/cpp_headers/bit_array.o 00:03:22.252 CXX test/cpp_headers/bit_pool.o 00:03:22.252 CC test/event/scheduler/scheduler.o 00:03:22.252 LINK pmr_persistence 00:03:22.252 CXX test/cpp_headers/blob_bdev.o 00:03:22.252 CC test/nvme/overhead/overhead.o 00:03:22.252 LINK reactor 00:03:22.252 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:22.252 LINK nvme_manage 00:03:22.252 CXX test/cpp_headers/blobfs_bdev.o 00:03:22.252 CC test/env/memory/memory_ut.o 00:03:22.252 LINK spdk_nvme 00:03:22.252 LINK jsoncat 00:03:22.252 LINK histogram_perf 00:03:22.252 LINK spdk_bdev 00:03:22.252 CC test/env/pci/pci_ut.o 00:03:22.252 LINK blobcli 00:03:22.519 LINK reactor_perf 00:03:22.519 CXX test/cpp_headers/blobfs.o 00:03:22.519 LINK vtophys 00:03:22.519 CXX test/cpp_headers/blob.o 00:03:22.519 CC test/nvme/err_injection/err_injection.o 00:03:22.519 CC test/nvme/startup/startup.o 00:03:22.519 CC test/nvme/reserve/reserve.o 00:03:22.519 CC test/nvme/simple_copy/simple_copy.o 00:03:22.519 CC test/nvme/connect_stress/connect_stress.o 00:03:22.519 CXX test/cpp_headers/conf.o 00:03:22.519 LINK app_repeat 00:03:22.519 LINK stub 00:03:22.519 CC test/nvme/boot_partition/boot_partition.o 00:03:22.519 LINK reset 00:03:22.519 CC test/nvme/compliance/nvme_compliance.o 00:03:22.519 LINK env_dpdk_post_init 00:03:22.519 CXX test/cpp_headers/config.o 00:03:22.519 LINK sgl 00:03:22.519 LINK nvme_dp 00:03:22.519 CXX test/cpp_headers/cpuset.o 00:03:22.519 CXX test/cpp_headers/crc16.o 00:03:22.519 CXX test/cpp_headers/crc32.o 00:03:22.519 CXX test/cpp_headers/crc64.o 00:03:22.519 CXX test/cpp_headers/dif.o 00:03:22.519 CC test/nvme/fused_ordering/fused_ordering.o 00:03:22.519 CXX test/cpp_headers/dma.o 00:03:22.519 CXX test/cpp_headers/endian.o 00:03:22.519 CXX test/cpp_headers/env_dpdk.o 00:03:22.519 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:22.519 CXX test/cpp_headers/env.o 00:03:22.519 CC test/nvme/fdp/fdp.o 00:03:22.778 CXX test/cpp_headers/event.o 00:03:22.778 CXX test/cpp_headers/fd_group.o 00:03:22.778 CC test/nvme/cuse/cuse.o 00:03:22.778 LINK scheduler 00:03:22.778 CXX test/cpp_headers/fd.o 00:03:22.778 CXX test/cpp_headers/file.o 00:03:22.778 CXX test/cpp_headers/ftl.o 00:03:22.778 LINK spdk_nvme_perf 00:03:22.778 CXX test/cpp_headers/gpt_spec.o 00:03:22.778 CXX test/cpp_headers/hexlify.o 00:03:22.778 CXX test/cpp_headers/histogram_data.o 00:03:22.778 CXX test/cpp_headers/idxd.o 00:03:22.778 LINK startup 00:03:22.778 LINK err_injection 00:03:22.778 LINK spdk_nvme_identify 00:03:22.778 LINK overhead 00:03:22.778 CXX test/cpp_headers/idxd_spec.o 00:03:22.778 LINK bdevperf 00:03:22.778 CXX test/cpp_headers/init.o 00:03:22.778 CXX test/cpp_headers/ioat.o 00:03:22.778 CXX test/cpp_headers/ioat_spec.o 00:03:22.778 CXX test/cpp_headers/iscsi_spec.o 00:03:22.778 LINK reserve 00:03:22.778 LINK connect_stress 00:03:22.778 LINK nvme_fuzz 00:03:22.778 LINK boot_partition 00:03:22.778 CXX test/cpp_headers/json.o 00:03:23.041 CXX test/cpp_headers/jsonrpc.o 00:03:23.041 LINK spdk_top 00:03:23.041 LINK simple_copy 00:03:23.041 CXX test/cpp_headers/likely.o 00:03:23.042 CXX test/cpp_headers/log.o 00:03:23.042 CXX test/cpp_headers/lvol.o 00:03:23.042 CXX test/cpp_headers/memory.o 00:03:23.042 CXX test/cpp_headers/mmio.o 00:03:23.042 CXX test/cpp_headers/nbd.o 00:03:23.042 CXX test/cpp_headers/notify.o 00:03:23.042 CXX test/cpp_headers/nvme.o 00:03:23.042 CXX test/cpp_headers/nvme_intel.o 00:03:23.042 CXX test/cpp_headers/nvme_ocssd.o 00:03:23.042 LINK fused_ordering 00:03:23.042 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:23.042 CXX test/cpp_headers/nvme_spec.o 00:03:23.042 CXX test/cpp_headers/nvme_zns.o 00:03:23.042 LINK doorbell_aers 00:03:23.042 CXX test/cpp_headers/nvmf_cmd.o 00:03:23.042 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:23.042 CXX test/cpp_headers/nvmf.o 00:03:23.042 LINK vhost_fuzz 00:03:23.042 CXX test/cpp_headers/nvmf_spec.o 00:03:23.042 CXX test/cpp_headers/nvmf_transport.o 00:03:23.042 CXX test/cpp_headers/opal.o 00:03:23.042 CXX test/cpp_headers/opal_spec.o 00:03:23.042 CXX test/cpp_headers/pci_ids.o 00:03:23.042 CXX test/cpp_headers/pipe.o 00:03:23.042 LINK pci_ut 00:03:23.042 CXX test/cpp_headers/queue.o 00:03:23.042 CXX test/cpp_headers/reduce.o 00:03:23.301 CXX test/cpp_headers/rpc.o 00:03:23.301 CXX test/cpp_headers/scheduler.o 00:03:23.301 CXX test/cpp_headers/scsi.o 00:03:23.301 CXX test/cpp_headers/scsi_spec.o 00:03:23.301 CXX test/cpp_headers/stdinc.o 00:03:23.301 CXX test/cpp_headers/sock.o 00:03:23.301 CXX test/cpp_headers/string.o 00:03:23.301 CXX test/cpp_headers/thread.o 00:03:23.301 CXX test/cpp_headers/trace.o 00:03:23.301 CXX test/cpp_headers/trace_parser.o 00:03:23.301 CXX test/cpp_headers/tree.o 00:03:23.301 CXX test/cpp_headers/ublk.o 00:03:23.301 CXX test/cpp_headers/util.o 00:03:23.301 CXX test/cpp_headers/uuid.o 00:03:23.301 LINK nvme_compliance 00:03:23.301 LINK fdp 00:03:23.301 LINK memory_ut 00:03:23.301 CXX test/cpp_headers/version.o 00:03:23.301 CXX test/cpp_headers/vfio_user_pci.o 00:03:23.301 CXX test/cpp_headers/vfio_user_spec.o 00:03:23.301 CXX test/cpp_headers/vhost.o 00:03:23.301 CXX test/cpp_headers/vmd.o 00:03:23.301 CXX test/cpp_headers/xor.o 00:03:23.301 CXX test/cpp_headers/zipf.o 00:03:24.234 LINK cuse 00:03:24.493 LINK iscsi_fuzz 00:03:27.020 LINK esnap 00:03:27.279 00:03:27.279 real 0m37.473s 00:03:27.279 user 7m14.415s 00:03:27.279 sys 1m36.082s 00:03:27.279 01:46:01 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:27.279 01:46:01 -- common/autotest_common.sh@10 -- $ set +x 00:03:27.279 ************************************ 00:03:27.279 END TEST make 00:03:27.279 ************************************ 00:03:27.279 01:46:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:27.279 01:46:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:27.279 01:46:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:27.279 01:46:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:27.279 01:46:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:27.279 01:46:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:27.279 01:46:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:27.279 01:46:01 -- scripts/common.sh@335 -- # IFS=.-: 00:03:27.279 01:46:01 -- scripts/common.sh@335 -- # read -ra ver1 00:03:27.279 01:46:01 -- scripts/common.sh@336 -- # IFS=.-: 00:03:27.279 01:46:01 -- scripts/common.sh@336 -- # read -ra ver2 00:03:27.279 01:46:01 -- scripts/common.sh@337 -- # local 'op=<' 00:03:27.279 01:46:01 -- scripts/common.sh@339 -- # ver1_l=2 00:03:27.279 01:46:01 -- scripts/common.sh@340 -- # ver2_l=1 00:03:27.279 01:46:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:27.279 01:46:01 -- scripts/common.sh@343 -- # case "$op" in 00:03:27.279 01:46:01 -- scripts/common.sh@344 -- # : 1 00:03:27.279 01:46:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:27.279 01:46:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:27.279 01:46:01 -- scripts/common.sh@364 -- # decimal 1 00:03:27.279 01:46:01 -- scripts/common.sh@352 -- # local d=1 00:03:27.279 01:46:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:27.279 01:46:01 -- scripts/common.sh@354 -- # echo 1 00:03:27.279 01:46:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:27.279 01:46:01 -- scripts/common.sh@365 -- # decimal 2 00:03:27.279 01:46:01 -- scripts/common.sh@352 -- # local d=2 00:03:27.279 01:46:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:27.279 01:46:01 -- scripts/common.sh@354 -- # echo 2 00:03:27.279 01:46:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:27.279 01:46:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:27.279 01:46:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:27.279 01:46:01 -- scripts/common.sh@367 -- # return 0 00:03:27.279 01:46:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:27.279 01:46:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:27.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.279 --rc genhtml_branch_coverage=1 00:03:27.279 --rc genhtml_function_coverage=1 00:03:27.279 --rc genhtml_legend=1 00:03:27.279 --rc geninfo_all_blocks=1 00:03:27.279 --rc geninfo_unexecuted_blocks=1 00:03:27.279 00:03:27.279 ' 00:03:27.279 01:46:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:27.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.279 --rc genhtml_branch_coverage=1 00:03:27.279 --rc genhtml_function_coverage=1 00:03:27.279 --rc genhtml_legend=1 00:03:27.279 --rc geninfo_all_blocks=1 00:03:27.279 --rc geninfo_unexecuted_blocks=1 00:03:27.279 00:03:27.279 ' 00:03:27.279 01:46:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:27.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.279 --rc genhtml_branch_coverage=1 00:03:27.279 --rc genhtml_function_coverage=1 00:03:27.279 --rc genhtml_legend=1 00:03:27.279 --rc geninfo_all_blocks=1 00:03:27.279 --rc geninfo_unexecuted_blocks=1 00:03:27.279 00:03:27.279 ' 00:03:27.279 01:46:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:27.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.279 --rc genhtml_branch_coverage=1 00:03:27.279 --rc genhtml_function_coverage=1 00:03:27.279 --rc genhtml_legend=1 00:03:27.279 --rc geninfo_all_blocks=1 00:03:27.279 --rc geninfo_unexecuted_blocks=1 00:03:27.279 00:03:27.279 ' 00:03:27.279 01:46:01 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:27.279 01:46:01 -- nvmf/common.sh@7 -- # uname -s 00:03:27.280 01:46:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:27.280 01:46:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:27.280 01:46:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:27.280 01:46:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:27.280 01:46:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:27.280 01:46:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:27.280 01:46:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:27.280 01:46:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:27.280 01:46:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:27.280 01:46:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:27.280 01:46:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:27.280 01:46:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:27.280 01:46:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:27.280 01:46:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:27.280 01:46:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:27.280 01:46:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:27.280 01:46:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:27.280 01:46:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:27.280 01:46:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:27.280 01:46:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:27.280 01:46:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:27.280 01:46:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:27.280 01:46:01 -- paths/export.sh@5 -- # export PATH 00:03:27.280 01:46:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:27.280 01:46:01 -- nvmf/common.sh@46 -- # : 0 00:03:27.280 01:46:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:27.280 01:46:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:27.280 01:46:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:27.280 01:46:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:27.280 01:46:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:27.280 01:46:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:27.280 01:46:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:27.280 01:46:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:27.280 01:46:01 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:27.280 01:46:01 -- spdk/autotest.sh@32 -- # uname -s 00:03:27.280 01:46:01 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:27.280 01:46:01 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:27.280 01:46:01 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:27.280 01:46:01 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:27.280 01:46:01 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:27.280 01:46:01 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:27.280 01:46:01 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:27.280 01:46:01 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:27.280 01:46:01 -- spdk/autotest.sh@48 -- # udevadm_pid=1048896 00:03:27.280 01:46:01 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:27.280 01:46:01 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:27.280 01:46:01 -- spdk/autotest.sh@54 -- # echo 1048898 00:03:27.280 01:46:01 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:27.280 01:46:01 -- spdk/autotest.sh@56 -- # echo 1048899 00:03:27.280 01:46:01 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:27.280 01:46:01 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:27.280 01:46:01 -- spdk/autotest.sh@60 -- # echo 1048900 00:03:27.280 01:46:01 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:27.280 01:46:01 -- spdk/autotest.sh@62 -- # echo 1048901 00:03:27.280 01:46:01 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:27.280 01:46:01 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:27.280 01:46:01 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:27.280 01:46:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:27.280 01:46:01 -- common/autotest_common.sh@10 -- # set +x 00:03:27.280 01:46:01 -- spdk/autotest.sh@70 -- # create_test_list 00:03:27.280 01:46:01 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:27.280 01:46:01 -- common/autotest_common.sh@10 -- # set +x 00:03:27.280 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:27.539 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:27.539 01:46:01 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:27.539 01:46:01 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:27.539 01:46:01 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:27.539 01:46:01 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:27.539 01:46:01 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:27.539 01:46:01 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:27.539 01:46:01 -- common/autotest_common.sh@1450 -- # uname 00:03:27.539 01:46:01 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:27.539 01:46:01 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:27.539 01:46:01 -- common/autotest_common.sh@1470 -- # uname 00:03:27.539 01:46:01 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:27.539 01:46:01 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:27.539 01:46:01 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:27.539 lcov: LCOV version 1.15 00:03:27.539 01:46:01 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:30.818 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:30.818 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:30.818 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:30.818 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:30.818 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:30.818 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:02.880 01:46:34 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:02.880 01:46:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:02.880 01:46:34 -- common/autotest_common.sh@10 -- # set +x 00:04:02.880 01:46:34 -- spdk/autotest.sh@89 -- # rm -f 00:04:02.880 01:46:34 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:02.880 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:02.880 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:02.880 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:02.880 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:02.880 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:02.880 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:02.880 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:02.880 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:02.880 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:02.880 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:02.880 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:02.880 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:02.880 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:02.880 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:02.880 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:02.880 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:02.880 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:02.880 01:46:36 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:02.880 01:46:36 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:02.880 01:46:36 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:02.880 01:46:36 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:02.880 01:46:36 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:02.880 01:46:36 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:02.880 01:46:36 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:02.880 01:46:36 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:02.880 01:46:36 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:02.880 01:46:36 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:02.880 01:46:36 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:02.880 01:46:36 -- spdk/autotest.sh@108 -- # grep -v p 00:04:02.880 01:46:36 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:02.880 01:46:36 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:02.880 01:46:36 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:02.880 01:46:36 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:02.880 01:46:36 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:02.880 No valid GPT data, bailing 00:04:02.880 01:46:36 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:02.880 01:46:36 -- scripts/common.sh@393 -- # pt= 00:04:02.880 01:46:36 -- scripts/common.sh@394 -- # return 1 00:04:02.880 01:46:36 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:02.880 1+0 records in 00:04:02.880 1+0 records out 00:04:02.880 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00223441 s, 469 MB/s 00:04:02.880 01:46:36 -- spdk/autotest.sh@116 -- # sync 00:04:02.880 01:46:36 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:02.880 01:46:36 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:02.880 01:46:36 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:04.259 01:46:38 -- spdk/autotest.sh@122 -- # uname -s 00:04:04.259 01:46:38 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:04.259 01:46:38 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:04.259 01:46:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.259 01:46:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.259 01:46:38 -- common/autotest_common.sh@10 -- # set +x 00:04:04.259 ************************************ 00:04:04.259 START TEST setup.sh 00:04:04.259 ************************************ 00:04:04.259 01:46:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:04.259 * Looking for test storage... 00:04:04.259 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:04.259 01:46:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:04.259 01:46:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:04.259 01:46:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:04.518 01:46:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:04.518 01:46:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:04.518 01:46:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:04.518 01:46:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:04.518 01:46:38 -- scripts/common.sh@335 -- # IFS=.-: 00:04:04.518 01:46:38 -- scripts/common.sh@335 -- # read -ra ver1 00:04:04.518 01:46:38 -- scripts/common.sh@336 -- # IFS=.-: 00:04:04.518 01:46:38 -- scripts/common.sh@336 -- # read -ra ver2 00:04:04.518 01:46:38 -- scripts/common.sh@337 -- # local 'op=<' 00:04:04.518 01:46:38 -- scripts/common.sh@339 -- # ver1_l=2 00:04:04.518 01:46:38 -- scripts/common.sh@340 -- # ver2_l=1 00:04:04.518 01:46:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:04.518 01:46:38 -- scripts/common.sh@343 -- # case "$op" in 00:04:04.518 01:46:38 -- scripts/common.sh@344 -- # : 1 00:04:04.518 01:46:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:04.518 01:46:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:04.518 01:46:38 -- scripts/common.sh@364 -- # decimal 1 00:04:04.518 01:46:38 -- scripts/common.sh@352 -- # local d=1 00:04:04.518 01:46:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:04.518 01:46:38 -- scripts/common.sh@354 -- # echo 1 00:04:04.518 01:46:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:04.518 01:46:38 -- scripts/common.sh@365 -- # decimal 2 00:04:04.518 01:46:38 -- scripts/common.sh@352 -- # local d=2 00:04:04.518 01:46:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:04.518 01:46:38 -- scripts/common.sh@354 -- # echo 2 00:04:04.518 01:46:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:04.518 01:46:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:04.518 01:46:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:04.518 01:46:38 -- scripts/common.sh@367 -- # return 0 00:04:04.518 01:46:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:04.518 01:46:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:04.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.518 --rc genhtml_branch_coverage=1 00:04:04.518 --rc genhtml_function_coverage=1 00:04:04.518 --rc genhtml_legend=1 00:04:04.518 --rc geninfo_all_blocks=1 00:04:04.518 --rc geninfo_unexecuted_blocks=1 00:04:04.518 00:04:04.518 ' 00:04:04.518 01:46:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:04.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.518 --rc genhtml_branch_coverage=1 00:04:04.518 --rc genhtml_function_coverage=1 00:04:04.518 --rc genhtml_legend=1 00:04:04.518 --rc geninfo_all_blocks=1 00:04:04.518 --rc geninfo_unexecuted_blocks=1 00:04:04.518 00:04:04.518 ' 00:04:04.518 01:46:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:04.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.518 --rc genhtml_branch_coverage=1 00:04:04.518 --rc genhtml_function_coverage=1 00:04:04.518 --rc genhtml_legend=1 00:04:04.518 --rc geninfo_all_blocks=1 00:04:04.518 --rc geninfo_unexecuted_blocks=1 00:04:04.518 00:04:04.518 ' 00:04:04.518 01:46:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:04.519 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.519 --rc genhtml_branch_coverage=1 00:04:04.519 --rc genhtml_function_coverage=1 00:04:04.519 --rc genhtml_legend=1 00:04:04.519 --rc geninfo_all_blocks=1 00:04:04.519 --rc geninfo_unexecuted_blocks=1 00:04:04.519 00:04:04.519 ' 00:04:04.519 01:46:38 -- setup/test-setup.sh@10 -- # uname -s 00:04:04.519 01:46:38 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:04.519 01:46:38 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:04.519 01:46:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.519 01:46:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.519 01:46:38 -- common/autotest_common.sh@10 -- # set +x 00:04:04.519 ************************************ 00:04:04.519 START TEST acl 00:04:04.519 ************************************ 00:04:04.519 01:46:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:04.519 * Looking for test storage... 00:04:04.519 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:04.519 01:46:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:04.519 01:46:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:04.519 01:46:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:04.519 01:46:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:04.519 01:46:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:04.519 01:46:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:04.519 01:46:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:04.519 01:46:38 -- scripts/common.sh@335 -- # IFS=.-: 00:04:04.519 01:46:38 -- scripts/common.sh@335 -- # read -ra ver1 00:04:04.519 01:46:38 -- scripts/common.sh@336 -- # IFS=.-: 00:04:04.519 01:46:38 -- scripts/common.sh@336 -- # read -ra ver2 00:04:04.519 01:46:38 -- scripts/common.sh@337 -- # local 'op=<' 00:04:04.519 01:46:38 -- scripts/common.sh@339 -- # ver1_l=2 00:04:04.519 01:46:38 -- scripts/common.sh@340 -- # ver2_l=1 00:04:04.519 01:46:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:04.519 01:46:38 -- scripts/common.sh@343 -- # case "$op" in 00:04:04.519 01:46:38 -- scripts/common.sh@344 -- # : 1 00:04:04.519 01:46:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:04.519 01:46:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:04.519 01:46:38 -- scripts/common.sh@364 -- # decimal 1 00:04:04.519 01:46:38 -- scripts/common.sh@352 -- # local d=1 00:04:04.519 01:46:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:04.519 01:46:38 -- scripts/common.sh@354 -- # echo 1 00:04:04.519 01:46:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:04.519 01:46:38 -- scripts/common.sh@365 -- # decimal 2 00:04:04.519 01:46:38 -- scripts/common.sh@352 -- # local d=2 00:04:04.519 01:46:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:04.519 01:46:38 -- scripts/common.sh@354 -- # echo 2 00:04:04.519 01:46:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:04.519 01:46:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:04.519 01:46:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:04.519 01:46:38 -- scripts/common.sh@367 -- # return 0 00:04:04.519 01:46:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:04.519 01:46:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:04.519 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.519 --rc genhtml_branch_coverage=1 00:04:04.519 --rc genhtml_function_coverage=1 00:04:04.519 --rc genhtml_legend=1 00:04:04.519 --rc geninfo_all_blocks=1 00:04:04.519 --rc geninfo_unexecuted_blocks=1 00:04:04.519 00:04:04.519 ' 00:04:04.519 01:46:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:04.519 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.519 --rc genhtml_branch_coverage=1 00:04:04.519 --rc genhtml_function_coverage=1 00:04:04.519 --rc genhtml_legend=1 00:04:04.519 --rc geninfo_all_blocks=1 00:04:04.519 --rc geninfo_unexecuted_blocks=1 00:04:04.519 00:04:04.519 ' 00:04:04.519 01:46:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:04.519 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.519 --rc genhtml_branch_coverage=1 00:04:04.519 --rc genhtml_function_coverage=1 00:04:04.519 --rc genhtml_legend=1 00:04:04.519 --rc geninfo_all_blocks=1 00:04:04.519 --rc geninfo_unexecuted_blocks=1 00:04:04.519 00:04:04.519 ' 00:04:04.519 01:46:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:04.519 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.519 --rc genhtml_branch_coverage=1 00:04:04.519 --rc genhtml_function_coverage=1 00:04:04.519 --rc genhtml_legend=1 00:04:04.519 --rc geninfo_all_blocks=1 00:04:04.519 --rc geninfo_unexecuted_blocks=1 00:04:04.519 00:04:04.519 ' 00:04:04.519 01:46:38 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:04.519 01:46:38 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:04.519 01:46:38 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:04.519 01:46:38 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:04.519 01:46:38 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:04.519 01:46:38 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:04.519 01:46:38 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:04.519 01:46:38 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:04.519 01:46:38 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:04.519 01:46:38 -- setup/acl.sh@12 -- # devs=() 00:04:04.519 01:46:38 -- setup/acl.sh@12 -- # declare -a devs 00:04:04.519 01:46:38 -- setup/acl.sh@13 -- # drivers=() 00:04:04.519 01:46:38 -- setup/acl.sh@13 -- # declare -A drivers 00:04:04.519 01:46:38 -- setup/acl.sh@51 -- # setup reset 00:04:04.519 01:46:38 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:04.519 01:46:38 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:06.426 01:46:40 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:06.426 01:46:40 -- setup/acl.sh@16 -- # local dev driver 00:04:06.426 01:46:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.426 01:46:40 -- setup/acl.sh@15 -- # setup output status 00:04:06.426 01:46:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:06.426 01:46:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:06.995 Hugepages 00:04:06.995 node hugesize free / total 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # continue 00:04:06.995 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # continue 00:04:06.995 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # continue 00:04:06.995 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.995 00:04:06.995 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # continue 00:04:06.995 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:06.995 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.995 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:06.995 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:06.995 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.995 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:06.995 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:06.995 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.995 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:06.995 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:06.995 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.995 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:06.995 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:06.995 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.995 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:06.995 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.995 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:06.995 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.995 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:06.995 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.255 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:07.255 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.255 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:07.255 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.255 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:07.255 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.255 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:07.255 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.255 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:07.255 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.255 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:07.255 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.255 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:07.255 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.255 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:07.255 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.255 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:07.255 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.255 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # continue 00:04:07.255 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.255 01:46:41 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:07.255 01:46:41 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:07.255 01:46:41 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:07.255 01:46:41 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:07.255 01:46:41 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:07.255 01:46:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.255 01:46:41 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:07.255 01:46:41 -- setup/acl.sh@54 -- # run_test denied denied 00:04:07.255 01:46:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.255 01:46:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.255 01:46:41 -- common/autotest_common.sh@10 -- # set +x 00:04:07.255 ************************************ 00:04:07.255 START TEST denied 00:04:07.255 ************************************ 00:04:07.255 01:46:41 -- common/autotest_common.sh@1114 -- # denied 00:04:07.255 01:46:41 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:07.255 01:46:41 -- setup/acl.sh@38 -- # setup output config 00:04:07.255 01:46:41 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:07.255 01:46:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:07.255 01:46:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:09.158 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:09.158 01:46:43 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:09.158 01:46:43 -- setup/acl.sh@28 -- # local dev driver 00:04:09.158 01:46:43 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:09.158 01:46:43 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:09.158 01:46:43 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:09.158 01:46:43 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:09.158 01:46:43 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:09.158 01:46:43 -- setup/acl.sh@41 -- # setup reset 00:04:09.158 01:46:43 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:09.158 01:46:43 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:11.694 00:04:11.694 real 0m4.108s 00:04:11.694 user 0m1.200s 00:04:11.694 sys 0m1.959s 00:04:11.694 01:46:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.694 01:46:45 -- common/autotest_common.sh@10 -- # set +x 00:04:11.694 ************************************ 00:04:11.694 END TEST denied 00:04:11.694 ************************************ 00:04:11.694 01:46:45 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:11.694 01:46:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.694 01:46:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.694 01:46:45 -- common/autotest_common.sh@10 -- # set +x 00:04:11.694 ************************************ 00:04:11.694 START TEST allowed 00:04:11.694 ************************************ 00:04:11.694 01:46:45 -- common/autotest_common.sh@1114 -- # allowed 00:04:11.694 01:46:45 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:11.694 01:46:45 -- setup/acl.sh@45 -- # setup output config 00:04:11.694 01:46:45 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:11.694 01:46:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:11.694 01:46:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:13.617 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:13.617 01:46:48 -- setup/acl.sh@47 -- # verify 00:04:13.618 01:46:48 -- setup/acl.sh@28 -- # local dev driver 00:04:13.618 01:46:48 -- setup/acl.sh@48 -- # setup reset 00:04:13.618 01:46:48 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:13.618 01:46:48 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:15.520 00:04:15.520 real 0m4.029s 00:04:15.520 user 0m1.084s 00:04:15.520 sys 0m1.832s 00:04:15.520 01:46:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.520 01:46:49 -- common/autotest_common.sh@10 -- # set +x 00:04:15.520 ************************************ 00:04:15.520 END TEST allowed 00:04:15.520 ************************************ 00:04:15.520 00:04:15.520 real 0m10.995s 00:04:15.520 user 0m3.360s 00:04:15.520 sys 0m5.671s 00:04:15.520 01:46:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.520 01:46:49 -- common/autotest_common.sh@10 -- # set +x 00:04:15.520 ************************************ 00:04:15.520 END TEST acl 00:04:15.520 ************************************ 00:04:15.520 01:46:49 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:15.520 01:46:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.520 01:46:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.520 01:46:49 -- common/autotest_common.sh@10 -- # set +x 00:04:15.520 ************************************ 00:04:15.520 START TEST hugepages 00:04:15.520 ************************************ 00:04:15.520 01:46:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:15.520 * Looking for test storage... 00:04:15.520 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:15.520 01:46:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:15.520 01:46:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:15.520 01:46:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:15.521 01:46:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:15.521 01:46:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:15.521 01:46:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:15.521 01:46:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:15.521 01:46:49 -- scripts/common.sh@335 -- # IFS=.-: 00:04:15.521 01:46:49 -- scripts/common.sh@335 -- # read -ra ver1 00:04:15.521 01:46:49 -- scripts/common.sh@336 -- # IFS=.-: 00:04:15.521 01:46:49 -- scripts/common.sh@336 -- # read -ra ver2 00:04:15.521 01:46:49 -- scripts/common.sh@337 -- # local 'op=<' 00:04:15.521 01:46:49 -- scripts/common.sh@339 -- # ver1_l=2 00:04:15.521 01:46:49 -- scripts/common.sh@340 -- # ver2_l=1 00:04:15.521 01:46:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:15.521 01:46:49 -- scripts/common.sh@343 -- # case "$op" in 00:04:15.521 01:46:49 -- scripts/common.sh@344 -- # : 1 00:04:15.521 01:46:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:15.521 01:46:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:15.521 01:46:49 -- scripts/common.sh@364 -- # decimal 1 00:04:15.521 01:46:49 -- scripts/common.sh@352 -- # local d=1 00:04:15.521 01:46:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:15.521 01:46:49 -- scripts/common.sh@354 -- # echo 1 00:04:15.521 01:46:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:15.521 01:46:49 -- scripts/common.sh@365 -- # decimal 2 00:04:15.521 01:46:49 -- scripts/common.sh@352 -- # local d=2 00:04:15.521 01:46:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:15.521 01:46:49 -- scripts/common.sh@354 -- # echo 2 00:04:15.521 01:46:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:15.521 01:46:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:15.521 01:46:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:15.521 01:46:49 -- scripts/common.sh@367 -- # return 0 00:04:15.521 01:46:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:15.521 01:46:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:15.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.521 --rc genhtml_branch_coverage=1 00:04:15.521 --rc genhtml_function_coverage=1 00:04:15.521 --rc genhtml_legend=1 00:04:15.521 --rc geninfo_all_blocks=1 00:04:15.521 --rc geninfo_unexecuted_blocks=1 00:04:15.521 00:04:15.521 ' 00:04:15.521 01:46:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:15.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.521 --rc genhtml_branch_coverage=1 00:04:15.521 --rc genhtml_function_coverage=1 00:04:15.521 --rc genhtml_legend=1 00:04:15.521 --rc geninfo_all_blocks=1 00:04:15.521 --rc geninfo_unexecuted_blocks=1 00:04:15.521 00:04:15.521 ' 00:04:15.521 01:46:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:15.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.521 --rc genhtml_branch_coverage=1 00:04:15.521 --rc genhtml_function_coverage=1 00:04:15.521 --rc genhtml_legend=1 00:04:15.521 --rc geninfo_all_blocks=1 00:04:15.521 --rc geninfo_unexecuted_blocks=1 00:04:15.521 00:04:15.521 ' 00:04:15.521 01:46:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:15.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.521 --rc genhtml_branch_coverage=1 00:04:15.521 --rc genhtml_function_coverage=1 00:04:15.521 --rc genhtml_legend=1 00:04:15.521 --rc geninfo_all_blocks=1 00:04:15.521 --rc geninfo_unexecuted_blocks=1 00:04:15.521 00:04:15.521 ' 00:04:15.521 01:46:49 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:15.521 01:46:49 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:15.521 01:46:49 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:15.521 01:46:49 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:15.521 01:46:49 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:15.521 01:46:49 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:15.521 01:46:49 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:15.521 01:46:49 -- setup/common.sh@18 -- # local node= 00:04:15.521 01:46:49 -- setup/common.sh@19 -- # local var val 00:04:15.521 01:46:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:15.521 01:46:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:15.521 01:46:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:15.521 01:46:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:15.521 01:46:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:15.521 01:46:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 41918684 kB' 'MemAvailable: 45677480 kB' 'Buffers: 3740 kB' 'Cached: 11958568 kB' 'SwapCached: 0 kB' 'Active: 8647064 kB' 'Inactive: 3758808 kB' 'Active(anon): 8250320 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446936 kB' 'Mapped: 171980 kB' 'Shmem: 7806756 kB' 'KReclaimable: 193644 kB' 'Slab: 671072 kB' 'SReclaimable: 193644 kB' 'SUnreclaim: 477428 kB' 'KernelStack: 12800 kB' 'PageTables: 8028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559280 kB' 'Committed_AS: 9319580 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.521 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.521 01:46:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # continue 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.522 01:46:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.522 01:46:49 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:15.522 01:46:49 -- setup/common.sh@33 -- # echo 2048 00:04:15.522 01:46:49 -- setup/common.sh@33 -- # return 0 00:04:15.522 01:46:49 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:15.522 01:46:49 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:15.522 01:46:49 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:15.522 01:46:49 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:15.522 01:46:49 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:15.522 01:46:49 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:15.522 01:46:49 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:15.522 01:46:49 -- setup/hugepages.sh@207 -- # get_nodes 00:04:15.522 01:46:49 -- setup/hugepages.sh@27 -- # local node 00:04:15.522 01:46:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:15.522 01:46:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:15.522 01:46:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:15.522 01:46:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:15.522 01:46:49 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:15.522 01:46:49 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:15.522 01:46:49 -- setup/hugepages.sh@208 -- # clear_hp 00:04:15.522 01:46:49 -- setup/hugepages.sh@37 -- # local node hp 00:04:15.523 01:46:49 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:15.523 01:46:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:15.523 01:46:49 -- setup/hugepages.sh@41 -- # echo 0 00:04:15.523 01:46:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:15.523 01:46:49 -- setup/hugepages.sh@41 -- # echo 0 00:04:15.523 01:46:49 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:15.523 01:46:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:15.523 01:46:49 -- setup/hugepages.sh@41 -- # echo 0 00:04:15.523 01:46:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:15.523 01:46:49 -- setup/hugepages.sh@41 -- # echo 0 00:04:15.523 01:46:49 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:15.523 01:46:49 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:15.523 01:46:49 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:15.523 01:46:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.523 01:46:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.523 01:46:49 -- common/autotest_common.sh@10 -- # set +x 00:04:15.523 ************************************ 00:04:15.523 START TEST default_setup 00:04:15.523 ************************************ 00:04:15.523 01:46:49 -- common/autotest_common.sh@1114 -- # default_setup 00:04:15.523 01:46:49 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:15.523 01:46:49 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:15.523 01:46:49 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:15.523 01:46:49 -- setup/hugepages.sh@51 -- # shift 00:04:15.523 01:46:49 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:15.523 01:46:49 -- setup/hugepages.sh@52 -- # local node_ids 00:04:15.523 01:46:49 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:15.523 01:46:49 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:15.523 01:46:49 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:15.523 01:46:49 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:15.523 01:46:49 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:15.523 01:46:49 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:15.523 01:46:49 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:15.523 01:46:49 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:15.523 01:46:49 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:15.523 01:46:49 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:15.523 01:46:49 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:15.523 01:46:49 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:15.523 01:46:49 -- setup/hugepages.sh@73 -- # return 0 00:04:15.523 01:46:49 -- setup/hugepages.sh@137 -- # setup output 00:04:15.523 01:46:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:15.523 01:46:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:16.899 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:16.899 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:16.899 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:16.899 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:16.899 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:16.899 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:16.899 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:16.899 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:16.899 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:16.899 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:16.899 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:16.899 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:16.899 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:16.899 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:16.899 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:16.899 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:17.839 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:17.839 01:46:52 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:17.839 01:46:52 -- setup/hugepages.sh@89 -- # local node 00:04:17.839 01:46:52 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:17.839 01:46:52 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:17.839 01:46:52 -- setup/hugepages.sh@92 -- # local surp 00:04:17.839 01:46:52 -- setup/hugepages.sh@93 -- # local resv 00:04:17.839 01:46:52 -- setup/hugepages.sh@94 -- # local anon 00:04:17.839 01:46:52 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:17.839 01:46:52 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:17.839 01:46:52 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:17.839 01:46:52 -- setup/common.sh@18 -- # local node= 00:04:17.839 01:46:52 -- setup/common.sh@19 -- # local var val 00:04:17.839 01:46:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:17.839 01:46:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:17.839 01:46:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:17.839 01:46:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:17.839 01:46:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:17.839 01:46:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.103 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.103 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44048000 kB' 'MemAvailable: 47806876 kB' 'Buffers: 3740 kB' 'Cached: 11958668 kB' 'SwapCached: 0 kB' 'Active: 8647460 kB' 'Inactive: 3758808 kB' 'Active(anon): 8250716 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447128 kB' 'Mapped: 171580 kB' 'Shmem: 7806856 kB' 'KReclaimable: 193804 kB' 'Slab: 670928 kB' 'SReclaimable: 193804 kB' 'SUnreclaim: 477124 kB' 'KernelStack: 12704 kB' 'PageTables: 7676 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9322620 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.104 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.104 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.105 01:46:52 -- setup/common.sh@33 -- # echo 0 00:04:18.105 01:46:52 -- setup/common.sh@33 -- # return 0 00:04:18.105 01:46:52 -- setup/hugepages.sh@97 -- # anon=0 00:04:18.105 01:46:52 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:18.105 01:46:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:18.105 01:46:52 -- setup/common.sh@18 -- # local node= 00:04:18.105 01:46:52 -- setup/common.sh@19 -- # local var val 00:04:18.105 01:46:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.105 01:46:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.105 01:46:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.105 01:46:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.105 01:46:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.105 01:46:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44066400 kB' 'MemAvailable: 47825276 kB' 'Buffers: 3740 kB' 'Cached: 11958672 kB' 'SwapCached: 0 kB' 'Active: 8647820 kB' 'Inactive: 3758808 kB' 'Active(anon): 8251076 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447548 kB' 'Mapped: 171580 kB' 'Shmem: 7806860 kB' 'KReclaimable: 193804 kB' 'Slab: 670908 kB' 'SReclaimable: 193804 kB' 'SUnreclaim: 477104 kB' 'KernelStack: 12688 kB' 'PageTables: 7608 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9322632 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.105 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.105 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.106 01:46:52 -- setup/common.sh@33 -- # echo 0 00:04:18.106 01:46:52 -- setup/common.sh@33 -- # return 0 00:04:18.106 01:46:52 -- setup/hugepages.sh@99 -- # surp=0 00:04:18.106 01:46:52 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:18.106 01:46:52 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:18.106 01:46:52 -- setup/common.sh@18 -- # local node= 00:04:18.106 01:46:52 -- setup/common.sh@19 -- # local var val 00:04:18.106 01:46:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.106 01:46:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.106 01:46:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.106 01:46:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.106 01:46:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.106 01:46:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44066920 kB' 'MemAvailable: 47825780 kB' 'Buffers: 3740 kB' 'Cached: 11958684 kB' 'SwapCached: 0 kB' 'Active: 8647288 kB' 'Inactive: 3758808 kB' 'Active(anon): 8250544 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447064 kB' 'Mapped: 171540 kB' 'Shmem: 7806872 kB' 'KReclaimable: 193772 kB' 'Slab: 670924 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477152 kB' 'KernelStack: 12736 kB' 'PageTables: 7728 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9322648 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198232 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.106 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.106 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.107 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.107 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.108 01:46:52 -- setup/common.sh@33 -- # echo 0 00:04:18.108 01:46:52 -- setup/common.sh@33 -- # return 0 00:04:18.108 01:46:52 -- setup/hugepages.sh@100 -- # resv=0 00:04:18.108 01:46:52 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:18.108 nr_hugepages=1024 00:04:18.108 01:46:52 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:18.108 resv_hugepages=0 00:04:18.108 01:46:52 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:18.108 surplus_hugepages=0 00:04:18.108 01:46:52 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:18.108 anon_hugepages=0 00:04:18.108 01:46:52 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:18.108 01:46:52 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:18.108 01:46:52 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:18.108 01:46:52 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:18.108 01:46:52 -- setup/common.sh@18 -- # local node= 00:04:18.108 01:46:52 -- setup/common.sh@19 -- # local var val 00:04:18.108 01:46:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.108 01:46:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.108 01:46:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.108 01:46:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.108 01:46:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.108 01:46:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44066920 kB' 'MemAvailable: 47825780 kB' 'Buffers: 3740 kB' 'Cached: 11958700 kB' 'SwapCached: 0 kB' 'Active: 8647308 kB' 'Inactive: 3758808 kB' 'Active(anon): 8250564 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447068 kB' 'Mapped: 171540 kB' 'Shmem: 7806888 kB' 'KReclaimable: 193772 kB' 'Slab: 670924 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477152 kB' 'KernelStack: 12736 kB' 'PageTables: 7728 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9322664 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198232 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.108 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.108 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.109 01:46:52 -- setup/common.sh@33 -- # echo 1024 00:04:18.109 01:46:52 -- setup/common.sh@33 -- # return 0 00:04:18.109 01:46:52 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:18.109 01:46:52 -- setup/hugepages.sh@112 -- # get_nodes 00:04:18.109 01:46:52 -- setup/hugepages.sh@27 -- # local node 00:04:18.109 01:46:52 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:18.109 01:46:52 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:18.109 01:46:52 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:18.109 01:46:52 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:18.109 01:46:52 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:18.109 01:46:52 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:18.109 01:46:52 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:18.109 01:46:52 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:18.109 01:46:52 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:18.109 01:46:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:18.109 01:46:52 -- setup/common.sh@18 -- # local node=0 00:04:18.109 01:46:52 -- setup/common.sh@19 -- # local var val 00:04:18.109 01:46:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.109 01:46:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.109 01:46:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:18.109 01:46:52 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:18.109 01:46:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.109 01:46:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20297552 kB' 'MemUsed: 12528304 kB' 'SwapCached: 0 kB' 'Active: 5866712 kB' 'Inactive: 3506048 kB' 'Active(anon): 5700284 kB' 'Inactive(anon): 0 kB' 'Active(file): 166428 kB' 'Inactive(file): 3506048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9021900 kB' 'Mapped: 56288 kB' 'AnonPages: 354012 kB' 'Shmem: 5349424 kB' 'KernelStack: 7112 kB' 'PageTables: 4664 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123968 kB' 'Slab: 402612 kB' 'SReclaimable: 123968 kB' 'SUnreclaim: 278644 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.109 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.109 01:46:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # continue 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.110 01:46:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.110 01:46:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.110 01:46:52 -- setup/common.sh@33 -- # echo 0 00:04:18.110 01:46:52 -- setup/common.sh@33 -- # return 0 00:04:18.110 01:46:52 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:18.110 01:46:52 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:18.110 01:46:52 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:18.110 01:46:52 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:18.110 01:46:52 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:18.110 node0=1024 expecting 1024 00:04:18.110 01:46:52 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:18.110 00:04:18.110 real 0m2.471s 00:04:18.110 user 0m0.666s 00:04:18.110 sys 0m0.948s 00:04:18.110 01:46:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:18.110 01:46:52 -- common/autotest_common.sh@10 -- # set +x 00:04:18.110 ************************************ 00:04:18.110 END TEST default_setup 00:04:18.110 ************************************ 00:04:18.110 01:46:52 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:18.110 01:46:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:18.110 01:46:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:18.110 01:46:52 -- common/autotest_common.sh@10 -- # set +x 00:04:18.110 ************************************ 00:04:18.110 START TEST per_node_1G_alloc 00:04:18.110 ************************************ 00:04:18.110 01:46:52 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:18.110 01:46:52 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:18.110 01:46:52 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:18.110 01:46:52 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:18.110 01:46:52 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:18.110 01:46:52 -- setup/hugepages.sh@51 -- # shift 00:04:18.110 01:46:52 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:18.110 01:46:52 -- setup/hugepages.sh@52 -- # local node_ids 00:04:18.110 01:46:52 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:18.110 01:46:52 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:18.110 01:46:52 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:18.110 01:46:52 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:18.111 01:46:52 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:18.111 01:46:52 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:18.111 01:46:52 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:18.111 01:46:52 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:18.111 01:46:52 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:18.111 01:46:52 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:18.111 01:46:52 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:18.111 01:46:52 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:18.111 01:46:52 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:18.111 01:46:52 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:18.111 01:46:52 -- setup/hugepages.sh@73 -- # return 0 00:04:18.111 01:46:52 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:18.111 01:46:52 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:18.111 01:46:52 -- setup/hugepages.sh@146 -- # setup output 00:04:18.111 01:46:52 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:18.111 01:46:52 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:19.543 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:19.543 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:19.543 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:19.543 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:19.543 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:19.543 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:19.543 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:19.543 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:19.543 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:19.543 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:19.543 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:19.543 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:19.543 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:19.543 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:19.543 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:19.543 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:19.543 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:19.543 01:46:53 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:19.543 01:46:53 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:19.543 01:46:53 -- setup/hugepages.sh@89 -- # local node 00:04:19.543 01:46:53 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:19.543 01:46:53 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:19.543 01:46:53 -- setup/hugepages.sh@92 -- # local surp 00:04:19.543 01:46:53 -- setup/hugepages.sh@93 -- # local resv 00:04:19.543 01:46:53 -- setup/hugepages.sh@94 -- # local anon 00:04:19.543 01:46:53 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:19.543 01:46:53 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:19.543 01:46:53 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:19.543 01:46:53 -- setup/common.sh@18 -- # local node= 00:04:19.543 01:46:53 -- setup/common.sh@19 -- # local var val 00:04:19.543 01:46:53 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.543 01:46:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.543 01:46:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:19.543 01:46:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:19.543 01:46:53 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.543 01:46:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.543 01:46:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44061644 kB' 'MemAvailable: 47820504 kB' 'Buffers: 3740 kB' 'Cached: 11958748 kB' 'SwapCached: 0 kB' 'Active: 8648128 kB' 'Inactive: 3758808 kB' 'Active(anon): 8251384 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447624 kB' 'Mapped: 171548 kB' 'Shmem: 7806936 kB' 'KReclaimable: 193772 kB' 'Slab: 671080 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477308 kB' 'KernelStack: 12736 kB' 'PageTables: 7704 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9323008 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.543 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.543 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.544 01:46:53 -- setup/common.sh@33 -- # echo 0 00:04:19.544 01:46:53 -- setup/common.sh@33 -- # return 0 00:04:19.544 01:46:53 -- setup/hugepages.sh@97 -- # anon=0 00:04:19.544 01:46:53 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:19.544 01:46:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:19.544 01:46:53 -- setup/common.sh@18 -- # local node= 00:04:19.544 01:46:53 -- setup/common.sh@19 -- # local var val 00:04:19.544 01:46:53 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.544 01:46:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.544 01:46:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:19.544 01:46:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:19.544 01:46:53 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.544 01:46:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44064624 kB' 'MemAvailable: 47823484 kB' 'Buffers: 3740 kB' 'Cached: 11958748 kB' 'SwapCached: 0 kB' 'Active: 8648072 kB' 'Inactive: 3758808 kB' 'Active(anon): 8251328 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447608 kB' 'Mapped: 171548 kB' 'Shmem: 7806936 kB' 'KReclaimable: 193772 kB' 'Slab: 671044 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477272 kB' 'KernelStack: 12704 kB' 'PageTables: 7588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9323020 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.544 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.544 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.545 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.545 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.546 01:46:53 -- setup/common.sh@33 -- # echo 0 00:04:19.546 01:46:53 -- setup/common.sh@33 -- # return 0 00:04:19.546 01:46:53 -- setup/hugepages.sh@99 -- # surp=0 00:04:19.546 01:46:53 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:19.546 01:46:53 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:19.546 01:46:53 -- setup/common.sh@18 -- # local node= 00:04:19.546 01:46:53 -- setup/common.sh@19 -- # local var val 00:04:19.546 01:46:53 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.546 01:46:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.546 01:46:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:19.546 01:46:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:19.546 01:46:53 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.546 01:46:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44064952 kB' 'MemAvailable: 47823812 kB' 'Buffers: 3740 kB' 'Cached: 11958760 kB' 'SwapCached: 0 kB' 'Active: 8647672 kB' 'Inactive: 3758808 kB' 'Active(anon): 8250928 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447168 kB' 'Mapped: 171548 kB' 'Shmem: 7806948 kB' 'KReclaimable: 193772 kB' 'Slab: 671136 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477364 kB' 'KernelStack: 12768 kB' 'PageTables: 7728 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9323036 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.546 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.546 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.547 01:46:53 -- setup/common.sh@33 -- # echo 0 00:04:19.547 01:46:53 -- setup/common.sh@33 -- # return 0 00:04:19.547 01:46:53 -- setup/hugepages.sh@100 -- # resv=0 00:04:19.547 01:46:53 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:19.547 nr_hugepages=1024 00:04:19.547 01:46:53 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:19.547 resv_hugepages=0 00:04:19.547 01:46:53 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:19.547 surplus_hugepages=0 00:04:19.547 01:46:53 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:19.547 anon_hugepages=0 00:04:19.547 01:46:53 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:19.547 01:46:53 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:19.547 01:46:53 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:19.547 01:46:53 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:19.547 01:46:53 -- setup/common.sh@18 -- # local node= 00:04:19.547 01:46:53 -- setup/common.sh@19 -- # local var val 00:04:19.547 01:46:53 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.547 01:46:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.547 01:46:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:19.547 01:46:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:19.547 01:46:53 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.547 01:46:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44065692 kB' 'MemAvailable: 47824552 kB' 'Buffers: 3740 kB' 'Cached: 11958776 kB' 'SwapCached: 0 kB' 'Active: 8647680 kB' 'Inactive: 3758808 kB' 'Active(anon): 8250936 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447164 kB' 'Mapped: 171548 kB' 'Shmem: 7806964 kB' 'KReclaimable: 193772 kB' 'Slab: 671128 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477356 kB' 'KernelStack: 12768 kB' 'PageTables: 7728 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9323048 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.547 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.547 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.548 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.548 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.549 01:46:53 -- setup/common.sh@33 -- # echo 1024 00:04:19.549 01:46:53 -- setup/common.sh@33 -- # return 0 00:04:19.549 01:46:53 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:19.549 01:46:53 -- setup/hugepages.sh@112 -- # get_nodes 00:04:19.549 01:46:53 -- setup/hugepages.sh@27 -- # local node 00:04:19.549 01:46:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:19.549 01:46:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:19.549 01:46:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:19.549 01:46:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:19.549 01:46:53 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:19.549 01:46:53 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:19.549 01:46:53 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:19.549 01:46:53 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:19.549 01:46:53 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:19.549 01:46:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:19.549 01:46:53 -- setup/common.sh@18 -- # local node=0 00:04:19.549 01:46:53 -- setup/common.sh@19 -- # local var val 00:04:19.549 01:46:53 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.549 01:46:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.549 01:46:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:19.549 01:46:53 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:19.549 01:46:53 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.549 01:46:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21355436 kB' 'MemUsed: 11470420 kB' 'SwapCached: 0 kB' 'Active: 5866912 kB' 'Inactive: 3506048 kB' 'Active(anon): 5700484 kB' 'Inactive(anon): 0 kB' 'Active(file): 166428 kB' 'Inactive(file): 3506048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9021908 kB' 'Mapped: 56288 kB' 'AnonPages: 354128 kB' 'Shmem: 5349432 kB' 'KernelStack: 7128 kB' 'PageTables: 4664 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123968 kB' 'Slab: 402660 kB' 'SReclaimable: 123968 kB' 'SUnreclaim: 278692 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.549 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.549 01:46:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@33 -- # echo 0 00:04:19.550 01:46:53 -- setup/common.sh@33 -- # return 0 00:04:19.550 01:46:53 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:19.550 01:46:53 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:19.550 01:46:53 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:19.550 01:46:53 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:19.550 01:46:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:19.550 01:46:53 -- setup/common.sh@18 -- # local node=1 00:04:19.550 01:46:53 -- setup/common.sh@19 -- # local var val 00:04:19.550 01:46:53 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.550 01:46:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.550 01:46:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:19.550 01:46:53 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:19.550 01:46:53 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.550 01:46:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709800 kB' 'MemFree: 22710808 kB' 'MemUsed: 4998992 kB' 'SwapCached: 0 kB' 'Active: 2780556 kB' 'Inactive: 252760 kB' 'Active(anon): 2550240 kB' 'Inactive(anon): 0 kB' 'Active(file): 230316 kB' 'Inactive(file): 252760 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2940636 kB' 'Mapped: 115260 kB' 'AnonPages: 92780 kB' 'Shmem: 2457560 kB' 'KernelStack: 5624 kB' 'PageTables: 3008 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 69804 kB' 'Slab: 268468 kB' 'SReclaimable: 69804 kB' 'SUnreclaim: 198664 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.550 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.550 01:46:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # continue 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.551 01:46:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.551 01:46:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.551 01:46:53 -- setup/common.sh@33 -- # echo 0 00:04:19.551 01:46:53 -- setup/common.sh@33 -- # return 0 00:04:19.551 01:46:53 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:19.551 01:46:53 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:19.551 01:46:53 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:19.551 01:46:53 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:19.551 01:46:53 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:19.551 node0=512 expecting 512 00:04:19.551 01:46:53 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:19.551 01:46:53 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:19.551 01:46:53 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:19.551 01:46:53 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:19.551 node1=512 expecting 512 00:04:19.551 01:46:53 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:19.551 00:04:19.551 real 0m1.537s 00:04:19.551 user 0m0.660s 00:04:19.551 sys 0m0.845s 00:04:19.551 01:46:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.551 01:46:53 -- common/autotest_common.sh@10 -- # set +x 00:04:19.551 ************************************ 00:04:19.551 END TEST per_node_1G_alloc 00:04:19.551 ************************************ 00:04:19.810 01:46:53 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:19.810 01:46:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.810 01:46:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.810 01:46:53 -- common/autotest_common.sh@10 -- # set +x 00:04:19.810 ************************************ 00:04:19.810 START TEST even_2G_alloc 00:04:19.810 ************************************ 00:04:19.810 01:46:53 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:19.810 01:46:53 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:19.810 01:46:53 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:19.810 01:46:53 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:19.810 01:46:53 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:19.810 01:46:53 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:19.810 01:46:53 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:19.810 01:46:53 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:19.810 01:46:53 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:19.810 01:46:53 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:19.810 01:46:53 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:19.810 01:46:53 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:19.810 01:46:53 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:19.810 01:46:53 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:19.810 01:46:53 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:19.810 01:46:53 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:19.810 01:46:53 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:19.810 01:46:53 -- setup/hugepages.sh@83 -- # : 512 00:04:19.810 01:46:53 -- setup/hugepages.sh@84 -- # : 1 00:04:19.810 01:46:53 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:19.810 01:46:53 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:19.810 01:46:53 -- setup/hugepages.sh@83 -- # : 0 00:04:19.810 01:46:53 -- setup/hugepages.sh@84 -- # : 0 00:04:19.810 01:46:53 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:19.810 01:46:53 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:19.810 01:46:53 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:19.810 01:46:53 -- setup/hugepages.sh@153 -- # setup output 00:04:19.810 01:46:53 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:19.810 01:46:53 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:20.747 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:20.747 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:20.747 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:20.747 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:20.747 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:20.747 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:20.747 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:20.747 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:20.747 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:20.747 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:20.747 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:20.747 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:20.747 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:20.747 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:20.747 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:20.747 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:20.747 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:21.010 01:46:55 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:21.010 01:46:55 -- setup/hugepages.sh@89 -- # local node 00:04:21.010 01:46:55 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:21.010 01:46:55 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:21.010 01:46:55 -- setup/hugepages.sh@92 -- # local surp 00:04:21.010 01:46:55 -- setup/hugepages.sh@93 -- # local resv 00:04:21.010 01:46:55 -- setup/hugepages.sh@94 -- # local anon 00:04:21.010 01:46:55 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:21.010 01:46:55 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:21.010 01:46:55 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:21.010 01:46:55 -- setup/common.sh@18 -- # local node= 00:04:21.010 01:46:55 -- setup/common.sh@19 -- # local var val 00:04:21.010 01:46:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.010 01:46:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.010 01:46:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.010 01:46:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.010 01:46:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.010 01:46:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.010 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.010 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44066220 kB' 'MemAvailable: 47825080 kB' 'Buffers: 3740 kB' 'Cached: 11958836 kB' 'SwapCached: 0 kB' 'Active: 8647948 kB' 'Inactive: 3758808 kB' 'Active(anon): 8251204 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447436 kB' 'Mapped: 171588 kB' 'Shmem: 7807024 kB' 'KReclaimable: 193772 kB' 'Slab: 671200 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477428 kB' 'KernelStack: 12768 kB' 'PageTables: 7688 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9323228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.011 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.011 01:46:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.011 01:46:55 -- setup/common.sh@33 -- # echo 0 00:04:21.011 01:46:55 -- setup/common.sh@33 -- # return 0 00:04:21.012 01:46:55 -- setup/hugepages.sh@97 -- # anon=0 00:04:21.012 01:46:55 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:21.012 01:46:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.012 01:46:55 -- setup/common.sh@18 -- # local node= 00:04:21.012 01:46:55 -- setup/common.sh@19 -- # local var val 00:04:21.012 01:46:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.012 01:46:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.012 01:46:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.012 01:46:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.012 01:46:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.012 01:46:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44070180 kB' 'MemAvailable: 47829040 kB' 'Buffers: 3740 kB' 'Cached: 11958836 kB' 'SwapCached: 0 kB' 'Active: 8648108 kB' 'Inactive: 3758808 kB' 'Active(anon): 8251364 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447620 kB' 'Mapped: 171556 kB' 'Shmem: 7807024 kB' 'KReclaimable: 193772 kB' 'Slab: 670824 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477052 kB' 'KernelStack: 12800 kB' 'PageTables: 7780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9323240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.012 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.012 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.013 01:46:55 -- setup/common.sh@33 -- # echo 0 00:04:21.013 01:46:55 -- setup/common.sh@33 -- # return 0 00:04:21.013 01:46:55 -- setup/hugepages.sh@99 -- # surp=0 00:04:21.013 01:46:55 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:21.013 01:46:55 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:21.013 01:46:55 -- setup/common.sh@18 -- # local node= 00:04:21.013 01:46:55 -- setup/common.sh@19 -- # local var val 00:04:21.013 01:46:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.013 01:46:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.013 01:46:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.013 01:46:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.013 01:46:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.013 01:46:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44070788 kB' 'MemAvailable: 47829648 kB' 'Buffers: 3740 kB' 'Cached: 11958852 kB' 'SwapCached: 0 kB' 'Active: 8647896 kB' 'Inactive: 3758808 kB' 'Active(anon): 8251152 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447336 kB' 'Mapped: 171556 kB' 'Shmem: 7807040 kB' 'KReclaimable: 193772 kB' 'Slab: 670892 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477120 kB' 'KernelStack: 12800 kB' 'PageTables: 7736 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9323528 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.013 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.013 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.014 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.014 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.014 01:46:55 -- setup/common.sh@33 -- # echo 0 00:04:21.014 01:46:55 -- setup/common.sh@33 -- # return 0 00:04:21.014 01:46:55 -- setup/hugepages.sh@100 -- # resv=0 00:04:21.014 01:46:55 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:21.014 nr_hugepages=1024 00:04:21.014 01:46:55 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:21.014 resv_hugepages=0 00:04:21.014 01:46:55 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:21.014 surplus_hugepages=0 00:04:21.014 01:46:55 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:21.014 anon_hugepages=0 00:04:21.014 01:46:55 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:21.014 01:46:55 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:21.014 01:46:55 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:21.014 01:46:55 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:21.015 01:46:55 -- setup/common.sh@18 -- # local node= 00:04:21.015 01:46:55 -- setup/common.sh@19 -- # local var val 00:04:21.015 01:46:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.015 01:46:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.015 01:46:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.015 01:46:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.015 01:46:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.015 01:46:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44069560 kB' 'MemAvailable: 47828420 kB' 'Buffers: 3740 kB' 'Cached: 11958864 kB' 'SwapCached: 0 kB' 'Active: 8651248 kB' 'Inactive: 3758808 kB' 'Active(anon): 8254504 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450652 kB' 'Mapped: 171992 kB' 'Shmem: 7807052 kB' 'KReclaimable: 193772 kB' 'Slab: 670892 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477120 kB' 'KernelStack: 12704 kB' 'PageTables: 7416 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9327556 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.015 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.015 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.016 01:46:55 -- setup/common.sh@33 -- # echo 1024 00:04:21.016 01:46:55 -- setup/common.sh@33 -- # return 0 00:04:21.016 01:46:55 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:21.016 01:46:55 -- setup/hugepages.sh@112 -- # get_nodes 00:04:21.016 01:46:55 -- setup/hugepages.sh@27 -- # local node 00:04:21.016 01:46:55 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:21.016 01:46:55 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:21.016 01:46:55 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:21.016 01:46:55 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:21.016 01:46:55 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:21.016 01:46:55 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:21.016 01:46:55 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:21.016 01:46:55 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:21.016 01:46:55 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:21.016 01:46:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.016 01:46:55 -- setup/common.sh@18 -- # local node=0 00:04:21.016 01:46:55 -- setup/common.sh@19 -- # local var val 00:04:21.016 01:46:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.016 01:46:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.016 01:46:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:21.016 01:46:55 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:21.016 01:46:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.016 01:46:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21346980 kB' 'MemUsed: 11478876 kB' 'SwapCached: 0 kB' 'Active: 5872900 kB' 'Inactive: 3506048 kB' 'Active(anon): 5706472 kB' 'Inactive(anon): 0 kB' 'Active(file): 166428 kB' 'Inactive(file): 3506048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9021920 kB' 'Mapped: 57128 kB' 'AnonPages: 360192 kB' 'Shmem: 5349444 kB' 'KernelStack: 7160 kB' 'PageTables: 4748 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123968 kB' 'Slab: 402452 kB' 'SReclaimable: 123968 kB' 'SUnreclaim: 278484 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.016 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.016 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.017 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.017 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.278 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.278 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@33 -- # echo 0 00:04:21.279 01:46:55 -- setup/common.sh@33 -- # return 0 00:04:21.279 01:46:55 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:21.279 01:46:55 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:21.279 01:46:55 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:21.279 01:46:55 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:21.279 01:46:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.279 01:46:55 -- setup/common.sh@18 -- # local node=1 00:04:21.279 01:46:55 -- setup/common.sh@19 -- # local var val 00:04:21.279 01:46:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.279 01:46:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.279 01:46:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:21.279 01:46:55 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:21.279 01:46:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.279 01:46:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709800 kB' 'MemFree: 22716364 kB' 'MemUsed: 4993436 kB' 'SwapCached: 0 kB' 'Active: 2782628 kB' 'Inactive: 252760 kB' 'Active(anon): 2552312 kB' 'Inactive(anon): 0 kB' 'Active(file): 230316 kB' 'Inactive(file): 252760 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2940716 kB' 'Mapped: 115284 kB' 'AnonPages: 94792 kB' 'Shmem: 2457640 kB' 'KernelStack: 5592 kB' 'PageTables: 2796 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 69804 kB' 'Slab: 268440 kB' 'SReclaimable: 69804 kB' 'SUnreclaim: 198636 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.279 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.279 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # continue 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.280 01:46:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.280 01:46:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.280 01:46:55 -- setup/common.sh@33 -- # echo 0 00:04:21.280 01:46:55 -- setup/common.sh@33 -- # return 0 00:04:21.280 01:46:55 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:21.280 01:46:55 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:21.280 01:46:55 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:21.280 01:46:55 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:21.280 01:46:55 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:21.280 node0=512 expecting 512 00:04:21.280 01:46:55 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:21.280 01:46:55 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:21.280 01:46:55 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:21.280 01:46:55 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:21.280 node1=512 expecting 512 00:04:21.280 01:46:55 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:21.280 00:04:21.280 real 0m1.482s 00:04:21.280 user 0m0.612s 00:04:21.280 sys 0m0.836s 00:04:21.280 01:46:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:21.280 01:46:55 -- common/autotest_common.sh@10 -- # set +x 00:04:21.280 ************************************ 00:04:21.280 END TEST even_2G_alloc 00:04:21.280 ************************************ 00:04:21.280 01:46:55 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:21.280 01:46:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:21.280 01:46:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:21.280 01:46:55 -- common/autotest_common.sh@10 -- # set +x 00:04:21.280 ************************************ 00:04:21.280 START TEST odd_alloc 00:04:21.280 ************************************ 00:04:21.280 01:46:55 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:21.281 01:46:55 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:21.281 01:46:55 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:21.281 01:46:55 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:21.281 01:46:55 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:21.281 01:46:55 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:21.281 01:46:55 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:21.281 01:46:55 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:21.281 01:46:55 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:21.281 01:46:55 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:21.281 01:46:55 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:21.281 01:46:55 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:21.281 01:46:55 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:21.281 01:46:55 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:21.281 01:46:55 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:21.281 01:46:55 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:21.281 01:46:55 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:21.281 01:46:55 -- setup/hugepages.sh@83 -- # : 513 00:04:21.281 01:46:55 -- setup/hugepages.sh@84 -- # : 1 00:04:21.281 01:46:55 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:21.281 01:46:55 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:21.281 01:46:55 -- setup/hugepages.sh@83 -- # : 0 00:04:21.281 01:46:55 -- setup/hugepages.sh@84 -- # : 0 00:04:21.281 01:46:55 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:21.281 01:46:55 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:21.281 01:46:55 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:21.281 01:46:55 -- setup/hugepages.sh@160 -- # setup output 00:04:21.281 01:46:55 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:21.281 01:46:55 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:22.666 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:22.666 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:22.666 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:22.666 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:22.666 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:22.666 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:22.666 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:22.666 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:22.666 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:22.666 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:22.666 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:22.666 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:22.666 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:22.666 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:22.666 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:22.666 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:22.666 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:22.666 01:46:56 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:22.666 01:46:56 -- setup/hugepages.sh@89 -- # local node 00:04:22.666 01:46:56 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:22.666 01:46:56 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:22.666 01:46:56 -- setup/hugepages.sh@92 -- # local surp 00:04:22.666 01:46:56 -- setup/hugepages.sh@93 -- # local resv 00:04:22.666 01:46:56 -- setup/hugepages.sh@94 -- # local anon 00:04:22.666 01:46:56 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:22.666 01:46:56 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:22.666 01:46:56 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:22.666 01:46:56 -- setup/common.sh@18 -- # local node= 00:04:22.666 01:46:56 -- setup/common.sh@19 -- # local var val 00:04:22.666 01:46:56 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.666 01:46:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.666 01:46:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:22.666 01:46:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:22.666 01:46:56 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.666 01:46:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.666 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.666 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.666 01:46:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44066448 kB' 'MemAvailable: 47825308 kB' 'Buffers: 3740 kB' 'Cached: 11958932 kB' 'SwapCached: 0 kB' 'Active: 8646556 kB' 'Inactive: 3758808 kB' 'Active(anon): 8249812 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445904 kB' 'Mapped: 170540 kB' 'Shmem: 7807120 kB' 'KReclaimable: 193772 kB' 'Slab: 670716 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 476944 kB' 'KernelStack: 12720 kB' 'PageTables: 7348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 9309904 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:22.666 01:46:56 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.666 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.666 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.667 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.667 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.668 01:46:56 -- setup/common.sh@33 -- # echo 0 00:04:22.668 01:46:56 -- setup/common.sh@33 -- # return 0 00:04:22.668 01:46:56 -- setup/hugepages.sh@97 -- # anon=0 00:04:22.668 01:46:56 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:22.668 01:46:56 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:22.668 01:46:56 -- setup/common.sh@18 -- # local node= 00:04:22.668 01:46:56 -- setup/common.sh@19 -- # local var val 00:04:22.668 01:46:56 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.668 01:46:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.668 01:46:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:22.668 01:46:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:22.668 01:46:56 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.668 01:46:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44076568 kB' 'MemAvailable: 47835428 kB' 'Buffers: 3740 kB' 'Cached: 11958936 kB' 'SwapCached: 0 kB' 'Active: 8646552 kB' 'Inactive: 3758808 kB' 'Active(anon): 8249808 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445876 kB' 'Mapped: 170576 kB' 'Shmem: 7807124 kB' 'KReclaimable: 193772 kB' 'Slab: 670728 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 476956 kB' 'KernelStack: 12736 kB' 'PageTables: 7396 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 9309916 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.668 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.668 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.669 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.669 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.670 01:46:56 -- setup/common.sh@33 -- # echo 0 00:04:22.670 01:46:56 -- setup/common.sh@33 -- # return 0 00:04:22.670 01:46:56 -- setup/hugepages.sh@99 -- # surp=0 00:04:22.670 01:46:56 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:22.670 01:46:56 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:22.670 01:46:56 -- setup/common.sh@18 -- # local node= 00:04:22.670 01:46:56 -- setup/common.sh@19 -- # local var val 00:04:22.670 01:46:56 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.670 01:46:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.670 01:46:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:22.670 01:46:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:22.670 01:46:56 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.670 01:46:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44076656 kB' 'MemAvailable: 47835516 kB' 'Buffers: 3740 kB' 'Cached: 11958948 kB' 'SwapCached: 0 kB' 'Active: 8646364 kB' 'Inactive: 3758808 kB' 'Active(anon): 8249620 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445676 kB' 'Mapped: 170500 kB' 'Shmem: 7807136 kB' 'KReclaimable: 193772 kB' 'Slab: 670728 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 476956 kB' 'KernelStack: 12736 kB' 'PageTables: 7336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 9309932 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.670 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.670 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.671 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.671 01:46:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.671 01:46:56 -- setup/common.sh@33 -- # echo 0 00:04:22.671 01:46:56 -- setup/common.sh@33 -- # return 0 00:04:22.671 01:46:56 -- setup/hugepages.sh@100 -- # resv=0 00:04:22.671 01:46:56 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:22.671 nr_hugepages=1025 00:04:22.671 01:46:56 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:22.671 resv_hugepages=0 00:04:22.671 01:46:56 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:22.671 surplus_hugepages=0 00:04:22.671 01:46:56 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:22.671 anon_hugepages=0 00:04:22.672 01:46:56 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:22.672 01:46:56 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:22.672 01:46:56 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:22.672 01:46:56 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:22.672 01:46:56 -- setup/common.sh@18 -- # local node= 00:04:22.672 01:46:56 -- setup/common.sh@19 -- # local var val 00:04:22.672 01:46:56 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.672 01:46:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.672 01:46:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:22.672 01:46:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:22.672 01:46:56 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.672 01:46:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44076656 kB' 'MemAvailable: 47835516 kB' 'Buffers: 3740 kB' 'Cached: 11958960 kB' 'SwapCached: 0 kB' 'Active: 8646416 kB' 'Inactive: 3758808 kB' 'Active(anon): 8249672 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445716 kB' 'Mapped: 170500 kB' 'Shmem: 7807148 kB' 'KReclaimable: 193772 kB' 'Slab: 670728 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 476956 kB' 'KernelStack: 12752 kB' 'PageTables: 7392 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 9309948 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.672 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.672 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.673 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.673 01:46:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.673 01:46:56 -- setup/common.sh@33 -- # echo 1025 00:04:22.673 01:46:56 -- setup/common.sh@33 -- # return 0 00:04:22.673 01:46:56 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:22.673 01:46:56 -- setup/hugepages.sh@112 -- # get_nodes 00:04:22.673 01:46:56 -- setup/hugepages.sh@27 -- # local node 00:04:22.673 01:46:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:22.673 01:46:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:22.673 01:46:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:22.673 01:46:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:22.673 01:46:56 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:22.673 01:46:56 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:22.673 01:46:56 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:22.673 01:46:56 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:22.673 01:46:56 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:22.673 01:46:56 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:22.673 01:46:56 -- setup/common.sh@18 -- # local node=0 00:04:22.673 01:46:56 -- setup/common.sh@19 -- # local var val 00:04:22.673 01:46:56 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.673 01:46:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.673 01:46:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:22.674 01:46:56 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:22.674 01:46:56 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.674 01:46:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21352948 kB' 'MemUsed: 11472908 kB' 'SwapCached: 0 kB' 'Active: 5866000 kB' 'Inactive: 3506048 kB' 'Active(anon): 5699572 kB' 'Inactive(anon): 0 kB' 'Active(file): 166428 kB' 'Inactive(file): 3506048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9021972 kB' 'Mapped: 55320 kB' 'AnonPages: 353204 kB' 'Shmem: 5349496 kB' 'KernelStack: 7080 kB' 'PageTables: 4428 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123968 kB' 'Slab: 402260 kB' 'SReclaimable: 123968 kB' 'SUnreclaim: 278292 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:56 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.674 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.674 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@33 -- # echo 0 00:04:22.675 01:46:57 -- setup/common.sh@33 -- # return 0 00:04:22.675 01:46:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:22.675 01:46:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:22.675 01:46:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:22.675 01:46:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:22.675 01:46:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:22.675 01:46:57 -- setup/common.sh@18 -- # local node=1 00:04:22.675 01:46:57 -- setup/common.sh@19 -- # local var val 00:04:22.675 01:46:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.675 01:46:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.675 01:46:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:22.675 01:46:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:22.675 01:46:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.675 01:46:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709800 kB' 'MemFree: 22723708 kB' 'MemUsed: 4986092 kB' 'SwapCached: 0 kB' 'Active: 2780440 kB' 'Inactive: 252760 kB' 'Active(anon): 2550124 kB' 'Inactive(anon): 0 kB' 'Active(file): 230316 kB' 'Inactive(file): 252760 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2940744 kB' 'Mapped: 115180 kB' 'AnonPages: 92516 kB' 'Shmem: 2457668 kB' 'KernelStack: 5672 kB' 'PageTables: 2964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 69804 kB' 'Slab: 268468 kB' 'SReclaimable: 69804 kB' 'SUnreclaim: 198664 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.675 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.675 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # continue 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.676 01:46:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.676 01:46:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.676 01:46:57 -- setup/common.sh@33 -- # echo 0 00:04:22.676 01:46:57 -- setup/common.sh@33 -- # return 0 00:04:22.676 01:46:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:22.676 01:46:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:22.676 01:46:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:22.676 01:46:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:22.676 01:46:57 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:22.676 node0=512 expecting 513 00:04:22.676 01:46:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:22.676 01:46:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:22.676 01:46:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:22.676 01:46:57 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:22.676 node1=513 expecting 512 00:04:22.676 01:46:57 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:22.676 00:04:22.676 real 0m1.571s 00:04:22.676 user 0m0.625s 00:04:22.676 sys 0m0.913s 00:04:22.676 01:46:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:22.676 01:46:57 -- common/autotest_common.sh@10 -- # set +x 00:04:22.676 ************************************ 00:04:22.676 END TEST odd_alloc 00:04:22.676 ************************************ 00:04:22.676 01:46:57 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:22.676 01:46:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:22.676 01:46:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:22.676 01:46:57 -- common/autotest_common.sh@10 -- # set +x 00:04:22.676 ************************************ 00:04:22.676 START TEST custom_alloc 00:04:22.676 ************************************ 00:04:22.676 01:46:57 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:22.676 01:46:57 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:22.676 01:46:57 -- setup/hugepages.sh@169 -- # local node 00:04:22.676 01:46:57 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:22.676 01:46:57 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:22.676 01:46:57 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:22.676 01:46:57 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:22.676 01:46:57 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:22.676 01:46:57 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:22.676 01:46:57 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:22.676 01:46:57 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:22.676 01:46:57 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:22.676 01:46:57 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:22.676 01:46:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:22.676 01:46:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:22.937 01:46:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:22.937 01:46:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:22.937 01:46:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:22.937 01:46:57 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:22.937 01:46:57 -- setup/hugepages.sh@83 -- # : 256 00:04:22.937 01:46:57 -- setup/hugepages.sh@84 -- # : 1 00:04:22.937 01:46:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:22.937 01:46:57 -- setup/hugepages.sh@83 -- # : 0 00:04:22.937 01:46:57 -- setup/hugepages.sh@84 -- # : 0 00:04:22.937 01:46:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:22.937 01:46:57 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:22.937 01:46:57 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:22.937 01:46:57 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:22.937 01:46:57 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:22.937 01:46:57 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:22.937 01:46:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:22.937 01:46:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:22.937 01:46:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:22.937 01:46:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:22.937 01:46:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:22.937 01:46:57 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:22.937 01:46:57 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:22.937 01:46:57 -- setup/hugepages.sh@78 -- # return 0 00:04:22.937 01:46:57 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:22.937 01:46:57 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:22.937 01:46:57 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:22.937 01:46:57 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:22.937 01:46:57 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:22.937 01:46:57 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:22.937 01:46:57 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:22.937 01:46:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:22.937 01:46:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:22.937 01:46:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:22.937 01:46:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:22.937 01:46:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:22.937 01:46:57 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:22.937 01:46:57 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:22.937 01:46:57 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:22.937 01:46:57 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:22.937 01:46:57 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:22.937 01:46:57 -- setup/hugepages.sh@78 -- # return 0 00:04:22.937 01:46:57 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:22.937 01:46:57 -- setup/hugepages.sh@187 -- # setup output 00:04:22.937 01:46:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:22.937 01:46:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:24.321 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:24.321 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:24.321 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:24.321 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:24.321 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:24.321 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:24.321 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:24.321 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:24.321 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:24.321 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:24.321 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:24.321 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:24.321 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:24.321 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:24.321 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:24.321 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:24.321 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:24.321 01:46:58 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:24.321 01:46:58 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:24.321 01:46:58 -- setup/hugepages.sh@89 -- # local node 00:04:24.321 01:46:58 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:24.321 01:46:58 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:24.321 01:46:58 -- setup/hugepages.sh@92 -- # local surp 00:04:24.321 01:46:58 -- setup/hugepages.sh@93 -- # local resv 00:04:24.321 01:46:58 -- setup/hugepages.sh@94 -- # local anon 00:04:24.321 01:46:58 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:24.321 01:46:58 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:24.321 01:46:58 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:24.321 01:46:58 -- setup/common.sh@18 -- # local node= 00:04:24.321 01:46:58 -- setup/common.sh@19 -- # local var val 00:04:24.321 01:46:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.321 01:46:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.321 01:46:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:24.321 01:46:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:24.321 01:46:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.321 01:46:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.321 01:46:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 43001432 kB' 'MemAvailable: 46760292 kB' 'Buffers: 3740 kB' 'Cached: 11959032 kB' 'SwapCached: 0 kB' 'Active: 8646720 kB' 'Inactive: 3758808 kB' 'Active(anon): 8249976 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446004 kB' 'Mapped: 170648 kB' 'Shmem: 7807220 kB' 'KReclaimable: 193772 kB' 'Slab: 670856 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477084 kB' 'KernelStack: 12752 kB' 'PageTables: 7336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 9310132 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.321 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.321 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.322 01:46:58 -- setup/common.sh@33 -- # echo 0 00:04:24.322 01:46:58 -- setup/common.sh@33 -- # return 0 00:04:24.322 01:46:58 -- setup/hugepages.sh@97 -- # anon=0 00:04:24.322 01:46:58 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:24.322 01:46:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:24.322 01:46:58 -- setup/common.sh@18 -- # local node= 00:04:24.322 01:46:58 -- setup/common.sh@19 -- # local var val 00:04:24.322 01:46:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.322 01:46:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.322 01:46:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:24.322 01:46:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:24.322 01:46:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.322 01:46:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 43005368 kB' 'MemAvailable: 46764228 kB' 'Buffers: 3740 kB' 'Cached: 11959032 kB' 'SwapCached: 0 kB' 'Active: 8647328 kB' 'Inactive: 3758808 kB' 'Active(anon): 8250584 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446616 kB' 'Mapped: 170648 kB' 'Shmem: 7807220 kB' 'KReclaimable: 193772 kB' 'Slab: 670816 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477044 kB' 'KernelStack: 12736 kB' 'PageTables: 7284 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 9310144 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.322 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.322 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.323 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.323 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.324 01:46:58 -- setup/common.sh@33 -- # echo 0 00:04:24.324 01:46:58 -- setup/common.sh@33 -- # return 0 00:04:24.324 01:46:58 -- setup/hugepages.sh@99 -- # surp=0 00:04:24.324 01:46:58 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:24.324 01:46:58 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:24.324 01:46:58 -- setup/common.sh@18 -- # local node= 00:04:24.324 01:46:58 -- setup/common.sh@19 -- # local var val 00:04:24.324 01:46:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.324 01:46:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.324 01:46:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:24.324 01:46:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:24.324 01:46:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.324 01:46:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 43005116 kB' 'MemAvailable: 46763976 kB' 'Buffers: 3740 kB' 'Cached: 11959048 kB' 'SwapCached: 0 kB' 'Active: 8646608 kB' 'Inactive: 3758808 kB' 'Active(anon): 8249864 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445888 kB' 'Mapped: 170584 kB' 'Shmem: 7807236 kB' 'KReclaimable: 193772 kB' 'Slab: 670816 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477044 kB' 'KernelStack: 12752 kB' 'PageTables: 7296 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 9310160 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.324 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.324 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.325 01:46:58 -- setup/common.sh@33 -- # echo 0 00:04:24.325 01:46:58 -- setup/common.sh@33 -- # return 0 00:04:24.325 01:46:58 -- setup/hugepages.sh@100 -- # resv=0 00:04:24.325 01:46:58 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:24.325 nr_hugepages=1536 00:04:24.325 01:46:58 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:24.325 resv_hugepages=0 00:04:24.325 01:46:58 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:24.325 surplus_hugepages=0 00:04:24.325 01:46:58 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:24.325 anon_hugepages=0 00:04:24.325 01:46:58 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:24.325 01:46:58 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:24.325 01:46:58 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:24.325 01:46:58 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:24.325 01:46:58 -- setup/common.sh@18 -- # local node= 00:04:24.325 01:46:58 -- setup/common.sh@19 -- # local var val 00:04:24.325 01:46:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.325 01:46:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.325 01:46:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:24.325 01:46:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:24.325 01:46:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.325 01:46:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 43008660 kB' 'MemAvailable: 46767520 kB' 'Buffers: 3740 kB' 'Cached: 11959064 kB' 'SwapCached: 0 kB' 'Active: 8646664 kB' 'Inactive: 3758808 kB' 'Active(anon): 8249920 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445904 kB' 'Mapped: 170508 kB' 'Shmem: 7807252 kB' 'KReclaimable: 193772 kB' 'Slab: 670780 kB' 'SReclaimable: 193772 kB' 'SUnreclaim: 477008 kB' 'KernelStack: 12736 kB' 'PageTables: 7216 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 9315916 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.325 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.325 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.326 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.326 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.327 01:46:58 -- setup/common.sh@33 -- # echo 1536 00:04:24.327 01:46:58 -- setup/common.sh@33 -- # return 0 00:04:24.327 01:46:58 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:24.327 01:46:58 -- setup/hugepages.sh@112 -- # get_nodes 00:04:24.327 01:46:58 -- setup/hugepages.sh@27 -- # local node 00:04:24.327 01:46:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:24.327 01:46:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:24.327 01:46:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:24.327 01:46:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:24.327 01:46:58 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:24.327 01:46:58 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:24.327 01:46:58 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:24.327 01:46:58 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:24.327 01:46:58 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:24.327 01:46:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:24.327 01:46:58 -- setup/common.sh@18 -- # local node=0 00:04:24.327 01:46:58 -- setup/common.sh@19 -- # local var val 00:04:24.327 01:46:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.327 01:46:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.327 01:46:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:24.327 01:46:58 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:24.327 01:46:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.327 01:46:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21341604 kB' 'MemUsed: 11484252 kB' 'SwapCached: 0 kB' 'Active: 5865728 kB' 'Inactive: 3506048 kB' 'Active(anon): 5699300 kB' 'Inactive(anon): 0 kB' 'Active(file): 166428 kB' 'Inactive(file): 3506048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9022064 kB' 'Mapped: 55320 kB' 'AnonPages: 352868 kB' 'Shmem: 5349588 kB' 'KernelStack: 7032 kB' 'PageTables: 4164 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123968 kB' 'Slab: 402408 kB' 'SReclaimable: 123968 kB' 'SUnreclaim: 278440 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.327 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.327 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@33 -- # echo 0 00:04:24.328 01:46:58 -- setup/common.sh@33 -- # return 0 00:04:24.328 01:46:58 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:24.328 01:46:58 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:24.328 01:46:58 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:24.328 01:46:58 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:24.328 01:46:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:24.328 01:46:58 -- setup/common.sh@18 -- # local node=1 00:04:24.328 01:46:58 -- setup/common.sh@19 -- # local var val 00:04:24.328 01:46:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.328 01:46:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.328 01:46:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:24.328 01:46:58 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:24.328 01:46:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.328 01:46:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709800 kB' 'MemFree: 21667888 kB' 'MemUsed: 6041912 kB' 'SwapCached: 0 kB' 'Active: 2780412 kB' 'Inactive: 252760 kB' 'Active(anon): 2550096 kB' 'Inactive(anon): 0 kB' 'Active(file): 230316 kB' 'Inactive(file): 252760 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2940752 kB' 'Mapped: 115204 kB' 'AnonPages: 92496 kB' 'Shmem: 2457676 kB' 'KernelStack: 5656 kB' 'PageTables: 2884 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 69804 kB' 'Slab: 268368 kB' 'SReclaimable: 69804 kB' 'SUnreclaim: 198564 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.328 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.328 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # continue 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.329 01:46:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.329 01:46:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.329 01:46:58 -- setup/common.sh@33 -- # echo 0 00:04:24.329 01:46:58 -- setup/common.sh@33 -- # return 0 00:04:24.329 01:46:58 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:24.329 01:46:58 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:24.329 01:46:58 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:24.329 01:46:58 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:24.329 01:46:58 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:24.329 node0=512 expecting 512 00:04:24.329 01:46:58 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:24.329 01:46:58 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:24.329 01:46:58 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:24.329 01:46:58 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:24.329 node1=1024 expecting 1024 00:04:24.329 01:46:58 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:24.329 00:04:24.329 real 0m1.602s 00:04:24.329 user 0m0.680s 00:04:24.329 sys 0m0.891s 00:04:24.329 01:46:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:24.329 01:46:58 -- common/autotest_common.sh@10 -- # set +x 00:04:24.329 ************************************ 00:04:24.329 END TEST custom_alloc 00:04:24.329 ************************************ 00:04:24.329 01:46:58 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:24.329 01:46:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:24.329 01:46:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:24.329 01:46:58 -- common/autotest_common.sh@10 -- # set +x 00:04:24.329 ************************************ 00:04:24.329 START TEST no_shrink_alloc 00:04:24.329 ************************************ 00:04:24.329 01:46:58 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:24.329 01:46:58 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:24.329 01:46:58 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:24.329 01:46:58 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:24.329 01:46:58 -- setup/hugepages.sh@51 -- # shift 00:04:24.329 01:46:58 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:24.329 01:46:58 -- setup/hugepages.sh@52 -- # local node_ids 00:04:24.329 01:46:58 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:24.329 01:46:58 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:24.329 01:46:58 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:24.329 01:46:58 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:24.329 01:46:58 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:24.329 01:46:58 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:24.329 01:46:58 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:24.329 01:46:58 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:24.329 01:46:58 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:24.329 01:46:58 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:24.329 01:46:58 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:24.329 01:46:58 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:24.329 01:46:58 -- setup/hugepages.sh@73 -- # return 0 00:04:24.329 01:46:58 -- setup/hugepages.sh@198 -- # setup output 00:04:24.329 01:46:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:24.329 01:46:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:25.705 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:25.705 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:25.705 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:25.705 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:25.705 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:25.705 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:25.705 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:25.705 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:25.705 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:25.705 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:25.705 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:25.705 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:25.705 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:25.705 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:25.705 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:25.705 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:25.705 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:25.968 01:47:00 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:25.968 01:47:00 -- setup/hugepages.sh@89 -- # local node 00:04:25.968 01:47:00 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:25.968 01:47:00 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:25.968 01:47:00 -- setup/hugepages.sh@92 -- # local surp 00:04:25.968 01:47:00 -- setup/hugepages.sh@93 -- # local resv 00:04:25.968 01:47:00 -- setup/hugepages.sh@94 -- # local anon 00:04:25.968 01:47:00 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:25.968 01:47:00 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:25.968 01:47:00 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:25.968 01:47:00 -- setup/common.sh@18 -- # local node= 00:04:25.968 01:47:00 -- setup/common.sh@19 -- # local var val 00:04:25.968 01:47:00 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.968 01:47:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.968 01:47:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.968 01:47:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.968 01:47:00 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.968 01:47:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44064252 kB' 'MemAvailable: 47823096 kB' 'Buffers: 3740 kB' 'Cached: 11959124 kB' 'SwapCached: 0 kB' 'Active: 8650232 kB' 'Inactive: 3758808 kB' 'Active(anon): 8253488 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449092 kB' 'Mapped: 170604 kB' 'Shmem: 7807312 kB' 'KReclaimable: 193740 kB' 'Slab: 670644 kB' 'SReclaimable: 193740 kB' 'SUnreclaim: 476904 kB' 'KernelStack: 13152 kB' 'PageTables: 8588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9313016 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198600 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.968 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.968 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.969 01:47:00 -- setup/common.sh@33 -- # echo 0 00:04:25.969 01:47:00 -- setup/common.sh@33 -- # return 0 00:04:25.969 01:47:00 -- setup/hugepages.sh@97 -- # anon=0 00:04:25.969 01:47:00 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:25.969 01:47:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:25.969 01:47:00 -- setup/common.sh@18 -- # local node= 00:04:25.969 01:47:00 -- setup/common.sh@19 -- # local var val 00:04:25.969 01:47:00 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.969 01:47:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.969 01:47:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.969 01:47:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.969 01:47:00 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.969 01:47:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44064368 kB' 'MemAvailable: 47823212 kB' 'Buffers: 3740 kB' 'Cached: 11959128 kB' 'SwapCached: 0 kB' 'Active: 8651332 kB' 'Inactive: 3758808 kB' 'Active(anon): 8254588 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450160 kB' 'Mapped: 170572 kB' 'Shmem: 7807316 kB' 'KReclaimable: 193740 kB' 'Slab: 670644 kB' 'SReclaimable: 193740 kB' 'SUnreclaim: 476904 kB' 'KernelStack: 13152 kB' 'PageTables: 9516 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9314424 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198600 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.969 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.969 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.970 01:47:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.970 01:47:00 -- setup/common.sh@33 -- # echo 0 00:04:25.970 01:47:00 -- setup/common.sh@33 -- # return 0 00:04:25.970 01:47:00 -- setup/hugepages.sh@99 -- # surp=0 00:04:25.970 01:47:00 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:25.970 01:47:00 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:25.970 01:47:00 -- setup/common.sh@18 -- # local node= 00:04:25.970 01:47:00 -- setup/common.sh@19 -- # local var val 00:04:25.970 01:47:00 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.970 01:47:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.970 01:47:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.970 01:47:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.970 01:47:00 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.970 01:47:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.970 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44072032 kB' 'MemAvailable: 47830876 kB' 'Buffers: 3740 kB' 'Cached: 11959140 kB' 'SwapCached: 0 kB' 'Active: 8648392 kB' 'Inactive: 3758808 kB' 'Active(anon): 8251648 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447552 kB' 'Mapped: 170520 kB' 'Shmem: 7807328 kB' 'KReclaimable: 193740 kB' 'Slab: 670652 kB' 'SReclaimable: 193740 kB' 'SUnreclaim: 476912 kB' 'KernelStack: 12784 kB' 'PageTables: 7460 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9310388 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.971 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.971 01:47:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.972 01:47:00 -- setup/common.sh@33 -- # echo 0 00:04:25.972 01:47:00 -- setup/common.sh@33 -- # return 0 00:04:25.972 01:47:00 -- setup/hugepages.sh@100 -- # resv=0 00:04:25.972 01:47:00 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:25.972 nr_hugepages=1024 00:04:25.972 01:47:00 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:25.972 resv_hugepages=0 00:04:25.972 01:47:00 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:25.972 surplus_hugepages=0 00:04:25.972 01:47:00 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:25.972 anon_hugepages=0 00:04:25.972 01:47:00 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:25.972 01:47:00 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:25.972 01:47:00 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:25.972 01:47:00 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:25.972 01:47:00 -- setup/common.sh@18 -- # local node= 00:04:25.972 01:47:00 -- setup/common.sh@19 -- # local var val 00:04:25.972 01:47:00 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.972 01:47:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.972 01:47:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.972 01:47:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.972 01:47:00 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.972 01:47:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44072952 kB' 'MemAvailable: 47831796 kB' 'Buffers: 3740 kB' 'Cached: 11959156 kB' 'SwapCached: 0 kB' 'Active: 8647752 kB' 'Inactive: 3758808 kB' 'Active(anon): 8251008 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446944 kB' 'Mapped: 170520 kB' 'Shmem: 7807344 kB' 'KReclaimable: 193740 kB' 'Slab: 670700 kB' 'SReclaimable: 193740 kB' 'SUnreclaim: 476960 kB' 'KernelStack: 12768 kB' 'PageTables: 7220 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9310404 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.972 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.972 01:47:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.973 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.973 01:47:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.973 01:47:00 -- setup/common.sh@33 -- # echo 1024 00:04:25.973 01:47:00 -- setup/common.sh@33 -- # return 0 00:04:25.973 01:47:00 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:25.973 01:47:00 -- setup/hugepages.sh@112 -- # get_nodes 00:04:25.973 01:47:00 -- setup/hugepages.sh@27 -- # local node 00:04:25.973 01:47:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:25.973 01:47:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:25.973 01:47:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:25.973 01:47:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:25.973 01:47:00 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:25.973 01:47:00 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:25.974 01:47:00 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:25.974 01:47:00 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:25.974 01:47:00 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:25.974 01:47:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:25.974 01:47:00 -- setup/common.sh@18 -- # local node=0 00:04:25.974 01:47:00 -- setup/common.sh@19 -- # local var val 00:04:25.974 01:47:00 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.974 01:47:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.974 01:47:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:25.974 01:47:00 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:25.974 01:47:00 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.974 01:47:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20298760 kB' 'MemUsed: 12527096 kB' 'SwapCached: 0 kB' 'Active: 5866580 kB' 'Inactive: 3506048 kB' 'Active(anon): 5700152 kB' 'Inactive(anon): 0 kB' 'Active(file): 166428 kB' 'Inactive(file): 3506048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9022148 kB' 'Mapped: 55320 kB' 'AnonPages: 353660 kB' 'Shmem: 5349672 kB' 'KernelStack: 7112 kB' 'PageTables: 4384 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123936 kB' 'Slab: 402332 kB' 'SReclaimable: 123936 kB' 'SUnreclaim: 278396 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.974 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.974 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.975 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.975 01:47:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.975 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.975 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.975 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.975 01:47:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.975 01:47:00 -- setup/common.sh@32 -- # continue 00:04:25.975 01:47:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.975 01:47:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.975 01:47:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.975 01:47:00 -- setup/common.sh@33 -- # echo 0 00:04:25.975 01:47:00 -- setup/common.sh@33 -- # return 0 00:04:25.975 01:47:00 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:25.975 01:47:00 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:25.975 01:47:00 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:25.975 01:47:00 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:25.975 01:47:00 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:25.975 node0=1024 expecting 1024 00:04:25.975 01:47:00 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:25.975 01:47:00 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:25.975 01:47:00 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:25.975 01:47:00 -- setup/hugepages.sh@202 -- # setup output 00:04:25.975 01:47:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:25.975 01:47:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:27.354 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:27.354 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:27.354 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:27.354 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:27.354 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:27.354 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:27.354 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:27.354 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:27.354 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:27.354 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:27.354 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:27.354 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:27.354 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:27.354 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:27.354 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:27.354 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:27.354 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:27.354 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:27.354 01:47:01 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:27.354 01:47:01 -- setup/hugepages.sh@89 -- # local node 00:04:27.354 01:47:01 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:27.354 01:47:01 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:27.354 01:47:01 -- setup/hugepages.sh@92 -- # local surp 00:04:27.354 01:47:01 -- setup/hugepages.sh@93 -- # local resv 00:04:27.354 01:47:01 -- setup/hugepages.sh@94 -- # local anon 00:04:27.354 01:47:01 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:27.354 01:47:01 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:27.354 01:47:01 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:27.354 01:47:01 -- setup/common.sh@18 -- # local node= 00:04:27.354 01:47:01 -- setup/common.sh@19 -- # local var val 00:04:27.354 01:47:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.354 01:47:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.354 01:47:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.354 01:47:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.354 01:47:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.354 01:47:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.354 01:47:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44060904 kB' 'MemAvailable: 47819748 kB' 'Buffers: 3740 kB' 'Cached: 11959204 kB' 'SwapCached: 0 kB' 'Active: 8647144 kB' 'Inactive: 3758808 kB' 'Active(anon): 8250400 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446176 kB' 'Mapped: 170552 kB' 'Shmem: 7807392 kB' 'KReclaimable: 193740 kB' 'Slab: 670592 kB' 'SReclaimable: 193740 kB' 'SUnreclaim: 476852 kB' 'KernelStack: 12784 kB' 'PageTables: 7284 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9310568 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.354 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.354 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.355 01:47:01 -- setup/common.sh@33 -- # echo 0 00:04:27.355 01:47:01 -- setup/common.sh@33 -- # return 0 00:04:27.355 01:47:01 -- setup/hugepages.sh@97 -- # anon=0 00:04:27.355 01:47:01 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:27.355 01:47:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:27.355 01:47:01 -- setup/common.sh@18 -- # local node= 00:04:27.355 01:47:01 -- setup/common.sh@19 -- # local var val 00:04:27.355 01:47:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.355 01:47:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.355 01:47:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.355 01:47:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.355 01:47:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.355 01:47:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.355 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.355 01:47:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44061164 kB' 'MemAvailable: 47820008 kB' 'Buffers: 3740 kB' 'Cached: 11959208 kB' 'SwapCached: 0 kB' 'Active: 8647412 kB' 'Inactive: 3758808 kB' 'Active(anon): 8250668 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446464 kB' 'Mapped: 170552 kB' 'Shmem: 7807396 kB' 'KReclaimable: 193740 kB' 'Slab: 670624 kB' 'SReclaimable: 193740 kB' 'SUnreclaim: 476884 kB' 'KernelStack: 12768 kB' 'PageTables: 7252 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9310580 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.355 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.356 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.356 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.357 01:47:01 -- setup/common.sh@33 -- # echo 0 00:04:27.357 01:47:01 -- setup/common.sh@33 -- # return 0 00:04:27.357 01:47:01 -- setup/hugepages.sh@99 -- # surp=0 00:04:27.357 01:47:01 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:27.357 01:47:01 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:27.357 01:47:01 -- setup/common.sh@18 -- # local node= 00:04:27.357 01:47:01 -- setup/common.sh@19 -- # local var val 00:04:27.357 01:47:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.357 01:47:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.357 01:47:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.357 01:47:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.357 01:47:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.357 01:47:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44061164 kB' 'MemAvailable: 47820008 kB' 'Buffers: 3740 kB' 'Cached: 11959212 kB' 'SwapCached: 0 kB' 'Active: 8647280 kB' 'Inactive: 3758808 kB' 'Active(anon): 8250536 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446316 kB' 'Mapped: 170524 kB' 'Shmem: 7807400 kB' 'KReclaimable: 193740 kB' 'Slab: 670624 kB' 'SReclaimable: 193740 kB' 'SUnreclaim: 476884 kB' 'KernelStack: 12800 kB' 'PageTables: 7340 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9310596 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.357 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.357 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.358 01:47:01 -- setup/common.sh@33 -- # echo 0 00:04:27.358 01:47:01 -- setup/common.sh@33 -- # return 0 00:04:27.358 01:47:01 -- setup/hugepages.sh@100 -- # resv=0 00:04:27.358 01:47:01 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:27.358 nr_hugepages=1024 00:04:27.358 01:47:01 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:27.358 resv_hugepages=0 00:04:27.358 01:47:01 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:27.358 surplus_hugepages=0 00:04:27.358 01:47:01 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:27.358 anon_hugepages=0 00:04:27.358 01:47:01 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:27.358 01:47:01 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:27.358 01:47:01 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:27.358 01:47:01 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:27.358 01:47:01 -- setup/common.sh@18 -- # local node= 00:04:27.358 01:47:01 -- setup/common.sh@19 -- # local var val 00:04:27.358 01:47:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.358 01:47:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.358 01:47:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.358 01:47:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.358 01:47:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.358 01:47:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.358 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.358 01:47:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44061164 kB' 'MemAvailable: 47820008 kB' 'Buffers: 3740 kB' 'Cached: 11959224 kB' 'SwapCached: 0 kB' 'Active: 8646736 kB' 'Inactive: 3758808 kB' 'Active(anon): 8249992 kB' 'Inactive(anon): 0 kB' 'Active(file): 396744 kB' 'Inactive(file): 3758808 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445720 kB' 'Mapped: 170524 kB' 'Shmem: 7807412 kB' 'KReclaimable: 193740 kB' 'Slab: 670624 kB' 'SReclaimable: 193740 kB' 'SUnreclaim: 476884 kB' 'KernelStack: 12816 kB' 'PageTables: 7396 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 9310612 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34176 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 10917888 kB' 'DirectMap1G: 57671680 kB' 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.358 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.359 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.359 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.360 01:47:01 -- setup/common.sh@33 -- # echo 1024 00:04:27.360 01:47:01 -- setup/common.sh@33 -- # return 0 00:04:27.360 01:47:01 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:27.360 01:47:01 -- setup/hugepages.sh@112 -- # get_nodes 00:04:27.360 01:47:01 -- setup/hugepages.sh@27 -- # local node 00:04:27.360 01:47:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:27.360 01:47:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:27.360 01:47:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:27.360 01:47:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:27.360 01:47:01 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:27.360 01:47:01 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:27.360 01:47:01 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:27.360 01:47:01 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:27.360 01:47:01 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:27.360 01:47:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:27.360 01:47:01 -- setup/common.sh@18 -- # local node=0 00:04:27.360 01:47:01 -- setup/common.sh@19 -- # local var val 00:04:27.360 01:47:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.360 01:47:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.360 01:47:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:27.360 01:47:01 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:27.360 01:47:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.360 01:47:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20279364 kB' 'MemUsed: 12546492 kB' 'SwapCached: 0 kB' 'Active: 5866628 kB' 'Inactive: 3506048 kB' 'Active(anon): 5700200 kB' 'Inactive(anon): 0 kB' 'Active(file): 166428 kB' 'Inactive(file): 3506048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9022224 kB' 'Mapped: 55320 kB' 'AnonPages: 353556 kB' 'Shmem: 5349748 kB' 'KernelStack: 7128 kB' 'PageTables: 4476 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123936 kB' 'Slab: 402288 kB' 'SReclaimable: 123936 kB' 'SUnreclaim: 278352 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.360 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.360 01:47:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.361 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.361 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # continue 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.620 01:47:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.620 01:47:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.620 01:47:01 -- setup/common.sh@33 -- # echo 0 00:04:27.620 01:47:01 -- setup/common.sh@33 -- # return 0 00:04:27.620 01:47:01 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:27.620 01:47:01 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:27.620 01:47:01 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:27.620 01:47:01 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:27.620 01:47:01 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:27.620 node0=1024 expecting 1024 00:04:27.620 01:47:01 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:27.620 00:04:27.620 real 0m3.071s 00:04:27.620 user 0m1.218s 00:04:27.620 sys 0m1.786s 00:04:27.620 01:47:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:27.620 01:47:01 -- common/autotest_common.sh@10 -- # set +x 00:04:27.620 ************************************ 00:04:27.620 END TEST no_shrink_alloc 00:04:27.620 ************************************ 00:04:27.620 01:47:01 -- setup/hugepages.sh@217 -- # clear_hp 00:04:27.620 01:47:01 -- setup/hugepages.sh@37 -- # local node hp 00:04:27.620 01:47:01 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:27.620 01:47:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:27.620 01:47:01 -- setup/hugepages.sh@41 -- # echo 0 00:04:27.620 01:47:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:27.620 01:47:01 -- setup/hugepages.sh@41 -- # echo 0 00:04:27.620 01:47:01 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:27.620 01:47:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:27.620 01:47:01 -- setup/hugepages.sh@41 -- # echo 0 00:04:27.620 01:47:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:27.620 01:47:01 -- setup/hugepages.sh@41 -- # echo 0 00:04:27.620 01:47:01 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:27.620 01:47:01 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:27.620 00:04:27.620 real 0m12.096s 00:04:27.620 user 0m4.654s 00:04:27.620 sys 0m6.421s 00:04:27.620 01:47:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:27.620 01:47:01 -- common/autotest_common.sh@10 -- # set +x 00:04:27.620 ************************************ 00:04:27.620 END TEST hugepages 00:04:27.620 ************************************ 00:04:27.620 01:47:01 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:27.620 01:47:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:27.620 01:47:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:27.620 01:47:01 -- common/autotest_common.sh@10 -- # set +x 00:04:27.620 ************************************ 00:04:27.620 START TEST driver 00:04:27.620 ************************************ 00:04:27.620 01:47:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:27.620 * Looking for test storage... 00:04:27.620 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:27.620 01:47:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:27.620 01:47:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:27.620 01:47:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:27.620 01:47:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:27.620 01:47:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:27.620 01:47:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:27.620 01:47:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:27.620 01:47:01 -- scripts/common.sh@335 -- # IFS=.-: 00:04:27.620 01:47:01 -- scripts/common.sh@335 -- # read -ra ver1 00:04:27.620 01:47:01 -- scripts/common.sh@336 -- # IFS=.-: 00:04:27.620 01:47:01 -- scripts/common.sh@336 -- # read -ra ver2 00:04:27.620 01:47:01 -- scripts/common.sh@337 -- # local 'op=<' 00:04:27.620 01:47:01 -- scripts/common.sh@339 -- # ver1_l=2 00:04:27.620 01:47:01 -- scripts/common.sh@340 -- # ver2_l=1 00:04:27.620 01:47:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:27.620 01:47:01 -- scripts/common.sh@343 -- # case "$op" in 00:04:27.620 01:47:01 -- scripts/common.sh@344 -- # : 1 00:04:27.620 01:47:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:27.620 01:47:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:27.620 01:47:01 -- scripts/common.sh@364 -- # decimal 1 00:04:27.620 01:47:01 -- scripts/common.sh@352 -- # local d=1 00:04:27.620 01:47:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:27.620 01:47:01 -- scripts/common.sh@354 -- # echo 1 00:04:27.620 01:47:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:27.620 01:47:01 -- scripts/common.sh@365 -- # decimal 2 00:04:27.620 01:47:01 -- scripts/common.sh@352 -- # local d=2 00:04:27.620 01:47:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:27.620 01:47:01 -- scripts/common.sh@354 -- # echo 2 00:04:27.620 01:47:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:27.620 01:47:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:27.620 01:47:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:27.620 01:47:01 -- scripts/common.sh@367 -- # return 0 00:04:27.620 01:47:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:27.620 01:47:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:27.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.620 --rc genhtml_branch_coverage=1 00:04:27.620 --rc genhtml_function_coverage=1 00:04:27.620 --rc genhtml_legend=1 00:04:27.620 --rc geninfo_all_blocks=1 00:04:27.620 --rc geninfo_unexecuted_blocks=1 00:04:27.620 00:04:27.620 ' 00:04:27.620 01:47:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:27.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.620 --rc genhtml_branch_coverage=1 00:04:27.620 --rc genhtml_function_coverage=1 00:04:27.620 --rc genhtml_legend=1 00:04:27.620 --rc geninfo_all_blocks=1 00:04:27.620 --rc geninfo_unexecuted_blocks=1 00:04:27.620 00:04:27.620 ' 00:04:27.620 01:47:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:27.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.620 --rc genhtml_branch_coverage=1 00:04:27.620 --rc genhtml_function_coverage=1 00:04:27.620 --rc genhtml_legend=1 00:04:27.620 --rc geninfo_all_blocks=1 00:04:27.620 --rc geninfo_unexecuted_blocks=1 00:04:27.620 00:04:27.620 ' 00:04:27.620 01:47:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:27.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.620 --rc genhtml_branch_coverage=1 00:04:27.620 --rc genhtml_function_coverage=1 00:04:27.620 --rc genhtml_legend=1 00:04:27.620 --rc geninfo_all_blocks=1 00:04:27.620 --rc geninfo_unexecuted_blocks=1 00:04:27.620 00:04:27.620 ' 00:04:27.620 01:47:01 -- setup/driver.sh@68 -- # setup reset 00:04:27.620 01:47:01 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:27.620 01:47:01 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:30.155 01:47:04 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:30.155 01:47:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.155 01:47:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.155 01:47:04 -- common/autotest_common.sh@10 -- # set +x 00:04:30.155 ************************************ 00:04:30.155 START TEST guess_driver 00:04:30.155 ************************************ 00:04:30.155 01:47:04 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:30.155 01:47:04 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:30.155 01:47:04 -- setup/driver.sh@47 -- # local fail=0 00:04:30.155 01:47:04 -- setup/driver.sh@49 -- # pick_driver 00:04:30.155 01:47:04 -- setup/driver.sh@36 -- # vfio 00:04:30.155 01:47:04 -- setup/driver.sh@21 -- # local iommu_grups 00:04:30.155 01:47:04 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:30.155 01:47:04 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:30.155 01:47:04 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:30.414 01:47:04 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:30.414 01:47:04 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:30.414 01:47:04 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:30.414 01:47:04 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:30.414 01:47:04 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:30.414 01:47:04 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:30.414 01:47:04 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:30.414 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:30.414 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:30.414 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:30.414 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:30.414 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:30.414 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:30.414 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:30.414 01:47:04 -- setup/driver.sh@30 -- # return 0 00:04:30.414 01:47:04 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:30.414 01:47:04 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:30.414 01:47:04 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:30.414 01:47:04 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:30.414 Looking for driver=vfio-pci 00:04:30.414 01:47:04 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:30.414 01:47:04 -- setup/driver.sh@45 -- # setup output config 00:04:30.414 01:47:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:30.414 01:47:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.794 01:47:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.794 01:47:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.794 01:47:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:32.363 01:47:06 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:32.363 01:47:06 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:32.363 01:47:06 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:32.623 01:47:06 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:32.623 01:47:06 -- setup/driver.sh@65 -- # setup reset 00:04:32.623 01:47:06 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:32.623 01:47:06 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:35.164 00:04:35.164 real 0m4.965s 00:04:35.164 user 0m1.139s 00:04:35.164 sys 0m1.966s 00:04:35.164 01:47:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:35.164 01:47:09 -- common/autotest_common.sh@10 -- # set +x 00:04:35.164 ************************************ 00:04:35.164 END TEST guess_driver 00:04:35.164 ************************************ 00:04:35.164 00:04:35.164 real 0m7.717s 00:04:35.164 user 0m1.830s 00:04:35.164 sys 0m3.061s 00:04:35.164 01:47:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:35.164 01:47:09 -- common/autotest_common.sh@10 -- # set +x 00:04:35.164 ************************************ 00:04:35.164 END TEST driver 00:04:35.164 ************************************ 00:04:35.164 01:47:09 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:35.422 01:47:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.422 01:47:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.422 01:47:09 -- common/autotest_common.sh@10 -- # set +x 00:04:35.422 ************************************ 00:04:35.422 START TEST devices 00:04:35.422 ************************************ 00:04:35.422 01:47:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:35.422 * Looking for test storage... 00:04:35.422 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:35.422 01:47:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:35.422 01:47:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:35.422 01:47:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:35.422 01:47:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:35.422 01:47:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:35.422 01:47:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:35.422 01:47:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:35.422 01:47:09 -- scripts/common.sh@335 -- # IFS=.-: 00:04:35.422 01:47:09 -- scripts/common.sh@335 -- # read -ra ver1 00:04:35.422 01:47:09 -- scripts/common.sh@336 -- # IFS=.-: 00:04:35.422 01:47:09 -- scripts/common.sh@336 -- # read -ra ver2 00:04:35.422 01:47:09 -- scripts/common.sh@337 -- # local 'op=<' 00:04:35.422 01:47:09 -- scripts/common.sh@339 -- # ver1_l=2 00:04:35.422 01:47:09 -- scripts/common.sh@340 -- # ver2_l=1 00:04:35.422 01:47:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:35.422 01:47:09 -- scripts/common.sh@343 -- # case "$op" in 00:04:35.422 01:47:09 -- scripts/common.sh@344 -- # : 1 00:04:35.422 01:47:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:35.422 01:47:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:35.422 01:47:09 -- scripts/common.sh@364 -- # decimal 1 00:04:35.422 01:47:09 -- scripts/common.sh@352 -- # local d=1 00:04:35.422 01:47:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:35.422 01:47:09 -- scripts/common.sh@354 -- # echo 1 00:04:35.422 01:47:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:35.422 01:47:09 -- scripts/common.sh@365 -- # decimal 2 00:04:35.423 01:47:09 -- scripts/common.sh@352 -- # local d=2 00:04:35.423 01:47:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:35.423 01:47:09 -- scripts/common.sh@354 -- # echo 2 00:04:35.423 01:47:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:35.423 01:47:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:35.423 01:47:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:35.423 01:47:09 -- scripts/common.sh@367 -- # return 0 00:04:35.423 01:47:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:35.423 01:47:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:35.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.423 --rc genhtml_branch_coverage=1 00:04:35.423 --rc genhtml_function_coverage=1 00:04:35.423 --rc genhtml_legend=1 00:04:35.423 --rc geninfo_all_blocks=1 00:04:35.423 --rc geninfo_unexecuted_blocks=1 00:04:35.423 00:04:35.423 ' 00:04:35.423 01:47:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:35.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.423 --rc genhtml_branch_coverage=1 00:04:35.423 --rc genhtml_function_coverage=1 00:04:35.423 --rc genhtml_legend=1 00:04:35.423 --rc geninfo_all_blocks=1 00:04:35.423 --rc geninfo_unexecuted_blocks=1 00:04:35.423 00:04:35.423 ' 00:04:35.423 01:47:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:35.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.423 --rc genhtml_branch_coverage=1 00:04:35.423 --rc genhtml_function_coverage=1 00:04:35.423 --rc genhtml_legend=1 00:04:35.423 --rc geninfo_all_blocks=1 00:04:35.423 --rc geninfo_unexecuted_blocks=1 00:04:35.423 00:04:35.423 ' 00:04:35.423 01:47:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:35.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.423 --rc genhtml_branch_coverage=1 00:04:35.423 --rc genhtml_function_coverage=1 00:04:35.423 --rc genhtml_legend=1 00:04:35.423 --rc geninfo_all_blocks=1 00:04:35.423 --rc geninfo_unexecuted_blocks=1 00:04:35.423 00:04:35.423 ' 00:04:35.423 01:47:09 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:35.423 01:47:09 -- setup/devices.sh@192 -- # setup reset 00:04:35.423 01:47:09 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:35.423 01:47:09 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:37.331 01:47:11 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:37.332 01:47:11 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:37.332 01:47:11 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:37.332 01:47:11 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:37.332 01:47:11 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:37.332 01:47:11 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:37.332 01:47:11 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:37.332 01:47:11 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:37.332 01:47:11 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:37.332 01:47:11 -- setup/devices.sh@196 -- # blocks=() 00:04:37.332 01:47:11 -- setup/devices.sh@196 -- # declare -a blocks 00:04:37.332 01:47:11 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:37.332 01:47:11 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:37.332 01:47:11 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:37.332 01:47:11 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:37.332 01:47:11 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:37.332 01:47:11 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:37.332 01:47:11 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:04:37.332 01:47:11 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:37.332 01:47:11 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:37.332 01:47:11 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:04:37.332 01:47:11 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:37.332 No valid GPT data, bailing 00:04:37.332 01:47:11 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:37.332 01:47:11 -- scripts/common.sh@393 -- # pt= 00:04:37.332 01:47:11 -- scripts/common.sh@394 -- # return 1 00:04:37.332 01:47:11 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:37.332 01:47:11 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:37.332 01:47:11 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:37.332 01:47:11 -- setup/common.sh@80 -- # echo 1000204886016 00:04:37.332 01:47:11 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:04:37.332 01:47:11 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:37.332 01:47:11 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:04:37.332 01:47:11 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:37.332 01:47:11 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:37.332 01:47:11 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:37.332 01:47:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.332 01:47:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.332 01:47:11 -- common/autotest_common.sh@10 -- # set +x 00:04:37.332 ************************************ 00:04:37.332 START TEST nvme_mount 00:04:37.332 ************************************ 00:04:37.332 01:47:11 -- common/autotest_common.sh@1114 -- # nvme_mount 00:04:37.332 01:47:11 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:37.332 01:47:11 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:37.332 01:47:11 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:37.332 01:47:11 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:37.332 01:47:11 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:37.332 01:47:11 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:37.332 01:47:11 -- setup/common.sh@40 -- # local part_no=1 00:04:37.332 01:47:11 -- setup/common.sh@41 -- # local size=1073741824 00:04:37.332 01:47:11 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:37.332 01:47:11 -- setup/common.sh@44 -- # parts=() 00:04:37.332 01:47:11 -- setup/common.sh@44 -- # local parts 00:04:37.332 01:47:11 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:37.332 01:47:11 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:37.332 01:47:11 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:37.332 01:47:11 -- setup/common.sh@46 -- # (( part++ )) 00:04:37.332 01:47:11 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:37.332 01:47:11 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:37.332 01:47:11 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:37.332 01:47:11 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:38.270 Creating new GPT entries in memory. 00:04:38.270 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:38.270 other utilities. 00:04:38.270 01:47:12 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:38.270 01:47:12 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:38.270 01:47:12 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:38.270 01:47:12 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:38.270 01:47:12 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:39.213 Creating new GPT entries in memory. 00:04:39.213 The operation has completed successfully. 00:04:39.213 01:47:13 -- setup/common.sh@57 -- # (( part++ )) 00:04:39.213 01:47:13 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:39.213 01:47:13 -- setup/common.sh@62 -- # wait 1069098 00:04:39.213 01:47:13 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.213 01:47:13 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:04:39.213 01:47:13 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.213 01:47:13 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:04:39.213 01:47:13 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:04:39.213 01:47:13 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.213 01:47:13 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:39.213 01:47:13 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:39.213 01:47:13 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:04:39.213 01:47:13 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.213 01:47:13 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:39.213 01:47:13 -- setup/devices.sh@53 -- # local found=0 00:04:39.213 01:47:13 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:39.214 01:47:13 -- setup/devices.sh@56 -- # : 00:04:39.214 01:47:13 -- setup/devices.sh@59 -- # local pci status 00:04:39.214 01:47:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.214 01:47:13 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:39.214 01:47:13 -- setup/devices.sh@47 -- # setup output config 00:04:39.214 01:47:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:39.214 01:47:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:04:40.593 01:47:14 -- setup/devices.sh@63 -- # found=1 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.593 01:47:14 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:40.593 01:47:14 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:40.593 01:47:14 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.593 01:47:14 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:40.593 01:47:14 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:40.593 01:47:14 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:40.593 01:47:14 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.593 01:47:14 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.593 01:47:14 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:40.593 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:40.593 01:47:14 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:40.593 01:47:14 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:40.852 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:40.852 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:40.852 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:40.852 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:40.852 01:47:15 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:04:40.852 01:47:15 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:04:40.852 01:47:15 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.852 01:47:15 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:04:40.852 01:47:15 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:04:40.852 01:47:15 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.852 01:47:15 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:40.852 01:47:15 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:40.852 01:47:15 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:04:40.852 01:47:15 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.852 01:47:15 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:40.852 01:47:15 -- setup/devices.sh@53 -- # local found=0 00:04:40.852 01:47:15 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:40.852 01:47:15 -- setup/devices.sh@56 -- # : 00:04:40.852 01:47:15 -- setup/devices.sh@59 -- # local pci status 00:04:40.852 01:47:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.852 01:47:15 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:40.852 01:47:15 -- setup/devices.sh@47 -- # setup output config 00:04:40.852 01:47:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:40.852 01:47:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:42.231 01:47:16 -- setup/devices.sh@63 -- # found=1 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:42.231 01:47:16 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:42.231 01:47:16 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:42.231 01:47:16 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:42.231 01:47:16 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:42.231 01:47:16 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:42.231 01:47:16 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:04:42.231 01:47:16 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:42.231 01:47:16 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:42.231 01:47:16 -- setup/devices.sh@50 -- # local mount_point= 00:04:42.231 01:47:16 -- setup/devices.sh@51 -- # local test_file= 00:04:42.231 01:47:16 -- setup/devices.sh@53 -- # local found=0 00:04:42.231 01:47:16 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:42.231 01:47:16 -- setup/devices.sh@59 -- # local pci status 00:04:42.231 01:47:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.231 01:47:16 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:42.231 01:47:16 -- setup/devices.sh@47 -- # setup output config 00:04:42.231 01:47:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:42.231 01:47:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:43.606 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.606 01:47:17 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:04:43.606 01:47:17 -- setup/devices.sh@63 -- # found=1 00:04:43.606 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.606 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.606 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.606 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.606 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.606 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.606 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.606 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.606 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.606 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.606 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.606 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.606 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.606 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.606 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.606 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.606 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.606 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.606 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.606 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.607 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.607 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.607 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.607 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.607 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.607 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.607 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.607 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.607 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.607 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.607 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.607 01:47:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.607 01:47:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.607 01:47:18 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:43.607 01:47:18 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:43.607 01:47:18 -- setup/devices.sh@68 -- # return 0 00:04:43.607 01:47:18 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:43.607 01:47:18 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:43.607 01:47:18 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:43.607 01:47:18 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:43.607 01:47:18 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:43.865 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:43.865 00:04:43.865 real 0m6.685s 00:04:43.865 user 0m1.570s 00:04:43.865 sys 0m2.722s 00:04:43.865 01:47:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.865 01:47:18 -- common/autotest_common.sh@10 -- # set +x 00:04:43.865 ************************************ 00:04:43.865 END TEST nvme_mount 00:04:43.865 ************************************ 00:04:43.865 01:47:18 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:43.865 01:47:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.865 01:47:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.865 01:47:18 -- common/autotest_common.sh@10 -- # set +x 00:04:43.865 ************************************ 00:04:43.865 START TEST dm_mount 00:04:43.865 ************************************ 00:04:43.865 01:47:18 -- common/autotest_common.sh@1114 -- # dm_mount 00:04:43.865 01:47:18 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:43.865 01:47:18 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:43.865 01:47:18 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:43.865 01:47:18 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:43.865 01:47:18 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:43.865 01:47:18 -- setup/common.sh@40 -- # local part_no=2 00:04:43.865 01:47:18 -- setup/common.sh@41 -- # local size=1073741824 00:04:43.865 01:47:18 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:43.865 01:47:18 -- setup/common.sh@44 -- # parts=() 00:04:43.865 01:47:18 -- setup/common.sh@44 -- # local parts 00:04:43.865 01:47:18 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:43.865 01:47:18 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:43.865 01:47:18 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:43.865 01:47:18 -- setup/common.sh@46 -- # (( part++ )) 00:04:43.865 01:47:18 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:43.865 01:47:18 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:43.865 01:47:18 -- setup/common.sh@46 -- # (( part++ )) 00:04:43.865 01:47:18 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:43.865 01:47:18 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:43.865 01:47:18 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:43.865 01:47:18 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:44.805 Creating new GPT entries in memory. 00:04:44.805 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:44.805 other utilities. 00:04:44.805 01:47:19 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:44.805 01:47:19 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:44.805 01:47:19 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:44.805 01:47:19 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:44.805 01:47:19 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:45.744 Creating new GPT entries in memory. 00:04:45.744 The operation has completed successfully. 00:04:45.744 01:47:20 -- setup/common.sh@57 -- # (( part++ )) 00:04:45.744 01:47:20 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:45.744 01:47:20 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:45.744 01:47:20 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:45.744 01:47:20 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:04:47.125 The operation has completed successfully. 00:04:47.125 01:47:21 -- setup/common.sh@57 -- # (( part++ )) 00:04:47.125 01:47:21 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:47.125 01:47:21 -- setup/common.sh@62 -- # wait 1071566 00:04:47.125 01:47:21 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:04:47.125 01:47:21 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:47.125 01:47:21 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:47.125 01:47:21 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:04:47.125 01:47:21 -- setup/devices.sh@160 -- # for t in {1..5} 00:04:47.125 01:47:21 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:47.125 01:47:21 -- setup/devices.sh@161 -- # break 00:04:47.125 01:47:21 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:47.125 01:47:21 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:04:47.125 01:47:21 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:04:47.125 01:47:21 -- setup/devices.sh@166 -- # dm=dm-0 00:04:47.125 01:47:21 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:04:47.125 01:47:21 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:04:47.125 01:47:21 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:47.125 01:47:21 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:04:47.125 01:47:21 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:47.125 01:47:21 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:47.125 01:47:21 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:04:47.125 01:47:21 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:47.125 01:47:21 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:47.125 01:47:21 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:47.125 01:47:21 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:04:47.125 01:47:21 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:47.125 01:47:21 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:47.125 01:47:21 -- setup/devices.sh@53 -- # local found=0 00:04:47.125 01:47:21 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:47.125 01:47:21 -- setup/devices.sh@56 -- # : 00:04:47.125 01:47:21 -- setup/devices.sh@59 -- # local pci status 00:04:47.125 01:47:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.125 01:47:21 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:47.125 01:47:21 -- setup/devices.sh@47 -- # setup output config 00:04:47.125 01:47:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:47.125 01:47:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:48.061 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.061 01:47:22 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:04:48.061 01:47:22 -- setup/devices.sh@63 -- # found=1 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.062 01:47:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.062 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.320 01:47:22 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:48.320 01:47:22 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:04:48.321 01:47:22 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:48.321 01:47:22 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:48.321 01:47:22 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:48.321 01:47:22 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:48.321 01:47:22 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:04:48.321 01:47:22 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:48.321 01:47:22 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:04:48.321 01:47:22 -- setup/devices.sh@50 -- # local mount_point= 00:04:48.321 01:47:22 -- setup/devices.sh@51 -- # local test_file= 00:04:48.321 01:47:22 -- setup/devices.sh@53 -- # local found=0 00:04:48.321 01:47:22 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:48.321 01:47:22 -- setup/devices.sh@59 -- # local pci status 00:04:48.321 01:47:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.321 01:47:22 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:48.321 01:47:22 -- setup/devices.sh@47 -- # setup output config 00:04:48.321 01:47:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:48.321 01:47:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:49.257 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.257 01:47:23 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:04:49.257 01:47:23 -- setup/devices.sh@63 -- # found=1 00:04:49.257 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.257 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.257 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.257 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.257 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.257 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.257 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.257 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.257 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.257 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.257 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.257 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.257 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.517 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.517 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.517 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.517 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.517 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.517 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.517 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.517 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.517 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.517 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.517 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.517 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.517 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.517 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.517 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.517 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.517 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.517 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.517 01:47:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.517 01:47:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.517 01:47:23 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:49.517 01:47:23 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:49.517 01:47:23 -- setup/devices.sh@68 -- # return 0 00:04:49.517 01:47:23 -- setup/devices.sh@187 -- # cleanup_dm 00:04:49.517 01:47:23 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:49.517 01:47:23 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:49.517 01:47:23 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:49.778 01:47:23 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:49.778 01:47:23 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:49.778 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:49.778 01:47:23 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:49.778 01:47:23 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:49.778 00:04:49.778 real 0m5.897s 00:04:49.778 user 0m1.032s 00:04:49.778 sys 0m1.735s 00:04:49.778 01:47:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.778 01:47:23 -- common/autotest_common.sh@10 -- # set +x 00:04:49.778 ************************************ 00:04:49.778 END TEST dm_mount 00:04:49.778 ************************************ 00:04:49.778 01:47:23 -- setup/devices.sh@1 -- # cleanup 00:04:49.778 01:47:23 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:49.778 01:47:23 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:49.778 01:47:23 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:49.778 01:47:23 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:49.778 01:47:23 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:49.778 01:47:23 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:50.038 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:50.038 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:50.038 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:50.038 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:50.038 01:47:24 -- setup/devices.sh@12 -- # cleanup_dm 00:04:50.038 01:47:24 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:50.038 01:47:24 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:50.038 01:47:24 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:50.038 01:47:24 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:50.038 01:47:24 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:50.038 01:47:24 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:50.038 00:04:50.038 real 0m14.673s 00:04:50.038 user 0m3.312s 00:04:50.038 sys 0m5.619s 00:04:50.038 01:47:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.038 01:47:24 -- common/autotest_common.sh@10 -- # set +x 00:04:50.038 ************************************ 00:04:50.038 END TEST devices 00:04:50.038 ************************************ 00:04:50.038 00:04:50.038 real 0m45.736s 00:04:50.038 user 0m13.297s 00:04:50.038 sys 0m20.913s 00:04:50.038 01:47:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.038 01:47:24 -- common/autotest_common.sh@10 -- # set +x 00:04:50.038 ************************************ 00:04:50.038 END TEST setup.sh 00:04:50.038 ************************************ 00:04:50.038 01:47:24 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:50.974 Hugepages 00:04:50.974 node hugesize free / total 00:04:50.974 node0 1048576kB 0 / 0 00:04:50.974 node0 2048kB 2048 / 2048 00:04:50.974 node1 1048576kB 0 / 0 00:04:50.974 node1 2048kB 0 / 0 00:04:50.974 00:04:50.974 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:50.974 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:04:50.974 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:04:50.974 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:04:50.974 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:04:50.974 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:04:50.974 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:04:50.974 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:04:50.974 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:04:50.974 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:04:50.974 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:04:51.255 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:04:51.256 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:04:51.256 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:04:51.256 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:04:51.256 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:04:51.256 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:04:51.256 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:04:51.256 01:47:25 -- spdk/autotest.sh@128 -- # uname -s 00:04:51.256 01:47:25 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:04:51.256 01:47:25 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:04:51.256 01:47:25 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:52.661 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:52.661 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:52.661 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:52.661 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:52.661 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:52.661 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:52.661 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:52.661 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:52.661 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:52.661 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:52.661 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:52.661 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:52.661 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:52.661 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:52.661 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:52.661 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:53.601 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:53.601 01:47:27 -- common/autotest_common.sh@1527 -- # sleep 1 00:04:54.539 01:47:28 -- common/autotest_common.sh@1528 -- # bdfs=() 00:04:54.539 01:47:28 -- common/autotest_common.sh@1528 -- # local bdfs 00:04:54.539 01:47:28 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:04:54.539 01:47:28 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:04:54.539 01:47:28 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:54.539 01:47:28 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:54.539 01:47:28 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:54.539 01:47:28 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:54.539 01:47:28 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:54.539 01:47:28 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:54.539 01:47:28 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:54.539 01:47:28 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:55.915 Waiting for block devices as requested 00:04:55.915 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:04:56.174 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:56.174 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:56.174 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:56.434 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:56.434 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:56.434 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:56.434 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:56.695 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:56.695 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:56.695 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:56.695 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:56.954 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:56.954 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:56.954 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:57.214 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:57.214 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:57.214 01:47:31 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:04:57.214 01:47:31 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:04:57.214 01:47:31 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:04:57.214 01:47:31 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:04:57.214 01:47:31 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:57.214 01:47:31 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:04:57.214 01:47:31 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:57.214 01:47:31 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:04:57.214 01:47:31 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:04:57.214 01:47:31 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:04:57.215 01:47:31 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:04:57.215 01:47:31 -- common/autotest_common.sh@1540 -- # grep oacs 00:04:57.215 01:47:31 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:04:57.215 01:47:31 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:04:57.215 01:47:31 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:04:57.215 01:47:31 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:04:57.215 01:47:31 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:04:57.215 01:47:31 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:04:57.215 01:47:31 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:04:57.215 01:47:31 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:04:57.215 01:47:31 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:04:57.215 01:47:31 -- common/autotest_common.sh@1552 -- # continue 00:04:57.215 01:47:31 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:04:57.215 01:47:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:57.215 01:47:31 -- common/autotest_common.sh@10 -- # set +x 00:04:57.215 01:47:31 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:04:57.215 01:47:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:57.215 01:47:31 -- common/autotest_common.sh@10 -- # set +x 00:04:57.215 01:47:31 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:58.591 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:58.591 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:58.591 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:58.591 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:58.591 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:58.591 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:58.591 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:58.849 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:58.849 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:58.849 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:58.849 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:58.849 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:58.849 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:58.849 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:58.849 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:58.849 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:59.791 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:59.791 01:47:34 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:04:59.791 01:47:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:59.791 01:47:34 -- common/autotest_common.sh@10 -- # set +x 00:04:59.791 01:47:34 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:04:59.791 01:47:34 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:04:59.791 01:47:34 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:04:59.791 01:47:34 -- common/autotest_common.sh@1572 -- # bdfs=() 00:04:59.791 01:47:34 -- common/autotest_common.sh@1572 -- # local bdfs 00:04:59.791 01:47:34 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:04:59.791 01:47:34 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:59.791 01:47:34 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:59.791 01:47:34 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:59.791 01:47:34 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:59.791 01:47:34 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:59.791 01:47:34 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:59.791 01:47:34 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:59.791 01:47:34 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:04:59.791 01:47:34 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:04:59.791 01:47:34 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:04:59.791 01:47:34 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:59.791 01:47:34 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:04:59.791 01:47:34 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:04:59.791 01:47:34 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:04:59.791 01:47:34 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=1077003 00:04:59.791 01:47:34 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:59.791 01:47:34 -- common/autotest_common.sh@1593 -- # waitforlisten 1077003 00:04:59.791 01:47:34 -- common/autotest_common.sh@829 -- # '[' -z 1077003 ']' 00:04:59.791 01:47:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:59.791 01:47:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:59.791 01:47:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:59.791 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:59.791 01:47:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:59.791 01:47:34 -- common/autotest_common.sh@10 -- # set +x 00:05:00.050 [2024-11-18 01:47:34.225235] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:00.050 [2024-11-18 01:47:34.225350] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1077003 ] 00:05:00.050 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.051 [2024-11-18 01:47:34.282818] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:00.051 [2024-11-18 01:47:34.360649] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:00.051 [2024-11-18 01:47:34.360816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.985 01:47:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:00.985 01:47:35 -- common/autotest_common.sh@862 -- # return 0 00:05:00.985 01:47:35 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:00.985 01:47:35 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:00.985 01:47:35 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:04.271 nvme0n1 00:05:04.271 01:47:38 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:04.271 [2024-11-18 01:47:38.481626] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:04.271 [2024-11-18 01:47:38.481675] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:04.271 request: 00:05:04.271 { 00:05:04.271 "nvme_ctrlr_name": "nvme0", 00:05:04.271 "password": "test", 00:05:04.271 "method": "bdev_nvme_opal_revert", 00:05:04.271 "req_id": 1 00:05:04.271 } 00:05:04.271 Got JSON-RPC error response 00:05:04.271 response: 00:05:04.271 { 00:05:04.271 "code": -32603, 00:05:04.271 "message": "Internal error" 00:05:04.271 } 00:05:04.271 01:47:38 -- common/autotest_common.sh@1599 -- # true 00:05:04.271 01:47:38 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:04.271 01:47:38 -- common/autotest_common.sh@1603 -- # killprocess 1077003 00:05:04.271 01:47:38 -- common/autotest_common.sh@936 -- # '[' -z 1077003 ']' 00:05:04.271 01:47:38 -- common/autotest_common.sh@940 -- # kill -0 1077003 00:05:04.271 01:47:38 -- common/autotest_common.sh@941 -- # uname 00:05:04.271 01:47:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:04.271 01:47:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1077003 00:05:04.271 01:47:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:04.271 01:47:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:04.271 01:47:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1077003' 00:05:04.271 killing process with pid 1077003 00:05:04.271 01:47:38 -- common/autotest_common.sh@955 -- # kill 1077003 00:05:04.271 01:47:38 -- common/autotest_common.sh@960 -- # wait 1077003 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.271 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:04.272 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:06.174 01:47:40 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:06.174 01:47:40 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:06.174 01:47:40 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:06.174 01:47:40 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:06.174 01:47:40 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:06.174 01:47:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:06.174 01:47:40 -- common/autotest_common.sh@10 -- # set +x 00:05:06.174 01:47:40 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:06.174 01:47:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:06.174 01:47:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:06.174 01:47:40 -- common/autotest_common.sh@10 -- # set +x 00:05:06.174 ************************************ 00:05:06.174 START TEST env 00:05:06.174 ************************************ 00:05:06.174 01:47:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:06.174 * Looking for test storage... 00:05:06.174 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:06.174 01:47:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:06.174 01:47:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:06.174 01:47:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:06.174 01:47:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:06.174 01:47:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:06.174 01:47:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:06.174 01:47:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:06.174 01:47:40 -- scripts/common.sh@335 -- # IFS=.-: 00:05:06.174 01:47:40 -- scripts/common.sh@335 -- # read -ra ver1 00:05:06.174 01:47:40 -- scripts/common.sh@336 -- # IFS=.-: 00:05:06.174 01:47:40 -- scripts/common.sh@336 -- # read -ra ver2 00:05:06.174 01:47:40 -- scripts/common.sh@337 -- # local 'op=<' 00:05:06.174 01:47:40 -- scripts/common.sh@339 -- # ver1_l=2 00:05:06.174 01:47:40 -- scripts/common.sh@340 -- # ver2_l=1 00:05:06.174 01:47:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:06.174 01:47:40 -- scripts/common.sh@343 -- # case "$op" in 00:05:06.174 01:47:40 -- scripts/common.sh@344 -- # : 1 00:05:06.174 01:47:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:06.174 01:47:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:06.174 01:47:40 -- scripts/common.sh@364 -- # decimal 1 00:05:06.174 01:47:40 -- scripts/common.sh@352 -- # local d=1 00:05:06.174 01:47:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:06.174 01:47:40 -- scripts/common.sh@354 -- # echo 1 00:05:06.174 01:47:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:06.174 01:47:40 -- scripts/common.sh@365 -- # decimal 2 00:05:06.174 01:47:40 -- scripts/common.sh@352 -- # local d=2 00:05:06.174 01:47:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:06.174 01:47:40 -- scripts/common.sh@354 -- # echo 2 00:05:06.174 01:47:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:06.174 01:47:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:06.174 01:47:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:06.174 01:47:40 -- scripts/common.sh@367 -- # return 0 00:05:06.174 01:47:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:06.174 01:47:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:06.174 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:06.174 --rc genhtml_branch_coverage=1 00:05:06.174 --rc genhtml_function_coverage=1 00:05:06.174 --rc genhtml_legend=1 00:05:06.174 --rc geninfo_all_blocks=1 00:05:06.174 --rc geninfo_unexecuted_blocks=1 00:05:06.174 00:05:06.174 ' 00:05:06.174 01:47:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:06.174 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:06.174 --rc genhtml_branch_coverage=1 00:05:06.174 --rc genhtml_function_coverage=1 00:05:06.174 --rc genhtml_legend=1 00:05:06.174 --rc geninfo_all_blocks=1 00:05:06.174 --rc geninfo_unexecuted_blocks=1 00:05:06.174 00:05:06.174 ' 00:05:06.174 01:47:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:06.174 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:06.174 --rc genhtml_branch_coverage=1 00:05:06.174 --rc genhtml_function_coverage=1 00:05:06.174 --rc genhtml_legend=1 00:05:06.174 --rc geninfo_all_blocks=1 00:05:06.174 --rc geninfo_unexecuted_blocks=1 00:05:06.174 00:05:06.174 ' 00:05:06.174 01:47:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:06.174 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:06.174 --rc genhtml_branch_coverage=1 00:05:06.174 --rc genhtml_function_coverage=1 00:05:06.174 --rc genhtml_legend=1 00:05:06.174 --rc geninfo_all_blocks=1 00:05:06.174 --rc geninfo_unexecuted_blocks=1 00:05:06.174 00:05:06.174 ' 00:05:06.174 01:47:40 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:06.174 01:47:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:06.174 01:47:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:06.174 01:47:40 -- common/autotest_common.sh@10 -- # set +x 00:05:06.174 ************************************ 00:05:06.174 START TEST env_memory 00:05:06.174 ************************************ 00:05:06.174 01:47:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:06.174 00:05:06.174 00:05:06.174 CUnit - A unit testing framework for C - Version 2.1-3 00:05:06.174 http://cunit.sourceforge.net/ 00:05:06.174 00:05:06.174 00:05:06.174 Suite: memory 00:05:06.174 Test: alloc and free memory map ...[2024-11-18 01:47:40.487338] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:06.174 passed 00:05:06.174 Test: mem map translation ...[2024-11-18 01:47:40.507357] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:06.174 [2024-11-18 01:47:40.507378] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:06.174 [2024-11-18 01:47:40.507434] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:06.175 [2024-11-18 01:47:40.507447] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:06.175 passed 00:05:06.175 Test: mem map registration ...[2024-11-18 01:47:40.548674] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:06.175 [2024-11-18 01:47:40.548697] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:06.175 passed 00:05:06.434 Test: mem map adjacent registrations ...passed 00:05:06.434 00:05:06.434 Run Summary: Type Total Ran Passed Failed Inactive 00:05:06.434 suites 1 1 n/a 0 0 00:05:06.434 tests 4 4 4 0 0 00:05:06.434 asserts 152 152 152 0 n/a 00:05:06.434 00:05:06.434 Elapsed time = 0.142 seconds 00:05:06.434 00:05:06.434 real 0m0.150s 00:05:06.434 user 0m0.145s 00:05:06.434 sys 0m0.005s 00:05:06.434 01:47:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:06.434 01:47:40 -- common/autotest_common.sh@10 -- # set +x 00:05:06.434 ************************************ 00:05:06.434 END TEST env_memory 00:05:06.434 ************************************ 00:05:06.434 01:47:40 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:06.434 01:47:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:06.434 01:47:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:06.434 01:47:40 -- common/autotest_common.sh@10 -- # set +x 00:05:06.434 ************************************ 00:05:06.434 START TEST env_vtophys 00:05:06.434 ************************************ 00:05:06.434 01:47:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:06.434 EAL: lib.eal log level changed from notice to debug 00:05:06.434 EAL: Detected lcore 0 as core 0 on socket 0 00:05:06.434 EAL: Detected lcore 1 as core 1 on socket 0 00:05:06.434 EAL: Detected lcore 2 as core 2 on socket 0 00:05:06.434 EAL: Detected lcore 3 as core 3 on socket 0 00:05:06.434 EAL: Detected lcore 4 as core 4 on socket 0 00:05:06.434 EAL: Detected lcore 5 as core 5 on socket 0 00:05:06.434 EAL: Detected lcore 6 as core 8 on socket 0 00:05:06.434 EAL: Detected lcore 7 as core 9 on socket 0 00:05:06.434 EAL: Detected lcore 8 as core 10 on socket 0 00:05:06.434 EAL: Detected lcore 9 as core 11 on socket 0 00:05:06.434 EAL: Detected lcore 10 as core 12 on socket 0 00:05:06.434 EAL: Detected lcore 11 as core 13 on socket 0 00:05:06.434 EAL: Detected lcore 12 as core 0 on socket 1 00:05:06.434 EAL: Detected lcore 13 as core 1 on socket 1 00:05:06.434 EAL: Detected lcore 14 as core 2 on socket 1 00:05:06.434 EAL: Detected lcore 15 as core 3 on socket 1 00:05:06.434 EAL: Detected lcore 16 as core 4 on socket 1 00:05:06.434 EAL: Detected lcore 17 as core 5 on socket 1 00:05:06.434 EAL: Detected lcore 18 as core 8 on socket 1 00:05:06.434 EAL: Detected lcore 19 as core 9 on socket 1 00:05:06.434 EAL: Detected lcore 20 as core 10 on socket 1 00:05:06.434 EAL: Detected lcore 21 as core 11 on socket 1 00:05:06.434 EAL: Detected lcore 22 as core 12 on socket 1 00:05:06.434 EAL: Detected lcore 23 as core 13 on socket 1 00:05:06.434 EAL: Detected lcore 24 as core 0 on socket 0 00:05:06.434 EAL: Detected lcore 25 as core 1 on socket 0 00:05:06.434 EAL: Detected lcore 26 as core 2 on socket 0 00:05:06.434 EAL: Detected lcore 27 as core 3 on socket 0 00:05:06.434 EAL: Detected lcore 28 as core 4 on socket 0 00:05:06.434 EAL: Detected lcore 29 as core 5 on socket 0 00:05:06.434 EAL: Detected lcore 30 as core 8 on socket 0 00:05:06.434 EAL: Detected lcore 31 as core 9 on socket 0 00:05:06.434 EAL: Detected lcore 32 as core 10 on socket 0 00:05:06.434 EAL: Detected lcore 33 as core 11 on socket 0 00:05:06.434 EAL: Detected lcore 34 as core 12 on socket 0 00:05:06.434 EAL: Detected lcore 35 as core 13 on socket 0 00:05:06.434 EAL: Detected lcore 36 as core 0 on socket 1 00:05:06.434 EAL: Detected lcore 37 as core 1 on socket 1 00:05:06.434 EAL: Detected lcore 38 as core 2 on socket 1 00:05:06.434 EAL: Detected lcore 39 as core 3 on socket 1 00:05:06.434 EAL: Detected lcore 40 as core 4 on socket 1 00:05:06.434 EAL: Detected lcore 41 as core 5 on socket 1 00:05:06.434 EAL: Detected lcore 42 as core 8 on socket 1 00:05:06.434 EAL: Detected lcore 43 as core 9 on socket 1 00:05:06.434 EAL: Detected lcore 44 as core 10 on socket 1 00:05:06.434 EAL: Detected lcore 45 as core 11 on socket 1 00:05:06.434 EAL: Detected lcore 46 as core 12 on socket 1 00:05:06.434 EAL: Detected lcore 47 as core 13 on socket 1 00:05:06.434 EAL: Maximum logical cores by configuration: 128 00:05:06.434 EAL: Detected CPU lcores: 48 00:05:06.434 EAL: Detected NUMA nodes: 2 00:05:06.434 EAL: Checking presence of .so 'librte_eal.so.23.0' 00:05:06.434 EAL: Detected shared linkage of DPDK 00:05:06.434 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23.0 00:05:06.434 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23.0 00:05:06.434 EAL: Registered [vdev] bus. 00:05:06.434 EAL: bus.vdev log level changed from disabled to notice 00:05:06.434 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23.0 00:05:06.434 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23.0 00:05:06.434 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:06.434 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:06.434 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:05:06.434 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:05:06.434 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:05:06.434 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:05:06.434 EAL: No shared files mode enabled, IPC will be disabled 00:05:06.434 EAL: No shared files mode enabled, IPC is disabled 00:05:06.434 EAL: Bus pci wants IOVA as 'DC' 00:05:06.434 EAL: Bus vdev wants IOVA as 'DC' 00:05:06.434 EAL: Buses did not request a specific IOVA mode. 00:05:06.434 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:06.434 EAL: Selected IOVA mode 'VA' 00:05:06.434 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.434 EAL: Probing VFIO support... 00:05:06.434 EAL: IOMMU type 1 (Type 1) is supported 00:05:06.434 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:06.434 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:06.434 EAL: VFIO support initialized 00:05:06.434 EAL: Ask a virtual area of 0x2e000 bytes 00:05:06.434 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:06.434 EAL: Setting up physically contiguous memory... 00:05:06.434 EAL: Setting maximum number of open files to 524288 00:05:06.435 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:06.435 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:06.435 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:06.435 EAL: Ask a virtual area of 0x61000 bytes 00:05:06.435 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:06.435 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:06.435 EAL: Ask a virtual area of 0x400000000 bytes 00:05:06.435 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:06.435 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:06.435 EAL: Ask a virtual area of 0x61000 bytes 00:05:06.435 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:06.435 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:06.435 EAL: Ask a virtual area of 0x400000000 bytes 00:05:06.435 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:06.435 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:06.435 EAL: Ask a virtual area of 0x61000 bytes 00:05:06.435 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:06.435 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:06.435 EAL: Ask a virtual area of 0x400000000 bytes 00:05:06.435 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:06.435 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:06.435 EAL: Ask a virtual area of 0x61000 bytes 00:05:06.435 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:06.435 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:06.435 EAL: Ask a virtual area of 0x400000000 bytes 00:05:06.435 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:06.435 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:06.435 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:06.435 EAL: Ask a virtual area of 0x61000 bytes 00:05:06.435 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:06.435 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:06.435 EAL: Ask a virtual area of 0x400000000 bytes 00:05:06.435 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:06.435 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:06.435 EAL: Ask a virtual area of 0x61000 bytes 00:05:06.435 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:06.435 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:06.435 EAL: Ask a virtual area of 0x400000000 bytes 00:05:06.435 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:06.435 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:06.435 EAL: Ask a virtual area of 0x61000 bytes 00:05:06.435 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:06.435 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:06.435 EAL: Ask a virtual area of 0x400000000 bytes 00:05:06.435 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:06.435 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:06.435 EAL: Ask a virtual area of 0x61000 bytes 00:05:06.435 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:06.435 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:06.435 EAL: Ask a virtual area of 0x400000000 bytes 00:05:06.435 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:06.435 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:06.435 EAL: Hugepages will be freed exactly as allocated. 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: TSC frequency is ~2700000 KHz 00:05:06.435 EAL: Main lcore 0 is ready (tid=7f96087c7a00;cpuset=[0]) 00:05:06.435 EAL: Trying to obtain current memory policy. 00:05:06.435 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:06.435 EAL: Restoring previous memory policy: 0 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was expanded by 2MB 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:06.435 EAL: Mem event callback 'spdk:(nil)' registered 00:05:06.435 00:05:06.435 00:05:06.435 CUnit - A unit testing framework for C - Version 2.1-3 00:05:06.435 http://cunit.sourceforge.net/ 00:05:06.435 00:05:06.435 00:05:06.435 Suite: components_suite 00:05:06.435 Test: vtophys_malloc_test ...passed 00:05:06.435 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:06.435 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:06.435 EAL: Restoring previous memory policy: 4 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was expanded by 4MB 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was shrunk by 4MB 00:05:06.435 EAL: Trying to obtain current memory policy. 00:05:06.435 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:06.435 EAL: Restoring previous memory policy: 4 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was expanded by 6MB 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was shrunk by 6MB 00:05:06.435 EAL: Trying to obtain current memory policy. 00:05:06.435 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:06.435 EAL: Restoring previous memory policy: 4 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was expanded by 10MB 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was shrunk by 10MB 00:05:06.435 EAL: Trying to obtain current memory policy. 00:05:06.435 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:06.435 EAL: Restoring previous memory policy: 4 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was expanded by 18MB 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was shrunk by 18MB 00:05:06.435 EAL: Trying to obtain current memory policy. 00:05:06.435 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:06.435 EAL: Restoring previous memory policy: 4 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was expanded by 34MB 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was shrunk by 34MB 00:05:06.435 EAL: Trying to obtain current memory policy. 00:05:06.435 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:06.435 EAL: Restoring previous memory policy: 4 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was expanded by 66MB 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was shrunk by 66MB 00:05:06.435 EAL: Trying to obtain current memory policy. 00:05:06.435 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:06.435 EAL: Restoring previous memory policy: 4 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.435 EAL: request: mp_malloc_sync 00:05:06.435 EAL: No shared files mode enabled, IPC is disabled 00:05:06.435 EAL: Heap on socket 0 was expanded by 130MB 00:05:06.435 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.693 EAL: request: mp_malloc_sync 00:05:06.693 EAL: No shared files mode enabled, IPC is disabled 00:05:06.693 EAL: Heap on socket 0 was shrunk by 130MB 00:05:06.693 EAL: Trying to obtain current memory policy. 00:05:06.693 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:06.694 EAL: Restoring previous memory policy: 4 00:05:06.694 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.694 EAL: request: mp_malloc_sync 00:05:06.694 EAL: No shared files mode enabled, IPC is disabled 00:05:06.694 EAL: Heap on socket 0 was expanded by 258MB 00:05:06.694 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.694 EAL: request: mp_malloc_sync 00:05:06.694 EAL: No shared files mode enabled, IPC is disabled 00:05:06.694 EAL: Heap on socket 0 was shrunk by 258MB 00:05:06.694 EAL: Trying to obtain current memory policy. 00:05:06.694 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:06.952 EAL: Restoring previous memory policy: 4 00:05:06.952 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.952 EAL: request: mp_malloc_sync 00:05:06.952 EAL: No shared files mode enabled, IPC is disabled 00:05:06.952 EAL: Heap on socket 0 was expanded by 514MB 00:05:06.952 EAL: Calling mem event callback 'spdk:(nil)' 00:05:07.211 EAL: request: mp_malloc_sync 00:05:07.211 EAL: No shared files mode enabled, IPC is disabled 00:05:07.211 EAL: Heap on socket 0 was shrunk by 514MB 00:05:07.211 EAL: Trying to obtain current memory policy. 00:05:07.211 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:07.469 EAL: Restoring previous memory policy: 4 00:05:07.469 EAL: Calling mem event callback 'spdk:(nil)' 00:05:07.469 EAL: request: mp_malloc_sync 00:05:07.469 EAL: No shared files mode enabled, IPC is disabled 00:05:07.469 EAL: Heap on socket 0 was expanded by 1026MB 00:05:07.469 EAL: Calling mem event callback 'spdk:(nil)' 00:05:07.729 EAL: request: mp_malloc_sync 00:05:07.729 EAL: No shared files mode enabled, IPC is disabled 00:05:07.729 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:07.729 passed 00:05:07.729 00:05:07.729 Run Summary: Type Total Ran Passed Failed Inactive 00:05:07.729 suites 1 1 n/a 0 0 00:05:07.729 tests 2 2 2 0 0 00:05:07.729 asserts 497 497 497 0 n/a 00:05:07.729 00:05:07.729 Elapsed time = 1.315 seconds 00:05:07.729 EAL: Calling mem event callback 'spdk:(nil)' 00:05:07.730 EAL: request: mp_malloc_sync 00:05:07.730 EAL: No shared files mode enabled, IPC is disabled 00:05:07.730 EAL: Heap on socket 0 was shrunk by 2MB 00:05:07.730 EAL: No shared files mode enabled, IPC is disabled 00:05:07.730 EAL: No shared files mode enabled, IPC is disabled 00:05:07.730 EAL: No shared files mode enabled, IPC is disabled 00:05:07.730 00:05:07.730 real 0m1.421s 00:05:07.730 user 0m0.831s 00:05:07.730 sys 0m0.558s 00:05:07.730 01:47:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:07.730 01:47:42 -- common/autotest_common.sh@10 -- # set +x 00:05:07.730 ************************************ 00:05:07.730 END TEST env_vtophys 00:05:07.730 ************************************ 00:05:07.730 01:47:42 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:07.730 01:47:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:07.730 01:47:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:07.730 01:47:42 -- common/autotest_common.sh@10 -- # set +x 00:05:07.730 ************************************ 00:05:07.730 START TEST env_pci 00:05:07.730 ************************************ 00:05:07.730 01:47:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:07.730 00:05:07.730 00:05:07.730 CUnit - A unit testing framework for C - Version 2.1-3 00:05:07.730 http://cunit.sourceforge.net/ 00:05:07.730 00:05:07.730 00:05:07.730 Suite: pci 00:05:07.730 Test: pci_hook ...[2024-11-18 01:47:42.084599] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1078060 has claimed it 00:05:07.730 EAL: Cannot find device (10000:00:01.0) 00:05:07.730 EAL: Failed to attach device on primary process 00:05:07.730 passed 00:05:07.730 00:05:07.730 Run Summary: Type Total Ran Passed Failed Inactive 00:05:07.730 suites 1 1 n/a 0 0 00:05:07.730 tests 1 1 1 0 0 00:05:07.730 asserts 25 25 25 0 n/a 00:05:07.730 00:05:07.730 Elapsed time = 0.021 seconds 00:05:07.730 00:05:07.730 real 0m0.033s 00:05:07.730 user 0m0.007s 00:05:07.730 sys 0m0.026s 00:05:07.730 01:47:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:07.730 01:47:42 -- common/autotest_common.sh@10 -- # set +x 00:05:07.730 ************************************ 00:05:07.730 END TEST env_pci 00:05:07.730 ************************************ 00:05:07.730 01:47:42 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:07.730 01:47:42 -- env/env.sh@15 -- # uname 00:05:07.730 01:47:42 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:07.730 01:47:42 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:07.730 01:47:42 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:07.730 01:47:42 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:07.730 01:47:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:07.991 01:47:42 -- common/autotest_common.sh@10 -- # set +x 00:05:07.991 ************************************ 00:05:07.991 START TEST env_dpdk_post_init 00:05:07.991 ************************************ 00:05:07.991 01:47:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:07.991 EAL: Detected CPU lcores: 48 00:05:07.991 EAL: Detected NUMA nodes: 2 00:05:07.991 EAL: Detected shared linkage of DPDK 00:05:07.991 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:07.991 EAL: Selected IOVA mode 'VA' 00:05:07.991 EAL: No free 2048 kB hugepages reported on node 1 00:05:07.991 EAL: VFIO support initialized 00:05:07.991 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:07.991 EAL: Using IOMMU type 1 (Type 1) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:07.991 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:08.251 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:08.251 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:08.251 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:08.847 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:12.129 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:12.129 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:12.129 Starting DPDK initialization... 00:05:12.129 Starting SPDK post initialization... 00:05:12.129 SPDK NVMe probe 00:05:12.129 Attaching to 0000:88:00.0 00:05:12.129 Attached to 0000:88:00.0 00:05:12.129 Cleaning up... 00:05:12.388 00:05:12.388 real 0m4.397s 00:05:12.388 user 0m3.290s 00:05:12.388 sys 0m0.165s 00:05:12.388 01:47:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:12.388 01:47:46 -- common/autotest_common.sh@10 -- # set +x 00:05:12.388 ************************************ 00:05:12.388 END TEST env_dpdk_post_init 00:05:12.388 ************************************ 00:05:12.388 01:47:46 -- env/env.sh@26 -- # uname 00:05:12.388 01:47:46 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:12.388 01:47:46 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:12.388 01:47:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.388 01:47:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.388 01:47:46 -- common/autotest_common.sh@10 -- # set +x 00:05:12.388 ************************************ 00:05:12.388 START TEST env_mem_callbacks 00:05:12.388 ************************************ 00:05:12.388 01:47:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:12.388 EAL: Detected CPU lcores: 48 00:05:12.388 EAL: Detected NUMA nodes: 2 00:05:12.388 EAL: Detected shared linkage of DPDK 00:05:12.388 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:12.388 EAL: Selected IOVA mode 'VA' 00:05:12.388 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.388 EAL: VFIO support initialized 00:05:12.388 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:12.388 00:05:12.388 00:05:12.388 CUnit - A unit testing framework for C - Version 2.1-3 00:05:12.388 http://cunit.sourceforge.net/ 00:05:12.388 00:05:12.388 00:05:12.388 Suite: memory 00:05:12.388 Test: test ... 00:05:12.388 register 0x200000200000 2097152 00:05:12.388 malloc 3145728 00:05:12.388 register 0x200000400000 4194304 00:05:12.388 buf 0x200000500000 len 3145728 PASSED 00:05:12.388 malloc 64 00:05:12.388 buf 0x2000004fff40 len 64 PASSED 00:05:12.388 malloc 4194304 00:05:12.388 register 0x200000800000 6291456 00:05:12.388 buf 0x200000a00000 len 4194304 PASSED 00:05:12.388 free 0x200000500000 3145728 00:05:12.388 free 0x2000004fff40 64 00:05:12.388 unregister 0x200000400000 4194304 PASSED 00:05:12.388 free 0x200000a00000 4194304 00:05:12.388 unregister 0x200000800000 6291456 PASSED 00:05:12.388 malloc 8388608 00:05:12.388 register 0x200000400000 10485760 00:05:12.388 buf 0x200000600000 len 8388608 PASSED 00:05:12.388 free 0x200000600000 8388608 00:05:12.388 unregister 0x200000400000 10485760 PASSED 00:05:12.388 passed 00:05:12.388 00:05:12.388 Run Summary: Type Total Ran Passed Failed Inactive 00:05:12.388 suites 1 1 n/a 0 0 00:05:12.388 tests 1 1 1 0 0 00:05:12.388 asserts 15 15 15 0 n/a 00:05:12.388 00:05:12.388 Elapsed time = 0.005 seconds 00:05:12.388 00:05:12.388 real 0m0.046s 00:05:12.388 user 0m0.011s 00:05:12.388 sys 0m0.035s 00:05:12.388 01:47:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:12.388 01:47:46 -- common/autotest_common.sh@10 -- # set +x 00:05:12.388 ************************************ 00:05:12.388 END TEST env_mem_callbacks 00:05:12.388 ************************************ 00:05:12.388 00:05:12.388 real 0m6.318s 00:05:12.388 user 0m4.422s 00:05:12.388 sys 0m0.950s 00:05:12.388 01:47:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:12.388 01:47:46 -- common/autotest_common.sh@10 -- # set +x 00:05:12.388 ************************************ 00:05:12.388 END TEST env 00:05:12.388 ************************************ 00:05:12.388 01:47:46 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:12.388 01:47:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.388 01:47:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.388 01:47:46 -- common/autotest_common.sh@10 -- # set +x 00:05:12.388 ************************************ 00:05:12.388 START TEST rpc 00:05:12.388 ************************************ 00:05:12.388 01:47:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:12.388 * Looking for test storage... 00:05:12.388 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:12.388 01:47:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:12.388 01:47:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:12.388 01:47:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:12.388 01:47:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:12.388 01:47:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:12.388 01:47:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:12.388 01:47:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:12.388 01:47:46 -- scripts/common.sh@335 -- # IFS=.-: 00:05:12.388 01:47:46 -- scripts/common.sh@335 -- # read -ra ver1 00:05:12.388 01:47:46 -- scripts/common.sh@336 -- # IFS=.-: 00:05:12.388 01:47:46 -- scripts/common.sh@336 -- # read -ra ver2 00:05:12.388 01:47:46 -- scripts/common.sh@337 -- # local 'op=<' 00:05:12.388 01:47:46 -- scripts/common.sh@339 -- # ver1_l=2 00:05:12.388 01:47:46 -- scripts/common.sh@340 -- # ver2_l=1 00:05:12.388 01:47:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:12.388 01:47:46 -- scripts/common.sh@343 -- # case "$op" in 00:05:12.388 01:47:46 -- scripts/common.sh@344 -- # : 1 00:05:12.388 01:47:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:12.388 01:47:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:12.388 01:47:46 -- scripts/common.sh@364 -- # decimal 1 00:05:12.388 01:47:46 -- scripts/common.sh@352 -- # local d=1 00:05:12.388 01:47:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:12.388 01:47:46 -- scripts/common.sh@354 -- # echo 1 00:05:12.388 01:47:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:12.388 01:47:46 -- scripts/common.sh@365 -- # decimal 2 00:05:12.647 01:47:46 -- scripts/common.sh@352 -- # local d=2 00:05:12.647 01:47:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:12.647 01:47:46 -- scripts/common.sh@354 -- # echo 2 00:05:12.647 01:47:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:12.647 01:47:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:12.647 01:47:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:12.647 01:47:46 -- scripts/common.sh@367 -- # return 0 00:05:12.647 01:47:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:12.647 01:47:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:12.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.647 --rc genhtml_branch_coverage=1 00:05:12.647 --rc genhtml_function_coverage=1 00:05:12.647 --rc genhtml_legend=1 00:05:12.647 --rc geninfo_all_blocks=1 00:05:12.647 --rc geninfo_unexecuted_blocks=1 00:05:12.647 00:05:12.647 ' 00:05:12.647 01:47:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:12.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.647 --rc genhtml_branch_coverage=1 00:05:12.647 --rc genhtml_function_coverage=1 00:05:12.647 --rc genhtml_legend=1 00:05:12.647 --rc geninfo_all_blocks=1 00:05:12.647 --rc geninfo_unexecuted_blocks=1 00:05:12.647 00:05:12.647 ' 00:05:12.647 01:47:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:12.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.647 --rc genhtml_branch_coverage=1 00:05:12.647 --rc genhtml_function_coverage=1 00:05:12.647 --rc genhtml_legend=1 00:05:12.647 --rc geninfo_all_blocks=1 00:05:12.647 --rc geninfo_unexecuted_blocks=1 00:05:12.647 00:05:12.647 ' 00:05:12.647 01:47:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:12.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.647 --rc genhtml_branch_coverage=1 00:05:12.647 --rc genhtml_function_coverage=1 00:05:12.647 --rc genhtml_legend=1 00:05:12.647 --rc geninfo_all_blocks=1 00:05:12.647 --rc geninfo_unexecuted_blocks=1 00:05:12.647 00:05:12.647 ' 00:05:12.647 01:47:46 -- rpc/rpc.sh@65 -- # spdk_pid=1078728 00:05:12.647 01:47:46 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:12.647 01:47:46 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:12.647 01:47:46 -- rpc/rpc.sh@67 -- # waitforlisten 1078728 00:05:12.647 01:47:46 -- common/autotest_common.sh@829 -- # '[' -z 1078728 ']' 00:05:12.647 01:47:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:12.647 01:47:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.647 01:47:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:12.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:12.647 01:47:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.647 01:47:46 -- common/autotest_common.sh@10 -- # set +x 00:05:12.647 [2024-11-18 01:47:46.843042] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:12.647 [2024-11-18 01:47:46.843143] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1078728 ] 00:05:12.647 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.647 [2024-11-18 01:47:46.901893] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.647 [2024-11-18 01:47:46.989267] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:12.647 [2024-11-18 01:47:46.989449] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:12.647 [2024-11-18 01:47:46.989470] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1078728' to capture a snapshot of events at runtime. 00:05:12.647 [2024-11-18 01:47:46.989483] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1078728 for offline analysis/debug. 00:05:12.647 [2024-11-18 01:47:46.989511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.582 01:47:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:13.582 01:47:47 -- common/autotest_common.sh@862 -- # return 0 00:05:13.582 01:47:47 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:13.582 01:47:47 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:13.582 01:47:47 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:13.582 01:47:47 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:13.582 01:47:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.582 01:47:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.582 01:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:13.582 ************************************ 00:05:13.582 START TEST rpc_integrity 00:05:13.582 ************************************ 00:05:13.582 01:47:47 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:13.582 01:47:47 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:13.582 01:47:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.582 01:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:13.582 01:47:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.582 01:47:47 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:13.582 01:47:47 -- rpc/rpc.sh@13 -- # jq length 00:05:13.582 01:47:47 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:13.582 01:47:47 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:13.582 01:47:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.582 01:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:13.582 01:47:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.582 01:47:47 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:13.582 01:47:47 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:13.582 01:47:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.582 01:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:13.582 01:47:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.582 01:47:47 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:13.582 { 00:05:13.582 "name": "Malloc0", 00:05:13.582 "aliases": [ 00:05:13.582 "4134b6ff-78ed-41cc-937f-8bd82119902e" 00:05:13.582 ], 00:05:13.582 "product_name": "Malloc disk", 00:05:13.582 "block_size": 512, 00:05:13.582 "num_blocks": 16384, 00:05:13.582 "uuid": "4134b6ff-78ed-41cc-937f-8bd82119902e", 00:05:13.582 "assigned_rate_limits": { 00:05:13.582 "rw_ios_per_sec": 0, 00:05:13.582 "rw_mbytes_per_sec": 0, 00:05:13.582 "r_mbytes_per_sec": 0, 00:05:13.582 "w_mbytes_per_sec": 0 00:05:13.582 }, 00:05:13.582 "claimed": false, 00:05:13.582 "zoned": false, 00:05:13.582 "supported_io_types": { 00:05:13.582 "read": true, 00:05:13.582 "write": true, 00:05:13.582 "unmap": true, 00:05:13.582 "write_zeroes": true, 00:05:13.582 "flush": true, 00:05:13.582 "reset": true, 00:05:13.582 "compare": false, 00:05:13.582 "compare_and_write": false, 00:05:13.582 "abort": true, 00:05:13.582 "nvme_admin": false, 00:05:13.582 "nvme_io": false 00:05:13.582 }, 00:05:13.582 "memory_domains": [ 00:05:13.582 { 00:05:13.582 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:13.582 "dma_device_type": 2 00:05:13.582 } 00:05:13.582 ], 00:05:13.582 "driver_specific": {} 00:05:13.582 } 00:05:13.582 ]' 00:05:13.582 01:47:47 -- rpc/rpc.sh@17 -- # jq length 00:05:13.582 01:47:47 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:13.582 01:47:47 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:13.582 01:47:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.582 01:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:13.582 [2024-11-18 01:47:47.911854] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:13.582 [2024-11-18 01:47:47.911898] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:13.582 [2024-11-18 01:47:47.911918] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x21f8b20 00:05:13.582 [2024-11-18 01:47:47.911930] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:13.582 [2024-11-18 01:47:47.913168] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:13.582 [2024-11-18 01:47:47.913193] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:13.582 Passthru0 00:05:13.582 01:47:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.582 01:47:47 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:13.582 01:47:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.582 01:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:13.582 01:47:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.582 01:47:47 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:13.582 { 00:05:13.582 "name": "Malloc0", 00:05:13.582 "aliases": [ 00:05:13.582 "4134b6ff-78ed-41cc-937f-8bd82119902e" 00:05:13.582 ], 00:05:13.582 "product_name": "Malloc disk", 00:05:13.582 "block_size": 512, 00:05:13.582 "num_blocks": 16384, 00:05:13.582 "uuid": "4134b6ff-78ed-41cc-937f-8bd82119902e", 00:05:13.582 "assigned_rate_limits": { 00:05:13.582 "rw_ios_per_sec": 0, 00:05:13.582 "rw_mbytes_per_sec": 0, 00:05:13.582 "r_mbytes_per_sec": 0, 00:05:13.582 "w_mbytes_per_sec": 0 00:05:13.582 }, 00:05:13.582 "claimed": true, 00:05:13.582 "claim_type": "exclusive_write", 00:05:13.582 "zoned": false, 00:05:13.582 "supported_io_types": { 00:05:13.582 "read": true, 00:05:13.582 "write": true, 00:05:13.582 "unmap": true, 00:05:13.582 "write_zeroes": true, 00:05:13.582 "flush": true, 00:05:13.582 "reset": true, 00:05:13.582 "compare": false, 00:05:13.582 "compare_and_write": false, 00:05:13.582 "abort": true, 00:05:13.582 "nvme_admin": false, 00:05:13.582 "nvme_io": false 00:05:13.582 }, 00:05:13.582 "memory_domains": [ 00:05:13.582 { 00:05:13.582 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:13.582 "dma_device_type": 2 00:05:13.582 } 00:05:13.582 ], 00:05:13.583 "driver_specific": {} 00:05:13.583 }, 00:05:13.583 { 00:05:13.583 "name": "Passthru0", 00:05:13.583 "aliases": [ 00:05:13.583 "fb76dd39-a174-5639-891b-2be6d74c0d61" 00:05:13.583 ], 00:05:13.583 "product_name": "passthru", 00:05:13.583 "block_size": 512, 00:05:13.583 "num_blocks": 16384, 00:05:13.583 "uuid": "fb76dd39-a174-5639-891b-2be6d74c0d61", 00:05:13.583 "assigned_rate_limits": { 00:05:13.583 "rw_ios_per_sec": 0, 00:05:13.583 "rw_mbytes_per_sec": 0, 00:05:13.583 "r_mbytes_per_sec": 0, 00:05:13.583 "w_mbytes_per_sec": 0 00:05:13.583 }, 00:05:13.583 "claimed": false, 00:05:13.583 "zoned": false, 00:05:13.583 "supported_io_types": { 00:05:13.583 "read": true, 00:05:13.583 "write": true, 00:05:13.583 "unmap": true, 00:05:13.583 "write_zeroes": true, 00:05:13.583 "flush": true, 00:05:13.583 "reset": true, 00:05:13.583 "compare": false, 00:05:13.583 "compare_and_write": false, 00:05:13.583 "abort": true, 00:05:13.583 "nvme_admin": false, 00:05:13.583 "nvme_io": false 00:05:13.583 }, 00:05:13.583 "memory_domains": [ 00:05:13.583 { 00:05:13.583 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:13.583 "dma_device_type": 2 00:05:13.583 } 00:05:13.583 ], 00:05:13.583 "driver_specific": { 00:05:13.583 "passthru": { 00:05:13.583 "name": "Passthru0", 00:05:13.583 "base_bdev_name": "Malloc0" 00:05:13.583 } 00:05:13.583 } 00:05:13.583 } 00:05:13.583 ]' 00:05:13.583 01:47:47 -- rpc/rpc.sh@21 -- # jq length 00:05:13.583 01:47:47 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:13.583 01:47:47 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:13.583 01:47:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.583 01:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:13.583 01:47:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.583 01:47:47 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:13.583 01:47:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.583 01:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:13.583 01:47:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.583 01:47:47 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:13.583 01:47:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.583 01:47:47 -- common/autotest_common.sh@10 -- # set +x 00:05:13.841 01:47:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.841 01:47:47 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:13.841 01:47:47 -- rpc/rpc.sh@26 -- # jq length 00:05:13.841 01:47:48 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:13.841 00:05:13.841 real 0m0.212s 00:05:13.841 user 0m0.131s 00:05:13.841 sys 0m0.023s 00:05:13.841 01:47:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.841 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:13.841 ************************************ 00:05:13.841 END TEST rpc_integrity 00:05:13.841 ************************************ 00:05:13.841 01:47:48 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:13.841 01:47:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.841 01:47:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.841 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:13.841 ************************************ 00:05:13.841 START TEST rpc_plugins 00:05:13.841 ************************************ 00:05:13.841 01:47:48 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:13.841 01:47:48 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:13.841 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.841 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:13.841 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.841 01:47:48 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:13.841 01:47:48 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:13.841 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.841 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:13.841 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.841 01:47:48 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:13.841 { 00:05:13.841 "name": "Malloc1", 00:05:13.841 "aliases": [ 00:05:13.841 "f5935b85-2a87-4ee6-bcc6-7d626b1fe133" 00:05:13.841 ], 00:05:13.841 "product_name": "Malloc disk", 00:05:13.841 "block_size": 4096, 00:05:13.841 "num_blocks": 256, 00:05:13.841 "uuid": "f5935b85-2a87-4ee6-bcc6-7d626b1fe133", 00:05:13.841 "assigned_rate_limits": { 00:05:13.841 "rw_ios_per_sec": 0, 00:05:13.841 "rw_mbytes_per_sec": 0, 00:05:13.841 "r_mbytes_per_sec": 0, 00:05:13.841 "w_mbytes_per_sec": 0 00:05:13.841 }, 00:05:13.841 "claimed": false, 00:05:13.841 "zoned": false, 00:05:13.841 "supported_io_types": { 00:05:13.841 "read": true, 00:05:13.841 "write": true, 00:05:13.841 "unmap": true, 00:05:13.841 "write_zeroes": true, 00:05:13.841 "flush": true, 00:05:13.841 "reset": true, 00:05:13.841 "compare": false, 00:05:13.841 "compare_and_write": false, 00:05:13.841 "abort": true, 00:05:13.841 "nvme_admin": false, 00:05:13.841 "nvme_io": false 00:05:13.841 }, 00:05:13.841 "memory_domains": [ 00:05:13.841 { 00:05:13.841 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:13.841 "dma_device_type": 2 00:05:13.841 } 00:05:13.841 ], 00:05:13.841 "driver_specific": {} 00:05:13.841 } 00:05:13.841 ]' 00:05:13.841 01:47:48 -- rpc/rpc.sh@32 -- # jq length 00:05:13.841 01:47:48 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:13.841 01:47:48 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:13.841 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.841 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:13.841 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.841 01:47:48 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:13.841 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.841 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:13.841 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.841 01:47:48 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:13.841 01:47:48 -- rpc/rpc.sh@36 -- # jq length 00:05:13.841 01:47:48 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:13.841 00:05:13.841 real 0m0.103s 00:05:13.841 user 0m0.067s 00:05:13.841 sys 0m0.006s 00:05:13.841 01:47:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.841 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:13.841 ************************************ 00:05:13.841 END TEST rpc_plugins 00:05:13.841 ************************************ 00:05:13.841 01:47:48 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:13.841 01:47:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.841 01:47:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.841 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:13.841 ************************************ 00:05:13.841 START TEST rpc_trace_cmd_test 00:05:13.841 ************************************ 00:05:13.841 01:47:48 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:13.841 01:47:48 -- rpc/rpc.sh@40 -- # local info 00:05:13.841 01:47:48 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:13.841 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.841 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:13.841 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.841 01:47:48 -- rpc/rpc.sh@42 -- # info='{ 00:05:13.841 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1078728", 00:05:13.841 "tpoint_group_mask": "0x8", 00:05:13.841 "iscsi_conn": { 00:05:13.841 "mask": "0x2", 00:05:13.841 "tpoint_mask": "0x0" 00:05:13.841 }, 00:05:13.841 "scsi": { 00:05:13.841 "mask": "0x4", 00:05:13.841 "tpoint_mask": "0x0" 00:05:13.841 }, 00:05:13.841 "bdev": { 00:05:13.841 "mask": "0x8", 00:05:13.841 "tpoint_mask": "0xffffffffffffffff" 00:05:13.841 }, 00:05:13.841 "nvmf_rdma": { 00:05:13.841 "mask": "0x10", 00:05:13.841 "tpoint_mask": "0x0" 00:05:13.841 }, 00:05:13.841 "nvmf_tcp": { 00:05:13.841 "mask": "0x20", 00:05:13.841 "tpoint_mask": "0x0" 00:05:13.841 }, 00:05:13.841 "ftl": { 00:05:13.841 "mask": "0x40", 00:05:13.841 "tpoint_mask": "0x0" 00:05:13.841 }, 00:05:13.841 "blobfs": { 00:05:13.841 "mask": "0x80", 00:05:13.841 "tpoint_mask": "0x0" 00:05:13.841 }, 00:05:13.841 "dsa": { 00:05:13.841 "mask": "0x200", 00:05:13.841 "tpoint_mask": "0x0" 00:05:13.841 }, 00:05:13.841 "thread": { 00:05:13.841 "mask": "0x400", 00:05:13.841 "tpoint_mask": "0x0" 00:05:13.841 }, 00:05:13.841 "nvme_pcie": { 00:05:13.841 "mask": "0x800", 00:05:13.841 "tpoint_mask": "0x0" 00:05:13.841 }, 00:05:13.841 "iaa": { 00:05:13.841 "mask": "0x1000", 00:05:13.841 "tpoint_mask": "0x0" 00:05:13.841 }, 00:05:13.841 "nvme_tcp": { 00:05:13.841 "mask": "0x2000", 00:05:13.841 "tpoint_mask": "0x0" 00:05:13.841 }, 00:05:13.841 "bdev_nvme": { 00:05:13.841 "mask": "0x4000", 00:05:13.841 "tpoint_mask": "0x0" 00:05:13.841 } 00:05:13.841 }' 00:05:13.842 01:47:48 -- rpc/rpc.sh@43 -- # jq length 00:05:13.842 01:47:48 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:13.842 01:47:48 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:14.100 01:47:48 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:14.100 01:47:48 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:14.100 01:47:48 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:14.100 01:47:48 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:14.100 01:47:48 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:14.100 01:47:48 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:14.100 01:47:48 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:14.100 00:05:14.100 real 0m0.183s 00:05:14.100 user 0m0.158s 00:05:14.100 sys 0m0.016s 00:05:14.100 01:47:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.100 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:14.100 ************************************ 00:05:14.100 END TEST rpc_trace_cmd_test 00:05:14.100 ************************************ 00:05:14.100 01:47:48 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:14.100 01:47:48 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:14.100 01:47:48 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:14.100 01:47:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.100 01:47:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.100 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:14.100 ************************************ 00:05:14.100 START TEST rpc_daemon_integrity 00:05:14.100 ************************************ 00:05:14.100 01:47:48 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:14.100 01:47:48 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:14.100 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:14.100 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:14.100 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:14.100 01:47:48 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:14.100 01:47:48 -- rpc/rpc.sh@13 -- # jq length 00:05:14.100 01:47:48 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:14.100 01:47:48 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:14.100 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:14.100 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:14.100 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:14.100 01:47:48 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:14.100 01:47:48 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:14.100 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:14.100 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:14.100 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:14.100 01:47:48 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:14.100 { 00:05:14.100 "name": "Malloc2", 00:05:14.100 "aliases": [ 00:05:14.100 "88cc619a-2f3c-41ab-874c-cfbc23491a90" 00:05:14.100 ], 00:05:14.100 "product_name": "Malloc disk", 00:05:14.100 "block_size": 512, 00:05:14.100 "num_blocks": 16384, 00:05:14.100 "uuid": "88cc619a-2f3c-41ab-874c-cfbc23491a90", 00:05:14.100 "assigned_rate_limits": { 00:05:14.100 "rw_ios_per_sec": 0, 00:05:14.100 "rw_mbytes_per_sec": 0, 00:05:14.100 "r_mbytes_per_sec": 0, 00:05:14.100 "w_mbytes_per_sec": 0 00:05:14.100 }, 00:05:14.100 "claimed": false, 00:05:14.100 "zoned": false, 00:05:14.100 "supported_io_types": { 00:05:14.100 "read": true, 00:05:14.100 "write": true, 00:05:14.100 "unmap": true, 00:05:14.100 "write_zeroes": true, 00:05:14.100 "flush": true, 00:05:14.100 "reset": true, 00:05:14.100 "compare": false, 00:05:14.100 "compare_and_write": false, 00:05:14.100 "abort": true, 00:05:14.100 "nvme_admin": false, 00:05:14.100 "nvme_io": false 00:05:14.100 }, 00:05:14.100 "memory_domains": [ 00:05:14.100 { 00:05:14.100 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:14.100 "dma_device_type": 2 00:05:14.100 } 00:05:14.100 ], 00:05:14.100 "driver_specific": {} 00:05:14.100 } 00:05:14.100 ]' 00:05:14.100 01:47:48 -- rpc/rpc.sh@17 -- # jq length 00:05:14.100 01:47:48 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:14.100 01:47:48 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:14.100 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:14.100 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:14.100 [2024-11-18 01:47:48.477469] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:14.100 [2024-11-18 01:47:48.477513] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:14.100 [2024-11-18 01:47:48.477539] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x21f7ec0 00:05:14.100 [2024-11-18 01:47:48.477553] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:14.100 [2024-11-18 01:47:48.478680] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:14.100 [2024-11-18 01:47:48.478703] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:14.100 Passthru0 00:05:14.100 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:14.100 01:47:48 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:14.100 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:14.100 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:14.100 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:14.100 01:47:48 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:14.100 { 00:05:14.100 "name": "Malloc2", 00:05:14.100 "aliases": [ 00:05:14.100 "88cc619a-2f3c-41ab-874c-cfbc23491a90" 00:05:14.100 ], 00:05:14.100 "product_name": "Malloc disk", 00:05:14.100 "block_size": 512, 00:05:14.100 "num_blocks": 16384, 00:05:14.100 "uuid": "88cc619a-2f3c-41ab-874c-cfbc23491a90", 00:05:14.100 "assigned_rate_limits": { 00:05:14.100 "rw_ios_per_sec": 0, 00:05:14.100 "rw_mbytes_per_sec": 0, 00:05:14.100 "r_mbytes_per_sec": 0, 00:05:14.100 "w_mbytes_per_sec": 0 00:05:14.100 }, 00:05:14.100 "claimed": true, 00:05:14.100 "claim_type": "exclusive_write", 00:05:14.100 "zoned": false, 00:05:14.100 "supported_io_types": { 00:05:14.100 "read": true, 00:05:14.100 "write": true, 00:05:14.100 "unmap": true, 00:05:14.100 "write_zeroes": true, 00:05:14.100 "flush": true, 00:05:14.100 "reset": true, 00:05:14.100 "compare": false, 00:05:14.100 "compare_and_write": false, 00:05:14.100 "abort": true, 00:05:14.100 "nvme_admin": false, 00:05:14.100 "nvme_io": false 00:05:14.100 }, 00:05:14.100 "memory_domains": [ 00:05:14.100 { 00:05:14.100 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:14.100 "dma_device_type": 2 00:05:14.100 } 00:05:14.100 ], 00:05:14.100 "driver_specific": {} 00:05:14.100 }, 00:05:14.100 { 00:05:14.100 "name": "Passthru0", 00:05:14.100 "aliases": [ 00:05:14.100 "76796a45-a437-5eb6-a124-4eb858e63013" 00:05:14.100 ], 00:05:14.100 "product_name": "passthru", 00:05:14.100 "block_size": 512, 00:05:14.100 "num_blocks": 16384, 00:05:14.100 "uuid": "76796a45-a437-5eb6-a124-4eb858e63013", 00:05:14.100 "assigned_rate_limits": { 00:05:14.100 "rw_ios_per_sec": 0, 00:05:14.100 "rw_mbytes_per_sec": 0, 00:05:14.100 "r_mbytes_per_sec": 0, 00:05:14.100 "w_mbytes_per_sec": 0 00:05:14.100 }, 00:05:14.100 "claimed": false, 00:05:14.100 "zoned": false, 00:05:14.100 "supported_io_types": { 00:05:14.100 "read": true, 00:05:14.100 "write": true, 00:05:14.100 "unmap": true, 00:05:14.100 "write_zeroes": true, 00:05:14.100 "flush": true, 00:05:14.100 "reset": true, 00:05:14.100 "compare": false, 00:05:14.100 "compare_and_write": false, 00:05:14.100 "abort": true, 00:05:14.101 "nvme_admin": false, 00:05:14.101 "nvme_io": false 00:05:14.101 }, 00:05:14.101 "memory_domains": [ 00:05:14.101 { 00:05:14.101 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:14.101 "dma_device_type": 2 00:05:14.101 } 00:05:14.101 ], 00:05:14.101 "driver_specific": { 00:05:14.101 "passthru": { 00:05:14.101 "name": "Passthru0", 00:05:14.101 "base_bdev_name": "Malloc2" 00:05:14.101 } 00:05:14.101 } 00:05:14.101 } 00:05:14.101 ]' 00:05:14.101 01:47:48 -- rpc/rpc.sh@21 -- # jq length 00:05:14.358 01:47:48 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:14.358 01:47:48 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:14.358 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:14.358 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:14.358 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:14.358 01:47:48 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:14.358 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:14.358 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:14.358 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:14.359 01:47:48 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:14.359 01:47:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:14.359 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:14.359 01:47:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:14.359 01:47:48 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:14.359 01:47:48 -- rpc/rpc.sh@26 -- # jq length 00:05:14.359 01:47:48 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:14.359 00:05:14.359 real 0m0.217s 00:05:14.359 user 0m0.140s 00:05:14.359 sys 0m0.019s 00:05:14.359 01:47:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.359 01:47:48 -- common/autotest_common.sh@10 -- # set +x 00:05:14.359 ************************************ 00:05:14.359 END TEST rpc_daemon_integrity 00:05:14.359 ************************************ 00:05:14.359 01:47:48 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:14.359 01:47:48 -- rpc/rpc.sh@84 -- # killprocess 1078728 00:05:14.359 01:47:48 -- common/autotest_common.sh@936 -- # '[' -z 1078728 ']' 00:05:14.359 01:47:48 -- common/autotest_common.sh@940 -- # kill -0 1078728 00:05:14.359 01:47:48 -- common/autotest_common.sh@941 -- # uname 00:05:14.359 01:47:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:14.359 01:47:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1078728 00:05:14.359 01:47:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:14.359 01:47:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:14.359 01:47:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1078728' 00:05:14.359 killing process with pid 1078728 00:05:14.359 01:47:48 -- common/autotest_common.sh@955 -- # kill 1078728 00:05:14.359 01:47:48 -- common/autotest_common.sh@960 -- # wait 1078728 00:05:14.924 00:05:14.924 real 0m2.389s 00:05:14.924 user 0m3.013s 00:05:14.924 sys 0m0.573s 00:05:14.924 01:47:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.924 01:47:49 -- common/autotest_common.sh@10 -- # set +x 00:05:14.924 ************************************ 00:05:14.924 END TEST rpc 00:05:14.924 ************************************ 00:05:14.924 01:47:49 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:14.924 01:47:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.924 01:47:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.924 01:47:49 -- common/autotest_common.sh@10 -- # set +x 00:05:14.924 ************************************ 00:05:14.924 START TEST rpc_client 00:05:14.924 ************************************ 00:05:14.924 01:47:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:14.924 * Looking for test storage... 00:05:14.924 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:14.924 01:47:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:14.924 01:47:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:14.924 01:47:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:14.924 01:47:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:14.924 01:47:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:14.924 01:47:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:14.924 01:47:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:14.924 01:47:49 -- scripts/common.sh@335 -- # IFS=.-: 00:05:14.924 01:47:49 -- scripts/common.sh@335 -- # read -ra ver1 00:05:14.924 01:47:49 -- scripts/common.sh@336 -- # IFS=.-: 00:05:14.924 01:47:49 -- scripts/common.sh@336 -- # read -ra ver2 00:05:14.924 01:47:49 -- scripts/common.sh@337 -- # local 'op=<' 00:05:14.924 01:47:49 -- scripts/common.sh@339 -- # ver1_l=2 00:05:14.924 01:47:49 -- scripts/common.sh@340 -- # ver2_l=1 00:05:14.924 01:47:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:14.924 01:47:49 -- scripts/common.sh@343 -- # case "$op" in 00:05:14.924 01:47:49 -- scripts/common.sh@344 -- # : 1 00:05:14.924 01:47:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:14.924 01:47:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:14.924 01:47:49 -- scripts/common.sh@364 -- # decimal 1 00:05:14.924 01:47:49 -- scripts/common.sh@352 -- # local d=1 00:05:14.924 01:47:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:14.924 01:47:49 -- scripts/common.sh@354 -- # echo 1 00:05:14.924 01:47:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:14.924 01:47:49 -- scripts/common.sh@365 -- # decimal 2 00:05:14.924 01:47:49 -- scripts/common.sh@352 -- # local d=2 00:05:14.924 01:47:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:14.924 01:47:49 -- scripts/common.sh@354 -- # echo 2 00:05:14.924 01:47:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:14.924 01:47:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:14.924 01:47:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:14.924 01:47:49 -- scripts/common.sh@367 -- # return 0 00:05:14.924 01:47:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:14.924 01:47:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:14.924 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.924 --rc genhtml_branch_coverage=1 00:05:14.924 --rc genhtml_function_coverage=1 00:05:14.924 --rc genhtml_legend=1 00:05:14.924 --rc geninfo_all_blocks=1 00:05:14.924 --rc geninfo_unexecuted_blocks=1 00:05:14.924 00:05:14.924 ' 00:05:14.924 01:47:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:14.924 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.924 --rc genhtml_branch_coverage=1 00:05:14.924 --rc genhtml_function_coverage=1 00:05:14.924 --rc genhtml_legend=1 00:05:14.924 --rc geninfo_all_blocks=1 00:05:14.924 --rc geninfo_unexecuted_blocks=1 00:05:14.924 00:05:14.924 ' 00:05:14.924 01:47:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:14.924 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.924 --rc genhtml_branch_coverage=1 00:05:14.924 --rc genhtml_function_coverage=1 00:05:14.924 --rc genhtml_legend=1 00:05:14.924 --rc geninfo_all_blocks=1 00:05:14.924 --rc geninfo_unexecuted_blocks=1 00:05:14.924 00:05:14.924 ' 00:05:14.924 01:47:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:14.924 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.924 --rc genhtml_branch_coverage=1 00:05:14.924 --rc genhtml_function_coverage=1 00:05:14.924 --rc genhtml_legend=1 00:05:14.924 --rc geninfo_all_blocks=1 00:05:14.924 --rc geninfo_unexecuted_blocks=1 00:05:14.925 00:05:14.925 ' 00:05:14.925 01:47:49 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:14.925 OK 00:05:14.925 01:47:49 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:14.925 00:05:14.925 real 0m0.151s 00:05:14.925 user 0m0.106s 00:05:14.925 sys 0m0.052s 00:05:14.925 01:47:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.925 01:47:49 -- common/autotest_common.sh@10 -- # set +x 00:05:14.925 ************************************ 00:05:14.925 END TEST rpc_client 00:05:14.925 ************************************ 00:05:14.925 01:47:49 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:14.925 01:47:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.925 01:47:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.925 01:47:49 -- common/autotest_common.sh@10 -- # set +x 00:05:14.925 ************************************ 00:05:14.925 START TEST json_config 00:05:14.925 ************************************ 00:05:14.925 01:47:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:14.925 01:47:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:14.925 01:47:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:14.925 01:47:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:15.183 01:47:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:15.183 01:47:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:15.183 01:47:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:15.183 01:47:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:15.183 01:47:49 -- scripts/common.sh@335 -- # IFS=.-: 00:05:15.184 01:47:49 -- scripts/common.sh@335 -- # read -ra ver1 00:05:15.184 01:47:49 -- scripts/common.sh@336 -- # IFS=.-: 00:05:15.184 01:47:49 -- scripts/common.sh@336 -- # read -ra ver2 00:05:15.184 01:47:49 -- scripts/common.sh@337 -- # local 'op=<' 00:05:15.184 01:47:49 -- scripts/common.sh@339 -- # ver1_l=2 00:05:15.184 01:47:49 -- scripts/common.sh@340 -- # ver2_l=1 00:05:15.184 01:47:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:15.184 01:47:49 -- scripts/common.sh@343 -- # case "$op" in 00:05:15.184 01:47:49 -- scripts/common.sh@344 -- # : 1 00:05:15.184 01:47:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:15.184 01:47:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:15.184 01:47:49 -- scripts/common.sh@364 -- # decimal 1 00:05:15.184 01:47:49 -- scripts/common.sh@352 -- # local d=1 00:05:15.184 01:47:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:15.184 01:47:49 -- scripts/common.sh@354 -- # echo 1 00:05:15.184 01:47:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:15.184 01:47:49 -- scripts/common.sh@365 -- # decimal 2 00:05:15.184 01:47:49 -- scripts/common.sh@352 -- # local d=2 00:05:15.184 01:47:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:15.184 01:47:49 -- scripts/common.sh@354 -- # echo 2 00:05:15.184 01:47:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:15.184 01:47:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:15.184 01:47:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:15.184 01:47:49 -- scripts/common.sh@367 -- # return 0 00:05:15.184 01:47:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:15.184 01:47:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:15.184 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:15.184 --rc genhtml_branch_coverage=1 00:05:15.184 --rc genhtml_function_coverage=1 00:05:15.184 --rc genhtml_legend=1 00:05:15.184 --rc geninfo_all_blocks=1 00:05:15.184 --rc geninfo_unexecuted_blocks=1 00:05:15.184 00:05:15.184 ' 00:05:15.184 01:47:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:15.184 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:15.184 --rc genhtml_branch_coverage=1 00:05:15.184 --rc genhtml_function_coverage=1 00:05:15.184 --rc genhtml_legend=1 00:05:15.184 --rc geninfo_all_blocks=1 00:05:15.184 --rc geninfo_unexecuted_blocks=1 00:05:15.184 00:05:15.184 ' 00:05:15.184 01:47:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:15.184 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:15.184 --rc genhtml_branch_coverage=1 00:05:15.184 --rc genhtml_function_coverage=1 00:05:15.184 --rc genhtml_legend=1 00:05:15.184 --rc geninfo_all_blocks=1 00:05:15.184 --rc geninfo_unexecuted_blocks=1 00:05:15.184 00:05:15.184 ' 00:05:15.184 01:47:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:15.184 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:15.184 --rc genhtml_branch_coverage=1 00:05:15.184 --rc genhtml_function_coverage=1 00:05:15.184 --rc genhtml_legend=1 00:05:15.184 --rc geninfo_all_blocks=1 00:05:15.184 --rc geninfo_unexecuted_blocks=1 00:05:15.184 00:05:15.184 ' 00:05:15.184 01:47:49 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:15.184 01:47:49 -- nvmf/common.sh@7 -- # uname -s 00:05:15.184 01:47:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:15.184 01:47:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:15.184 01:47:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:15.184 01:47:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:15.184 01:47:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:15.184 01:47:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:15.184 01:47:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:15.184 01:47:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:15.184 01:47:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:15.184 01:47:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:15.184 01:47:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:15.184 01:47:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:15.184 01:47:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:15.184 01:47:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:15.184 01:47:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:15.184 01:47:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:15.184 01:47:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:15.184 01:47:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:15.184 01:47:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:15.184 01:47:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:15.184 01:47:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:15.184 01:47:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:15.184 01:47:49 -- paths/export.sh@5 -- # export PATH 00:05:15.184 01:47:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:15.184 01:47:49 -- nvmf/common.sh@46 -- # : 0 00:05:15.184 01:47:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:15.184 01:47:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:15.184 01:47:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:15.184 01:47:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:15.184 01:47:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:15.184 01:47:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:15.184 01:47:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:15.184 01:47:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:15.184 01:47:49 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:15.184 01:47:49 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:15.184 01:47:49 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:15.184 01:47:49 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:15.184 01:47:49 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:15.184 01:47:49 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:15.184 01:47:49 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:15.184 01:47:49 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:15.184 01:47:49 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:15.184 01:47:49 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:15.184 01:47:49 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:15.184 01:47:49 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:15.184 01:47:49 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:15.184 01:47:49 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:15.184 01:47:49 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:15.184 INFO: JSON configuration test init 00:05:15.184 01:47:49 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:15.184 01:47:49 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:15.184 01:47:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:15.184 01:47:49 -- common/autotest_common.sh@10 -- # set +x 00:05:15.184 01:47:49 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:15.184 01:47:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:15.184 01:47:49 -- common/autotest_common.sh@10 -- # set +x 00:05:15.184 01:47:49 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:15.184 01:47:49 -- json_config/json_config.sh@98 -- # local app=target 00:05:15.184 01:47:49 -- json_config/json_config.sh@99 -- # shift 00:05:15.184 01:47:49 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:15.184 01:47:49 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:15.184 01:47:49 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:15.184 01:47:49 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:15.184 01:47:49 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:15.184 01:47:49 -- json_config/json_config.sh@111 -- # app_pid[$app]=1079236 00:05:15.184 01:47:49 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:15.184 01:47:49 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:15.184 Waiting for target to run... 00:05:15.184 01:47:49 -- json_config/json_config.sh@114 -- # waitforlisten 1079236 /var/tmp/spdk_tgt.sock 00:05:15.184 01:47:49 -- common/autotest_common.sh@829 -- # '[' -z 1079236 ']' 00:05:15.184 01:47:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:15.184 01:47:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:15.184 01:47:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:15.184 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:15.185 01:47:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:15.185 01:47:49 -- common/autotest_common.sh@10 -- # set +x 00:05:15.185 [2024-11-18 01:47:49.423627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:15.185 [2024-11-18 01:47:49.423704] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1079236 ] 00:05:15.185 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.443 [2024-11-18 01:47:49.775579] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:15.443 [2024-11-18 01:47:49.831599] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:15.443 [2024-11-18 01:47:49.831751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.008 01:47:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.008 01:47:50 -- common/autotest_common.sh@862 -- # return 0 00:05:16.008 01:47:50 -- json_config/json_config.sh@115 -- # echo '' 00:05:16.008 00:05:16.008 01:47:50 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:16.008 01:47:50 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:16.008 01:47:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:16.008 01:47:50 -- common/autotest_common.sh@10 -- # set +x 00:05:16.008 01:47:50 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:16.008 01:47:50 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:16.008 01:47:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:16.008 01:47:50 -- common/autotest_common.sh@10 -- # set +x 00:05:16.266 01:47:50 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:16.266 01:47:50 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:16.266 01:47:50 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:19.547 01:47:53 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:19.547 01:47:53 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:19.547 01:47:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:19.547 01:47:53 -- common/autotest_common.sh@10 -- # set +x 00:05:19.547 01:47:53 -- json_config/json_config.sh@48 -- # local ret=0 00:05:19.547 01:47:53 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:19.547 01:47:53 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:19.547 01:47:53 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:19.547 01:47:53 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:19.547 01:47:53 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:19.547 01:47:53 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:19.547 01:47:53 -- json_config/json_config.sh@51 -- # local get_types 00:05:19.547 01:47:53 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:19.547 01:47:53 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:19.547 01:47:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:19.547 01:47:53 -- common/autotest_common.sh@10 -- # set +x 00:05:19.547 01:47:53 -- json_config/json_config.sh@58 -- # return 0 00:05:19.547 01:47:53 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:19.547 01:47:53 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:19.547 01:47:53 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:19.547 01:47:53 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:19.547 01:47:53 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:19.547 01:47:53 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:19.547 01:47:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:19.547 01:47:53 -- common/autotest_common.sh@10 -- # set +x 00:05:19.547 01:47:53 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:19.547 01:47:53 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:19.547 01:47:53 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:19.547 01:47:53 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:19.547 01:47:53 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:19.805 MallocForNvmf0 00:05:19.805 01:47:54 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:19.805 01:47:54 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:20.063 MallocForNvmf1 00:05:20.063 01:47:54 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:20.063 01:47:54 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:20.321 [2024-11-18 01:47:54.552880] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:20.321 01:47:54 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:20.321 01:47:54 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:20.579 01:47:54 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:20.579 01:47:54 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:20.837 01:47:55 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:20.837 01:47:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:21.095 01:47:55 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:21.095 01:47:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:21.352 [2024-11-18 01:47:55.552150] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:21.352 01:47:55 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:21.352 01:47:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:21.352 01:47:55 -- common/autotest_common.sh@10 -- # set +x 00:05:21.353 01:47:55 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:21.353 01:47:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:21.353 01:47:55 -- common/autotest_common.sh@10 -- # set +x 00:05:21.353 01:47:55 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:21.353 01:47:55 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:21.353 01:47:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:21.611 MallocBdevForConfigChangeCheck 00:05:21.611 01:47:55 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:21.611 01:47:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:21.611 01:47:55 -- common/autotest_common.sh@10 -- # set +x 00:05:21.611 01:47:55 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:21.611 01:47:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:21.870 01:47:56 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:21.870 INFO: shutting down applications... 00:05:21.870 01:47:56 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:21.870 01:47:56 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:21.870 01:47:56 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:21.870 01:47:56 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:23.782 Calling clear_iscsi_subsystem 00:05:23.782 Calling clear_nvmf_subsystem 00:05:23.782 Calling clear_nbd_subsystem 00:05:23.782 Calling clear_ublk_subsystem 00:05:23.782 Calling clear_vhost_blk_subsystem 00:05:23.782 Calling clear_vhost_scsi_subsystem 00:05:23.782 Calling clear_scheduler_subsystem 00:05:23.782 Calling clear_bdev_subsystem 00:05:23.782 Calling clear_accel_subsystem 00:05:23.782 Calling clear_vmd_subsystem 00:05:23.782 Calling clear_sock_subsystem 00:05:23.782 Calling clear_iobuf_subsystem 00:05:23.782 01:47:57 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:23.782 01:47:57 -- json_config/json_config.sh@396 -- # count=100 00:05:23.782 01:47:57 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:23.782 01:47:57 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:23.782 01:47:57 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:23.782 01:47:57 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:24.042 01:47:58 -- json_config/json_config.sh@398 -- # break 00:05:24.042 01:47:58 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:24.042 01:47:58 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:24.042 01:47:58 -- json_config/json_config.sh@120 -- # local app=target 00:05:24.042 01:47:58 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:24.042 01:47:58 -- json_config/json_config.sh@124 -- # [[ -n 1079236 ]] 00:05:24.042 01:47:58 -- json_config/json_config.sh@127 -- # kill -SIGINT 1079236 00:05:24.042 01:47:58 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:24.042 01:47:58 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:24.042 01:47:58 -- json_config/json_config.sh@130 -- # kill -0 1079236 00:05:24.042 01:47:58 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:24.610 01:47:58 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:24.610 01:47:58 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:24.610 01:47:58 -- json_config/json_config.sh@130 -- # kill -0 1079236 00:05:24.610 01:47:58 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:24.610 01:47:58 -- json_config/json_config.sh@132 -- # break 00:05:24.610 01:47:58 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:24.610 01:47:58 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:24.610 SPDK target shutdown done 00:05:24.610 01:47:58 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:24.610 INFO: relaunching applications... 00:05:24.610 01:47:58 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:24.610 01:47:58 -- json_config/json_config.sh@98 -- # local app=target 00:05:24.610 01:47:58 -- json_config/json_config.sh@99 -- # shift 00:05:24.610 01:47:58 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:24.610 01:47:58 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:24.610 01:47:58 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:24.610 01:47:58 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:24.610 01:47:58 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:24.610 01:47:58 -- json_config/json_config.sh@111 -- # app_pid[$app]=1080456 00:05:24.610 01:47:58 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:24.610 01:47:58 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:24.610 Waiting for target to run... 00:05:24.610 01:47:58 -- json_config/json_config.sh@114 -- # waitforlisten 1080456 /var/tmp/spdk_tgt.sock 00:05:24.610 01:47:58 -- common/autotest_common.sh@829 -- # '[' -z 1080456 ']' 00:05:24.611 01:47:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:24.611 01:47:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:24.611 01:47:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:24.611 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:24.611 01:47:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:24.611 01:47:58 -- common/autotest_common.sh@10 -- # set +x 00:05:24.611 [2024-11-18 01:47:58.813976] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:24.611 [2024-11-18 01:47:58.814067] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1080456 ] 00:05:24.611 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.932 [2024-11-18 01:47:59.321222] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.191 [2024-11-18 01:47:59.394045] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:25.191 [2024-11-18 01:47:59.394206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.537 [2024-11-18 01:48:02.407090] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:28.537 [2024-11-18 01:48:02.439534] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:28.537 01:48:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:28.537 01:48:02 -- common/autotest_common.sh@862 -- # return 0 00:05:28.537 01:48:02 -- json_config/json_config.sh@115 -- # echo '' 00:05:28.537 00:05:28.537 01:48:02 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:28.537 01:48:02 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:28.537 INFO: Checking if target configuration is the same... 00:05:28.537 01:48:02 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:28.537 01:48:02 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:28.537 01:48:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:28.537 + '[' 2 -ne 2 ']' 00:05:28.537 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:28.537 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:28.537 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:28.537 +++ basename /dev/fd/62 00:05:28.537 ++ mktemp /tmp/62.XXX 00:05:28.537 + tmp_file_1=/tmp/62.6B0 00:05:28.537 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:28.537 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:28.537 + tmp_file_2=/tmp/spdk_tgt_config.json.j7N 00:05:28.537 + ret=0 00:05:28.537 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:28.795 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:29.054 + diff -u /tmp/62.6B0 /tmp/spdk_tgt_config.json.j7N 00:05:29.054 + echo 'INFO: JSON config files are the same' 00:05:29.054 INFO: JSON config files are the same 00:05:29.054 + rm /tmp/62.6B0 /tmp/spdk_tgt_config.json.j7N 00:05:29.054 + exit 0 00:05:29.054 01:48:03 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:29.054 01:48:03 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:29.054 INFO: changing configuration and checking if this can be detected... 00:05:29.054 01:48:03 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:29.054 01:48:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:29.312 01:48:03 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:29.312 01:48:03 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:29.312 01:48:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:29.312 + '[' 2 -ne 2 ']' 00:05:29.312 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:29.313 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:29.313 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:29.313 +++ basename /dev/fd/62 00:05:29.313 ++ mktemp /tmp/62.XXX 00:05:29.313 + tmp_file_1=/tmp/62.wau 00:05:29.313 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:29.313 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:29.313 + tmp_file_2=/tmp/spdk_tgt_config.json.RWD 00:05:29.313 + ret=0 00:05:29.313 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:29.570 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:29.570 + diff -u /tmp/62.wau /tmp/spdk_tgt_config.json.RWD 00:05:29.570 + ret=1 00:05:29.570 + echo '=== Start of file: /tmp/62.wau ===' 00:05:29.570 + cat /tmp/62.wau 00:05:29.570 + echo '=== End of file: /tmp/62.wau ===' 00:05:29.570 + echo '' 00:05:29.570 + echo '=== Start of file: /tmp/spdk_tgt_config.json.RWD ===' 00:05:29.570 + cat /tmp/spdk_tgt_config.json.RWD 00:05:29.570 + echo '=== End of file: /tmp/spdk_tgt_config.json.RWD ===' 00:05:29.570 + echo '' 00:05:29.570 + rm /tmp/62.wau /tmp/spdk_tgt_config.json.RWD 00:05:29.570 + exit 1 00:05:29.570 01:48:03 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:29.570 INFO: configuration change detected. 00:05:29.570 01:48:03 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:29.570 01:48:03 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:29.570 01:48:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:29.570 01:48:03 -- common/autotest_common.sh@10 -- # set +x 00:05:29.570 01:48:03 -- json_config/json_config.sh@360 -- # local ret=0 00:05:29.570 01:48:03 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:29.570 01:48:03 -- json_config/json_config.sh@370 -- # [[ -n 1080456 ]] 00:05:29.570 01:48:03 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:29.570 01:48:03 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:29.571 01:48:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:29.571 01:48:03 -- common/autotest_common.sh@10 -- # set +x 00:05:29.571 01:48:03 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:29.571 01:48:03 -- json_config/json_config.sh@246 -- # uname -s 00:05:29.571 01:48:03 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:29.571 01:48:03 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:29.571 01:48:03 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:29.571 01:48:03 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:29.571 01:48:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:29.571 01:48:03 -- common/autotest_common.sh@10 -- # set +x 00:05:29.571 01:48:03 -- json_config/json_config.sh@376 -- # killprocess 1080456 00:05:29.571 01:48:03 -- common/autotest_common.sh@936 -- # '[' -z 1080456 ']' 00:05:29.571 01:48:03 -- common/autotest_common.sh@940 -- # kill -0 1080456 00:05:29.571 01:48:03 -- common/autotest_common.sh@941 -- # uname 00:05:29.571 01:48:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:29.571 01:48:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1080456 00:05:29.829 01:48:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:29.829 01:48:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:29.829 01:48:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1080456' 00:05:29.829 killing process with pid 1080456 00:05:29.829 01:48:03 -- common/autotest_common.sh@955 -- # kill 1080456 00:05:29.829 01:48:03 -- common/autotest_common.sh@960 -- # wait 1080456 00:05:31.202 01:48:05 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:31.202 01:48:05 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:31.202 01:48:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:31.202 01:48:05 -- common/autotest_common.sh@10 -- # set +x 00:05:31.202 01:48:05 -- json_config/json_config.sh@381 -- # return 0 00:05:31.202 01:48:05 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:31.202 INFO: Success 00:05:31.202 00:05:31.202 real 0m16.325s 00:05:31.202 user 0m18.730s 00:05:31.202 sys 0m2.160s 00:05:31.202 01:48:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.202 01:48:05 -- common/autotest_common.sh@10 -- # set +x 00:05:31.202 ************************************ 00:05:31.202 END TEST json_config 00:05:31.202 ************************************ 00:05:31.202 01:48:05 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:31.202 01:48:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:31.202 01:48:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.202 01:48:05 -- common/autotest_common.sh@10 -- # set +x 00:05:31.202 ************************************ 00:05:31.202 START TEST json_config_extra_key 00:05:31.202 ************************************ 00:05:31.202 01:48:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:31.461 01:48:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:31.461 01:48:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:31.461 01:48:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:31.461 01:48:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:31.461 01:48:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:31.461 01:48:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:31.461 01:48:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:31.461 01:48:05 -- scripts/common.sh@335 -- # IFS=.-: 00:05:31.461 01:48:05 -- scripts/common.sh@335 -- # read -ra ver1 00:05:31.461 01:48:05 -- scripts/common.sh@336 -- # IFS=.-: 00:05:31.461 01:48:05 -- scripts/common.sh@336 -- # read -ra ver2 00:05:31.461 01:48:05 -- scripts/common.sh@337 -- # local 'op=<' 00:05:31.461 01:48:05 -- scripts/common.sh@339 -- # ver1_l=2 00:05:31.461 01:48:05 -- scripts/common.sh@340 -- # ver2_l=1 00:05:31.461 01:48:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:31.461 01:48:05 -- scripts/common.sh@343 -- # case "$op" in 00:05:31.461 01:48:05 -- scripts/common.sh@344 -- # : 1 00:05:31.461 01:48:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:31.461 01:48:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:31.461 01:48:05 -- scripts/common.sh@364 -- # decimal 1 00:05:31.461 01:48:05 -- scripts/common.sh@352 -- # local d=1 00:05:31.461 01:48:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:31.461 01:48:05 -- scripts/common.sh@354 -- # echo 1 00:05:31.461 01:48:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:31.461 01:48:05 -- scripts/common.sh@365 -- # decimal 2 00:05:31.461 01:48:05 -- scripts/common.sh@352 -- # local d=2 00:05:31.461 01:48:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:31.461 01:48:05 -- scripts/common.sh@354 -- # echo 2 00:05:31.461 01:48:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:31.461 01:48:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:31.461 01:48:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:31.461 01:48:05 -- scripts/common.sh@367 -- # return 0 00:05:31.461 01:48:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:31.462 01:48:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:31.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.462 --rc genhtml_branch_coverage=1 00:05:31.462 --rc genhtml_function_coverage=1 00:05:31.462 --rc genhtml_legend=1 00:05:31.462 --rc geninfo_all_blocks=1 00:05:31.462 --rc geninfo_unexecuted_blocks=1 00:05:31.462 00:05:31.462 ' 00:05:31.462 01:48:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:31.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.462 --rc genhtml_branch_coverage=1 00:05:31.462 --rc genhtml_function_coverage=1 00:05:31.462 --rc genhtml_legend=1 00:05:31.462 --rc geninfo_all_blocks=1 00:05:31.462 --rc geninfo_unexecuted_blocks=1 00:05:31.462 00:05:31.462 ' 00:05:31.462 01:48:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:31.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.462 --rc genhtml_branch_coverage=1 00:05:31.462 --rc genhtml_function_coverage=1 00:05:31.462 --rc genhtml_legend=1 00:05:31.462 --rc geninfo_all_blocks=1 00:05:31.462 --rc geninfo_unexecuted_blocks=1 00:05:31.462 00:05:31.462 ' 00:05:31.462 01:48:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:31.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.462 --rc genhtml_branch_coverage=1 00:05:31.462 --rc genhtml_function_coverage=1 00:05:31.462 --rc genhtml_legend=1 00:05:31.462 --rc geninfo_all_blocks=1 00:05:31.462 --rc geninfo_unexecuted_blocks=1 00:05:31.462 00:05:31.462 ' 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:31.462 01:48:05 -- nvmf/common.sh@7 -- # uname -s 00:05:31.462 01:48:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:31.462 01:48:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:31.462 01:48:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:31.462 01:48:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:31.462 01:48:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:31.462 01:48:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:31.462 01:48:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:31.462 01:48:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:31.462 01:48:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:31.462 01:48:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:31.462 01:48:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:31.462 01:48:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:31.462 01:48:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:31.462 01:48:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:31.462 01:48:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:31.462 01:48:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:31.462 01:48:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:31.462 01:48:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:31.462 01:48:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:31.462 01:48:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:31.462 01:48:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:31.462 01:48:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:31.462 01:48:05 -- paths/export.sh@5 -- # export PATH 00:05:31.462 01:48:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:31.462 01:48:05 -- nvmf/common.sh@46 -- # : 0 00:05:31.462 01:48:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:31.462 01:48:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:31.462 01:48:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:31.462 01:48:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:31.462 01:48:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:31.462 01:48:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:31.462 01:48:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:31.462 01:48:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:31.462 INFO: launching applications... 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1081646 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:31.462 Waiting for target to run... 00:05:31.462 01:48:05 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1081646 /var/tmp/spdk_tgt.sock 00:05:31.462 01:48:05 -- common/autotest_common.sh@829 -- # '[' -z 1081646 ']' 00:05:31.462 01:48:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:31.462 01:48:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:31.462 01:48:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:31.462 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:31.462 01:48:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:31.462 01:48:05 -- common/autotest_common.sh@10 -- # set +x 00:05:31.462 [2024-11-18 01:48:05.781352] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:31.462 [2024-11-18 01:48:05.781430] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1081646 ] 00:05:31.462 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.720 [2024-11-18 01:48:06.115911] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.979 [2024-11-18 01:48:06.171739] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:31.979 [2024-11-18 01:48:06.171889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.544 01:48:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:32.544 01:48:06 -- common/autotest_common.sh@862 -- # return 0 00:05:32.544 01:48:06 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:32.544 00:05:32.544 01:48:06 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:32.544 INFO: shutting down applications... 00:05:32.544 01:48:06 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:32.544 01:48:06 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:32.544 01:48:06 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:32.544 01:48:06 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1081646 ]] 00:05:32.544 01:48:06 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1081646 00:05:32.544 01:48:06 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:32.544 01:48:06 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:32.544 01:48:06 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1081646 00:05:32.544 01:48:06 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:33.113 01:48:07 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:33.113 01:48:07 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:33.113 01:48:07 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1081646 00:05:33.113 01:48:07 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:33.113 01:48:07 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:33.113 01:48:07 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:33.113 01:48:07 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:33.113 SPDK target shutdown done 00:05:33.113 01:48:07 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:33.113 Success 00:05:33.113 00:05:33.113 real 0m1.647s 00:05:33.113 user 0m1.591s 00:05:33.113 sys 0m0.432s 00:05:33.113 01:48:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.113 01:48:07 -- common/autotest_common.sh@10 -- # set +x 00:05:33.113 ************************************ 00:05:33.113 END TEST json_config_extra_key 00:05:33.113 ************************************ 00:05:33.113 01:48:07 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:33.113 01:48:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.113 01:48:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.113 01:48:07 -- common/autotest_common.sh@10 -- # set +x 00:05:33.113 ************************************ 00:05:33.113 START TEST alias_rpc 00:05:33.113 ************************************ 00:05:33.113 01:48:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:33.113 * Looking for test storage... 00:05:33.113 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:33.113 01:48:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:33.113 01:48:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:33.113 01:48:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:33.113 01:48:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:33.113 01:48:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:33.113 01:48:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:33.113 01:48:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:33.113 01:48:07 -- scripts/common.sh@335 -- # IFS=.-: 00:05:33.113 01:48:07 -- scripts/common.sh@335 -- # read -ra ver1 00:05:33.113 01:48:07 -- scripts/common.sh@336 -- # IFS=.-: 00:05:33.113 01:48:07 -- scripts/common.sh@336 -- # read -ra ver2 00:05:33.113 01:48:07 -- scripts/common.sh@337 -- # local 'op=<' 00:05:33.113 01:48:07 -- scripts/common.sh@339 -- # ver1_l=2 00:05:33.113 01:48:07 -- scripts/common.sh@340 -- # ver2_l=1 00:05:33.113 01:48:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:33.113 01:48:07 -- scripts/common.sh@343 -- # case "$op" in 00:05:33.113 01:48:07 -- scripts/common.sh@344 -- # : 1 00:05:33.113 01:48:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:33.113 01:48:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:33.113 01:48:07 -- scripts/common.sh@364 -- # decimal 1 00:05:33.113 01:48:07 -- scripts/common.sh@352 -- # local d=1 00:05:33.113 01:48:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:33.113 01:48:07 -- scripts/common.sh@354 -- # echo 1 00:05:33.113 01:48:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:33.113 01:48:07 -- scripts/common.sh@365 -- # decimal 2 00:05:33.113 01:48:07 -- scripts/common.sh@352 -- # local d=2 00:05:33.113 01:48:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:33.113 01:48:07 -- scripts/common.sh@354 -- # echo 2 00:05:33.114 01:48:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:33.114 01:48:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:33.114 01:48:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:33.114 01:48:07 -- scripts/common.sh@367 -- # return 0 00:05:33.114 01:48:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:33.114 01:48:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:33.114 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.114 --rc genhtml_branch_coverage=1 00:05:33.114 --rc genhtml_function_coverage=1 00:05:33.114 --rc genhtml_legend=1 00:05:33.114 --rc geninfo_all_blocks=1 00:05:33.114 --rc geninfo_unexecuted_blocks=1 00:05:33.114 00:05:33.114 ' 00:05:33.114 01:48:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:33.114 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.114 --rc genhtml_branch_coverage=1 00:05:33.114 --rc genhtml_function_coverage=1 00:05:33.114 --rc genhtml_legend=1 00:05:33.114 --rc geninfo_all_blocks=1 00:05:33.114 --rc geninfo_unexecuted_blocks=1 00:05:33.114 00:05:33.114 ' 00:05:33.114 01:48:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:33.114 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.114 --rc genhtml_branch_coverage=1 00:05:33.114 --rc genhtml_function_coverage=1 00:05:33.114 --rc genhtml_legend=1 00:05:33.114 --rc geninfo_all_blocks=1 00:05:33.114 --rc geninfo_unexecuted_blocks=1 00:05:33.114 00:05:33.114 ' 00:05:33.114 01:48:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:33.114 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.114 --rc genhtml_branch_coverage=1 00:05:33.114 --rc genhtml_function_coverage=1 00:05:33.114 --rc genhtml_legend=1 00:05:33.114 --rc geninfo_all_blocks=1 00:05:33.114 --rc geninfo_unexecuted_blocks=1 00:05:33.114 00:05:33.114 ' 00:05:33.114 01:48:07 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:33.114 01:48:07 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:33.114 01:48:07 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1081998 00:05:33.114 01:48:07 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1081998 00:05:33.114 01:48:07 -- common/autotest_common.sh@829 -- # '[' -z 1081998 ']' 00:05:33.114 01:48:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:33.114 01:48:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:33.114 01:48:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:33.114 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:33.114 01:48:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:33.114 01:48:07 -- common/autotest_common.sh@10 -- # set +x 00:05:33.114 [2024-11-18 01:48:07.457085] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:33.114 [2024-11-18 01:48:07.457160] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1081998 ] 00:05:33.114 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.372 [2024-11-18 01:48:07.517072] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.372 [2024-11-18 01:48:07.604816] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:33.372 [2024-11-18 01:48:07.604964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.307 01:48:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:34.307 01:48:08 -- common/autotest_common.sh@862 -- # return 0 00:05:34.307 01:48:08 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:34.307 01:48:08 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1081998 00:05:34.307 01:48:08 -- common/autotest_common.sh@936 -- # '[' -z 1081998 ']' 00:05:34.307 01:48:08 -- common/autotest_common.sh@940 -- # kill -0 1081998 00:05:34.307 01:48:08 -- common/autotest_common.sh@941 -- # uname 00:05:34.307 01:48:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:34.307 01:48:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1081998 00:05:34.565 01:48:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:34.565 01:48:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:34.565 01:48:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1081998' 00:05:34.565 killing process with pid 1081998 00:05:34.565 01:48:08 -- common/autotest_common.sh@955 -- # kill 1081998 00:05:34.565 01:48:08 -- common/autotest_common.sh@960 -- # wait 1081998 00:05:34.823 00:05:34.823 real 0m1.833s 00:05:34.823 user 0m2.151s 00:05:34.823 sys 0m0.456s 00:05:34.823 01:48:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.823 01:48:09 -- common/autotest_common.sh@10 -- # set +x 00:05:34.823 ************************************ 00:05:34.823 END TEST alias_rpc 00:05:34.823 ************************************ 00:05:34.823 01:48:09 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:05:34.824 01:48:09 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:34.824 01:48:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.824 01:48:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.824 01:48:09 -- common/autotest_common.sh@10 -- # set +x 00:05:34.824 ************************************ 00:05:34.824 START TEST spdkcli_tcp 00:05:34.824 ************************************ 00:05:34.824 01:48:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:34.824 * Looking for test storage... 00:05:34.824 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:34.824 01:48:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:34.824 01:48:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:34.824 01:48:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:35.082 01:48:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:35.082 01:48:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:35.082 01:48:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:35.082 01:48:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:35.082 01:48:09 -- scripts/common.sh@335 -- # IFS=.-: 00:05:35.082 01:48:09 -- scripts/common.sh@335 -- # read -ra ver1 00:05:35.082 01:48:09 -- scripts/common.sh@336 -- # IFS=.-: 00:05:35.082 01:48:09 -- scripts/common.sh@336 -- # read -ra ver2 00:05:35.082 01:48:09 -- scripts/common.sh@337 -- # local 'op=<' 00:05:35.082 01:48:09 -- scripts/common.sh@339 -- # ver1_l=2 00:05:35.082 01:48:09 -- scripts/common.sh@340 -- # ver2_l=1 00:05:35.082 01:48:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:35.082 01:48:09 -- scripts/common.sh@343 -- # case "$op" in 00:05:35.082 01:48:09 -- scripts/common.sh@344 -- # : 1 00:05:35.082 01:48:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:35.082 01:48:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:35.082 01:48:09 -- scripts/common.sh@364 -- # decimal 1 00:05:35.082 01:48:09 -- scripts/common.sh@352 -- # local d=1 00:05:35.082 01:48:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:35.082 01:48:09 -- scripts/common.sh@354 -- # echo 1 00:05:35.082 01:48:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:35.082 01:48:09 -- scripts/common.sh@365 -- # decimal 2 00:05:35.082 01:48:09 -- scripts/common.sh@352 -- # local d=2 00:05:35.082 01:48:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:35.082 01:48:09 -- scripts/common.sh@354 -- # echo 2 00:05:35.082 01:48:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:35.082 01:48:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:35.082 01:48:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:35.082 01:48:09 -- scripts/common.sh@367 -- # return 0 00:05:35.082 01:48:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:35.082 01:48:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:35.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:35.082 --rc genhtml_branch_coverage=1 00:05:35.082 --rc genhtml_function_coverage=1 00:05:35.082 --rc genhtml_legend=1 00:05:35.082 --rc geninfo_all_blocks=1 00:05:35.082 --rc geninfo_unexecuted_blocks=1 00:05:35.082 00:05:35.082 ' 00:05:35.082 01:48:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:35.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:35.082 --rc genhtml_branch_coverage=1 00:05:35.082 --rc genhtml_function_coverage=1 00:05:35.082 --rc genhtml_legend=1 00:05:35.082 --rc geninfo_all_blocks=1 00:05:35.082 --rc geninfo_unexecuted_blocks=1 00:05:35.082 00:05:35.082 ' 00:05:35.082 01:48:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:35.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:35.082 --rc genhtml_branch_coverage=1 00:05:35.082 --rc genhtml_function_coverage=1 00:05:35.082 --rc genhtml_legend=1 00:05:35.082 --rc geninfo_all_blocks=1 00:05:35.082 --rc geninfo_unexecuted_blocks=1 00:05:35.082 00:05:35.082 ' 00:05:35.082 01:48:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:35.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:35.082 --rc genhtml_branch_coverage=1 00:05:35.082 --rc genhtml_function_coverage=1 00:05:35.082 --rc genhtml_legend=1 00:05:35.082 --rc geninfo_all_blocks=1 00:05:35.082 --rc geninfo_unexecuted_blocks=1 00:05:35.082 00:05:35.082 ' 00:05:35.082 01:48:09 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:35.082 01:48:09 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:35.082 01:48:09 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:35.082 01:48:09 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:35.082 01:48:09 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:35.082 01:48:09 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:35.082 01:48:09 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:35.082 01:48:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:35.082 01:48:09 -- common/autotest_common.sh@10 -- # set +x 00:05:35.082 01:48:09 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1082673 00:05:35.082 01:48:09 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:35.082 01:48:09 -- spdkcli/tcp.sh@27 -- # waitforlisten 1082673 00:05:35.082 01:48:09 -- common/autotest_common.sh@829 -- # '[' -z 1082673 ']' 00:05:35.082 01:48:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:35.082 01:48:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:35.082 01:48:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:35.082 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:35.082 01:48:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:35.082 01:48:09 -- common/autotest_common.sh@10 -- # set +x 00:05:35.082 [2024-11-18 01:48:09.315213] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:35.082 [2024-11-18 01:48:09.315308] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1082673 ] 00:05:35.082 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.082 [2024-11-18 01:48:09.372245] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:35.082 [2024-11-18 01:48:09.455825] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:35.082 [2024-11-18 01:48:09.456049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:35.082 [2024-11-18 01:48:09.456073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.016 01:48:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:36.016 01:48:10 -- common/autotest_common.sh@862 -- # return 0 00:05:36.016 01:48:10 -- spdkcli/tcp.sh@31 -- # socat_pid=1082817 00:05:36.016 01:48:10 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:36.016 01:48:10 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:36.274 [ 00:05:36.274 "bdev_malloc_delete", 00:05:36.274 "bdev_malloc_create", 00:05:36.274 "bdev_null_resize", 00:05:36.274 "bdev_null_delete", 00:05:36.274 "bdev_null_create", 00:05:36.274 "bdev_nvme_cuse_unregister", 00:05:36.274 "bdev_nvme_cuse_register", 00:05:36.274 "bdev_opal_new_user", 00:05:36.274 "bdev_opal_set_lock_state", 00:05:36.274 "bdev_opal_delete", 00:05:36.274 "bdev_opal_get_info", 00:05:36.274 "bdev_opal_create", 00:05:36.274 "bdev_nvme_opal_revert", 00:05:36.274 "bdev_nvme_opal_init", 00:05:36.274 "bdev_nvme_send_cmd", 00:05:36.274 "bdev_nvme_get_path_iostat", 00:05:36.274 "bdev_nvme_get_mdns_discovery_info", 00:05:36.274 "bdev_nvme_stop_mdns_discovery", 00:05:36.274 "bdev_nvme_start_mdns_discovery", 00:05:36.274 "bdev_nvme_set_multipath_policy", 00:05:36.274 "bdev_nvme_set_preferred_path", 00:05:36.274 "bdev_nvme_get_io_paths", 00:05:36.274 "bdev_nvme_remove_error_injection", 00:05:36.274 "bdev_nvme_add_error_injection", 00:05:36.274 "bdev_nvme_get_discovery_info", 00:05:36.274 "bdev_nvme_stop_discovery", 00:05:36.274 "bdev_nvme_start_discovery", 00:05:36.274 "bdev_nvme_get_controller_health_info", 00:05:36.274 "bdev_nvme_disable_controller", 00:05:36.274 "bdev_nvme_enable_controller", 00:05:36.274 "bdev_nvme_reset_controller", 00:05:36.274 "bdev_nvme_get_transport_statistics", 00:05:36.274 "bdev_nvme_apply_firmware", 00:05:36.274 "bdev_nvme_detach_controller", 00:05:36.274 "bdev_nvme_get_controllers", 00:05:36.274 "bdev_nvme_attach_controller", 00:05:36.274 "bdev_nvme_set_hotplug", 00:05:36.274 "bdev_nvme_set_options", 00:05:36.274 "bdev_passthru_delete", 00:05:36.274 "bdev_passthru_create", 00:05:36.274 "bdev_lvol_grow_lvstore", 00:05:36.274 "bdev_lvol_get_lvols", 00:05:36.274 "bdev_lvol_get_lvstores", 00:05:36.274 "bdev_lvol_delete", 00:05:36.274 "bdev_lvol_set_read_only", 00:05:36.275 "bdev_lvol_resize", 00:05:36.275 "bdev_lvol_decouple_parent", 00:05:36.275 "bdev_lvol_inflate", 00:05:36.275 "bdev_lvol_rename", 00:05:36.275 "bdev_lvol_clone_bdev", 00:05:36.275 "bdev_lvol_clone", 00:05:36.275 "bdev_lvol_snapshot", 00:05:36.275 "bdev_lvol_create", 00:05:36.275 "bdev_lvol_delete_lvstore", 00:05:36.275 "bdev_lvol_rename_lvstore", 00:05:36.275 "bdev_lvol_create_lvstore", 00:05:36.275 "bdev_raid_set_options", 00:05:36.275 "bdev_raid_remove_base_bdev", 00:05:36.275 "bdev_raid_add_base_bdev", 00:05:36.275 "bdev_raid_delete", 00:05:36.275 "bdev_raid_create", 00:05:36.275 "bdev_raid_get_bdevs", 00:05:36.275 "bdev_error_inject_error", 00:05:36.275 "bdev_error_delete", 00:05:36.275 "bdev_error_create", 00:05:36.275 "bdev_split_delete", 00:05:36.275 "bdev_split_create", 00:05:36.275 "bdev_delay_delete", 00:05:36.275 "bdev_delay_create", 00:05:36.275 "bdev_delay_update_latency", 00:05:36.275 "bdev_zone_block_delete", 00:05:36.275 "bdev_zone_block_create", 00:05:36.275 "blobfs_create", 00:05:36.275 "blobfs_detect", 00:05:36.275 "blobfs_set_cache_size", 00:05:36.275 "bdev_aio_delete", 00:05:36.275 "bdev_aio_rescan", 00:05:36.275 "bdev_aio_create", 00:05:36.275 "bdev_ftl_set_property", 00:05:36.275 "bdev_ftl_get_properties", 00:05:36.275 "bdev_ftl_get_stats", 00:05:36.275 "bdev_ftl_unmap", 00:05:36.275 "bdev_ftl_unload", 00:05:36.275 "bdev_ftl_delete", 00:05:36.275 "bdev_ftl_load", 00:05:36.275 "bdev_ftl_create", 00:05:36.275 "bdev_virtio_attach_controller", 00:05:36.275 "bdev_virtio_scsi_get_devices", 00:05:36.275 "bdev_virtio_detach_controller", 00:05:36.275 "bdev_virtio_blk_set_hotplug", 00:05:36.275 "bdev_iscsi_delete", 00:05:36.275 "bdev_iscsi_create", 00:05:36.275 "bdev_iscsi_set_options", 00:05:36.275 "accel_error_inject_error", 00:05:36.275 "ioat_scan_accel_module", 00:05:36.275 "dsa_scan_accel_module", 00:05:36.275 "iaa_scan_accel_module", 00:05:36.275 "vfu_virtio_create_scsi_endpoint", 00:05:36.275 "vfu_virtio_scsi_remove_target", 00:05:36.275 "vfu_virtio_scsi_add_target", 00:05:36.275 "vfu_virtio_create_blk_endpoint", 00:05:36.275 "vfu_virtio_delete_endpoint", 00:05:36.275 "iscsi_set_options", 00:05:36.275 "iscsi_get_auth_groups", 00:05:36.275 "iscsi_auth_group_remove_secret", 00:05:36.275 "iscsi_auth_group_add_secret", 00:05:36.275 "iscsi_delete_auth_group", 00:05:36.275 "iscsi_create_auth_group", 00:05:36.275 "iscsi_set_discovery_auth", 00:05:36.275 "iscsi_get_options", 00:05:36.275 "iscsi_target_node_request_logout", 00:05:36.275 "iscsi_target_node_set_redirect", 00:05:36.275 "iscsi_target_node_set_auth", 00:05:36.275 "iscsi_target_node_add_lun", 00:05:36.275 "iscsi_get_connections", 00:05:36.275 "iscsi_portal_group_set_auth", 00:05:36.275 "iscsi_start_portal_group", 00:05:36.275 "iscsi_delete_portal_group", 00:05:36.275 "iscsi_create_portal_group", 00:05:36.275 "iscsi_get_portal_groups", 00:05:36.275 "iscsi_delete_target_node", 00:05:36.275 "iscsi_target_node_remove_pg_ig_maps", 00:05:36.275 "iscsi_target_node_add_pg_ig_maps", 00:05:36.275 "iscsi_create_target_node", 00:05:36.275 "iscsi_get_target_nodes", 00:05:36.275 "iscsi_delete_initiator_group", 00:05:36.275 "iscsi_initiator_group_remove_initiators", 00:05:36.275 "iscsi_initiator_group_add_initiators", 00:05:36.275 "iscsi_create_initiator_group", 00:05:36.275 "iscsi_get_initiator_groups", 00:05:36.275 "nvmf_set_crdt", 00:05:36.275 "nvmf_set_config", 00:05:36.275 "nvmf_set_max_subsystems", 00:05:36.275 "nvmf_subsystem_get_listeners", 00:05:36.275 "nvmf_subsystem_get_qpairs", 00:05:36.275 "nvmf_subsystem_get_controllers", 00:05:36.275 "nvmf_get_stats", 00:05:36.275 "nvmf_get_transports", 00:05:36.275 "nvmf_create_transport", 00:05:36.275 "nvmf_get_targets", 00:05:36.275 "nvmf_delete_target", 00:05:36.275 "nvmf_create_target", 00:05:36.275 "nvmf_subsystem_allow_any_host", 00:05:36.275 "nvmf_subsystem_remove_host", 00:05:36.275 "nvmf_subsystem_add_host", 00:05:36.275 "nvmf_subsystem_remove_ns", 00:05:36.275 "nvmf_subsystem_add_ns", 00:05:36.275 "nvmf_subsystem_listener_set_ana_state", 00:05:36.275 "nvmf_discovery_get_referrals", 00:05:36.275 "nvmf_discovery_remove_referral", 00:05:36.275 "nvmf_discovery_add_referral", 00:05:36.275 "nvmf_subsystem_remove_listener", 00:05:36.275 "nvmf_subsystem_add_listener", 00:05:36.275 "nvmf_delete_subsystem", 00:05:36.275 "nvmf_create_subsystem", 00:05:36.275 "nvmf_get_subsystems", 00:05:36.275 "env_dpdk_get_mem_stats", 00:05:36.275 "nbd_get_disks", 00:05:36.275 "nbd_stop_disk", 00:05:36.275 "nbd_start_disk", 00:05:36.275 "ublk_recover_disk", 00:05:36.275 "ublk_get_disks", 00:05:36.275 "ublk_stop_disk", 00:05:36.275 "ublk_start_disk", 00:05:36.275 "ublk_destroy_target", 00:05:36.275 "ublk_create_target", 00:05:36.275 "virtio_blk_create_transport", 00:05:36.275 "virtio_blk_get_transports", 00:05:36.275 "vhost_controller_set_coalescing", 00:05:36.275 "vhost_get_controllers", 00:05:36.275 "vhost_delete_controller", 00:05:36.275 "vhost_create_blk_controller", 00:05:36.275 "vhost_scsi_controller_remove_target", 00:05:36.275 "vhost_scsi_controller_add_target", 00:05:36.275 "vhost_start_scsi_controller", 00:05:36.275 "vhost_create_scsi_controller", 00:05:36.275 "thread_set_cpumask", 00:05:36.275 "framework_get_scheduler", 00:05:36.275 "framework_set_scheduler", 00:05:36.275 "framework_get_reactors", 00:05:36.275 "thread_get_io_channels", 00:05:36.275 "thread_get_pollers", 00:05:36.275 "thread_get_stats", 00:05:36.275 "framework_monitor_context_switch", 00:05:36.275 "spdk_kill_instance", 00:05:36.275 "log_enable_timestamps", 00:05:36.275 "log_get_flags", 00:05:36.275 "log_clear_flag", 00:05:36.275 "log_set_flag", 00:05:36.275 "log_get_level", 00:05:36.275 "log_set_level", 00:05:36.275 "log_get_print_level", 00:05:36.275 "log_set_print_level", 00:05:36.275 "framework_enable_cpumask_locks", 00:05:36.275 "framework_disable_cpumask_locks", 00:05:36.275 "framework_wait_init", 00:05:36.275 "framework_start_init", 00:05:36.275 "scsi_get_devices", 00:05:36.275 "bdev_get_histogram", 00:05:36.275 "bdev_enable_histogram", 00:05:36.275 "bdev_set_qos_limit", 00:05:36.275 "bdev_set_qd_sampling_period", 00:05:36.275 "bdev_get_bdevs", 00:05:36.275 "bdev_reset_iostat", 00:05:36.275 "bdev_get_iostat", 00:05:36.275 "bdev_examine", 00:05:36.275 "bdev_wait_for_examine", 00:05:36.275 "bdev_set_options", 00:05:36.275 "notify_get_notifications", 00:05:36.275 "notify_get_types", 00:05:36.275 "accel_get_stats", 00:05:36.275 "accel_set_options", 00:05:36.275 "accel_set_driver", 00:05:36.275 "accel_crypto_key_destroy", 00:05:36.275 "accel_crypto_keys_get", 00:05:36.275 "accel_crypto_key_create", 00:05:36.275 "accel_assign_opc", 00:05:36.275 "accel_get_module_info", 00:05:36.275 "accel_get_opc_assignments", 00:05:36.275 "vmd_rescan", 00:05:36.275 "vmd_remove_device", 00:05:36.275 "vmd_enable", 00:05:36.275 "sock_set_default_impl", 00:05:36.275 "sock_impl_set_options", 00:05:36.275 "sock_impl_get_options", 00:05:36.275 "iobuf_get_stats", 00:05:36.275 "iobuf_set_options", 00:05:36.275 "framework_get_pci_devices", 00:05:36.275 "framework_get_config", 00:05:36.275 "framework_get_subsystems", 00:05:36.275 "vfu_tgt_set_base_path", 00:05:36.275 "trace_get_info", 00:05:36.275 "trace_get_tpoint_group_mask", 00:05:36.275 "trace_disable_tpoint_group", 00:05:36.275 "trace_enable_tpoint_group", 00:05:36.275 "trace_clear_tpoint_mask", 00:05:36.275 "trace_set_tpoint_mask", 00:05:36.275 "spdk_get_version", 00:05:36.275 "rpc_get_methods" 00:05:36.275 ] 00:05:36.275 01:48:10 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:36.275 01:48:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:36.275 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:05:36.275 01:48:10 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:36.275 01:48:10 -- spdkcli/tcp.sh@38 -- # killprocess 1082673 00:05:36.275 01:48:10 -- common/autotest_common.sh@936 -- # '[' -z 1082673 ']' 00:05:36.275 01:48:10 -- common/autotest_common.sh@940 -- # kill -0 1082673 00:05:36.275 01:48:10 -- common/autotest_common.sh@941 -- # uname 00:05:36.275 01:48:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:36.275 01:48:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1082673 00:05:36.275 01:48:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:36.275 01:48:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:36.275 01:48:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1082673' 00:05:36.275 killing process with pid 1082673 00:05:36.275 01:48:10 -- common/autotest_common.sh@955 -- # kill 1082673 00:05:36.275 01:48:10 -- common/autotest_common.sh@960 -- # wait 1082673 00:05:36.841 00:05:36.841 real 0m1.896s 00:05:36.841 user 0m3.698s 00:05:36.841 sys 0m0.509s 00:05:36.842 01:48:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.842 01:48:11 -- common/autotest_common.sh@10 -- # set +x 00:05:36.842 ************************************ 00:05:36.842 END TEST spdkcli_tcp 00:05:36.842 ************************************ 00:05:36.842 01:48:11 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:36.842 01:48:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:36.842 01:48:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.842 01:48:11 -- common/autotest_common.sh@10 -- # set +x 00:05:36.842 ************************************ 00:05:36.842 START TEST dpdk_mem_utility 00:05:36.842 ************************************ 00:05:36.842 01:48:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:36.842 * Looking for test storage... 00:05:36.842 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:36.842 01:48:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:36.842 01:48:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:36.842 01:48:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:36.842 01:48:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:36.842 01:48:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:36.842 01:48:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:36.842 01:48:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:36.842 01:48:11 -- scripts/common.sh@335 -- # IFS=.-: 00:05:36.842 01:48:11 -- scripts/common.sh@335 -- # read -ra ver1 00:05:36.842 01:48:11 -- scripts/common.sh@336 -- # IFS=.-: 00:05:36.842 01:48:11 -- scripts/common.sh@336 -- # read -ra ver2 00:05:36.842 01:48:11 -- scripts/common.sh@337 -- # local 'op=<' 00:05:36.842 01:48:11 -- scripts/common.sh@339 -- # ver1_l=2 00:05:36.842 01:48:11 -- scripts/common.sh@340 -- # ver2_l=1 00:05:36.842 01:48:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:36.842 01:48:11 -- scripts/common.sh@343 -- # case "$op" in 00:05:36.842 01:48:11 -- scripts/common.sh@344 -- # : 1 00:05:36.842 01:48:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:36.842 01:48:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:36.842 01:48:11 -- scripts/common.sh@364 -- # decimal 1 00:05:36.842 01:48:11 -- scripts/common.sh@352 -- # local d=1 00:05:36.842 01:48:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:36.842 01:48:11 -- scripts/common.sh@354 -- # echo 1 00:05:36.842 01:48:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:36.842 01:48:11 -- scripts/common.sh@365 -- # decimal 2 00:05:36.842 01:48:11 -- scripts/common.sh@352 -- # local d=2 00:05:36.842 01:48:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:36.842 01:48:11 -- scripts/common.sh@354 -- # echo 2 00:05:36.842 01:48:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:36.842 01:48:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:36.842 01:48:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:36.842 01:48:11 -- scripts/common.sh@367 -- # return 0 00:05:36.842 01:48:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:36.842 01:48:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:36.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.842 --rc genhtml_branch_coverage=1 00:05:36.842 --rc genhtml_function_coverage=1 00:05:36.842 --rc genhtml_legend=1 00:05:36.842 --rc geninfo_all_blocks=1 00:05:36.842 --rc geninfo_unexecuted_blocks=1 00:05:36.842 00:05:36.842 ' 00:05:36.842 01:48:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:36.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.842 --rc genhtml_branch_coverage=1 00:05:36.842 --rc genhtml_function_coverage=1 00:05:36.842 --rc genhtml_legend=1 00:05:36.842 --rc geninfo_all_blocks=1 00:05:36.842 --rc geninfo_unexecuted_blocks=1 00:05:36.842 00:05:36.842 ' 00:05:36.842 01:48:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:36.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.842 --rc genhtml_branch_coverage=1 00:05:36.842 --rc genhtml_function_coverage=1 00:05:36.842 --rc genhtml_legend=1 00:05:36.842 --rc geninfo_all_blocks=1 00:05:36.842 --rc geninfo_unexecuted_blocks=1 00:05:36.842 00:05:36.842 ' 00:05:36.842 01:48:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:36.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.842 --rc genhtml_branch_coverage=1 00:05:36.842 --rc genhtml_function_coverage=1 00:05:36.842 --rc genhtml_legend=1 00:05:36.842 --rc geninfo_all_blocks=1 00:05:36.842 --rc geninfo_unexecuted_blocks=1 00:05:36.842 00:05:36.842 ' 00:05:36.842 01:48:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:36.842 01:48:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1082909 00:05:36.842 01:48:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:36.842 01:48:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1082909 00:05:36.842 01:48:11 -- common/autotest_common.sh@829 -- # '[' -z 1082909 ']' 00:05:36.842 01:48:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:36.842 01:48:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:36.842 01:48:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:36.842 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:36.842 01:48:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:36.842 01:48:11 -- common/autotest_common.sh@10 -- # set +x 00:05:37.100 [2024-11-18 01:48:11.245334] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:37.100 [2024-11-18 01:48:11.245430] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1082909 ] 00:05:37.100 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.100 [2024-11-18 01:48:11.308176] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.100 [2024-11-18 01:48:11.392516] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:37.100 [2024-11-18 01:48:11.392685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.035 01:48:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:38.035 01:48:12 -- common/autotest_common.sh@862 -- # return 0 00:05:38.035 01:48:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:38.035 01:48:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:38.035 01:48:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:38.035 01:48:12 -- common/autotest_common.sh@10 -- # set +x 00:05:38.035 { 00:05:38.035 "filename": "/tmp/spdk_mem_dump.txt" 00:05:38.035 } 00:05:38.035 01:48:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:38.035 01:48:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:38.035 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:38.035 1 heaps totaling size 814.000000 MiB 00:05:38.035 size: 814.000000 MiB heap id: 0 00:05:38.035 end heaps---------- 00:05:38.035 8 mempools totaling size 598.116089 MiB 00:05:38.035 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:38.035 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:38.035 size: 84.521057 MiB name: bdev_io_1082909 00:05:38.035 size: 51.011292 MiB name: evtpool_1082909 00:05:38.035 size: 50.003479 MiB name: msgpool_1082909 00:05:38.035 size: 21.763794 MiB name: PDU_Pool 00:05:38.035 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:38.035 size: 0.026123 MiB name: Session_Pool 00:05:38.035 end mempools------- 00:05:38.035 6 memzones totaling size 4.142822 MiB 00:05:38.035 size: 1.000366 MiB name: RG_ring_0_1082909 00:05:38.035 size: 1.000366 MiB name: RG_ring_1_1082909 00:05:38.035 size: 1.000366 MiB name: RG_ring_4_1082909 00:05:38.035 size: 1.000366 MiB name: RG_ring_5_1082909 00:05:38.035 size: 0.125366 MiB name: RG_ring_2_1082909 00:05:38.035 size: 0.015991 MiB name: RG_ring_3_1082909 00:05:38.035 end memzones------- 00:05:38.035 01:48:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:38.035 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:38.035 list of free elements. size: 12.519348 MiB 00:05:38.035 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:38.035 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:38.035 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:38.035 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:38.035 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:38.035 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:38.035 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:38.035 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:38.035 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:38.035 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:38.035 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:38.035 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:38.035 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:38.035 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:38.035 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:38.035 list of standard malloc elements. size: 199.218079 MiB 00:05:38.035 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:38.035 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:38.035 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:38.035 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:38.035 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:38.035 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:38.035 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:38.035 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:38.035 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:38.035 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:38.035 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:38.035 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:38.035 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:38.035 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:38.035 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:38.035 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:38.035 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:38.035 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:38.035 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:38.035 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:38.035 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:38.035 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:38.035 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:38.035 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:38.035 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:38.035 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:38.035 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:38.035 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:38.035 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:38.035 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:38.035 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:38.035 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:38.035 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:38.035 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:38.035 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:38.035 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:38.035 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:38.035 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:38.035 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:38.035 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:38.035 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:38.035 list of memzone associated elements. size: 602.262573 MiB 00:05:38.035 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:38.035 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:38.035 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:38.035 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:38.035 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:38.035 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1082909_0 00:05:38.035 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:38.035 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1082909_0 00:05:38.035 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:38.035 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1082909_0 00:05:38.035 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:38.035 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:38.035 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:38.035 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:38.035 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:38.035 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1082909 00:05:38.035 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:38.035 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1082909 00:05:38.035 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:38.035 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1082909 00:05:38.035 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:38.035 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:38.035 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:38.035 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:38.035 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:38.035 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:38.035 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:38.035 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:38.035 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:38.035 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1082909 00:05:38.035 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:38.035 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1082909 00:05:38.035 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:38.035 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1082909 00:05:38.035 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:38.036 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1082909 00:05:38.036 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:38.036 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1082909 00:05:38.036 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:38.036 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:38.036 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:38.036 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:38.036 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:38.036 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:38.036 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:38.036 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1082909 00:05:38.036 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:38.036 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:38.036 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:38.036 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:38.036 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:38.036 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1082909 00:05:38.036 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:38.036 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:38.036 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:38.036 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1082909 00:05:38.036 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:38.036 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1082909 00:05:38.036 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:38.036 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:38.036 01:48:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:38.036 01:48:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1082909 00:05:38.036 01:48:12 -- common/autotest_common.sh@936 -- # '[' -z 1082909 ']' 00:05:38.036 01:48:12 -- common/autotest_common.sh@940 -- # kill -0 1082909 00:05:38.036 01:48:12 -- common/autotest_common.sh@941 -- # uname 00:05:38.036 01:48:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:38.036 01:48:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1082909 00:05:38.036 01:48:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:38.036 01:48:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:38.036 01:48:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1082909' 00:05:38.036 killing process with pid 1082909 00:05:38.036 01:48:12 -- common/autotest_common.sh@955 -- # kill 1082909 00:05:38.036 01:48:12 -- common/autotest_common.sh@960 -- # wait 1082909 00:05:38.602 00:05:38.602 real 0m1.690s 00:05:38.602 user 0m1.871s 00:05:38.602 sys 0m0.460s 00:05:38.602 01:48:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:38.602 01:48:12 -- common/autotest_common.sh@10 -- # set +x 00:05:38.602 ************************************ 00:05:38.602 END TEST dpdk_mem_utility 00:05:38.602 ************************************ 00:05:38.602 01:48:12 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:38.602 01:48:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:38.602 01:48:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.602 01:48:12 -- common/autotest_common.sh@10 -- # set +x 00:05:38.602 ************************************ 00:05:38.602 START TEST event 00:05:38.602 ************************************ 00:05:38.602 01:48:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:38.602 * Looking for test storage... 00:05:38.602 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:38.602 01:48:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:38.602 01:48:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:38.602 01:48:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:38.602 01:48:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:38.602 01:48:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:38.602 01:48:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:38.602 01:48:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:38.602 01:48:12 -- scripts/common.sh@335 -- # IFS=.-: 00:05:38.602 01:48:12 -- scripts/common.sh@335 -- # read -ra ver1 00:05:38.602 01:48:12 -- scripts/common.sh@336 -- # IFS=.-: 00:05:38.602 01:48:12 -- scripts/common.sh@336 -- # read -ra ver2 00:05:38.602 01:48:12 -- scripts/common.sh@337 -- # local 'op=<' 00:05:38.602 01:48:12 -- scripts/common.sh@339 -- # ver1_l=2 00:05:38.602 01:48:12 -- scripts/common.sh@340 -- # ver2_l=1 00:05:38.602 01:48:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:38.602 01:48:12 -- scripts/common.sh@343 -- # case "$op" in 00:05:38.602 01:48:12 -- scripts/common.sh@344 -- # : 1 00:05:38.602 01:48:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:38.602 01:48:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:38.602 01:48:12 -- scripts/common.sh@364 -- # decimal 1 00:05:38.602 01:48:12 -- scripts/common.sh@352 -- # local d=1 00:05:38.602 01:48:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:38.602 01:48:12 -- scripts/common.sh@354 -- # echo 1 00:05:38.602 01:48:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:38.602 01:48:12 -- scripts/common.sh@365 -- # decimal 2 00:05:38.602 01:48:12 -- scripts/common.sh@352 -- # local d=2 00:05:38.602 01:48:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:38.602 01:48:12 -- scripts/common.sh@354 -- # echo 2 00:05:38.602 01:48:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:38.602 01:48:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:38.602 01:48:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:38.602 01:48:12 -- scripts/common.sh@367 -- # return 0 00:05:38.602 01:48:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:38.602 01:48:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:38.602 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.602 --rc genhtml_branch_coverage=1 00:05:38.602 --rc genhtml_function_coverage=1 00:05:38.602 --rc genhtml_legend=1 00:05:38.602 --rc geninfo_all_blocks=1 00:05:38.602 --rc geninfo_unexecuted_blocks=1 00:05:38.602 00:05:38.602 ' 00:05:38.602 01:48:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:38.602 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.602 --rc genhtml_branch_coverage=1 00:05:38.602 --rc genhtml_function_coverage=1 00:05:38.602 --rc genhtml_legend=1 00:05:38.602 --rc geninfo_all_blocks=1 00:05:38.602 --rc geninfo_unexecuted_blocks=1 00:05:38.602 00:05:38.602 ' 00:05:38.602 01:48:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:38.602 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.602 --rc genhtml_branch_coverage=1 00:05:38.602 --rc genhtml_function_coverage=1 00:05:38.602 --rc genhtml_legend=1 00:05:38.602 --rc geninfo_all_blocks=1 00:05:38.602 --rc geninfo_unexecuted_blocks=1 00:05:38.602 00:05:38.602 ' 00:05:38.602 01:48:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:38.602 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.602 --rc genhtml_branch_coverage=1 00:05:38.602 --rc genhtml_function_coverage=1 00:05:38.602 --rc genhtml_legend=1 00:05:38.602 --rc geninfo_all_blocks=1 00:05:38.603 --rc geninfo_unexecuted_blocks=1 00:05:38.603 00:05:38.603 ' 00:05:38.603 01:48:12 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:38.603 01:48:12 -- bdev/nbd_common.sh@6 -- # set -e 00:05:38.603 01:48:12 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:38.603 01:48:12 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:38.603 01:48:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.603 01:48:12 -- common/autotest_common.sh@10 -- # set +x 00:05:38.603 ************************************ 00:05:38.603 START TEST event_perf 00:05:38.603 ************************************ 00:05:38.603 01:48:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:38.603 Running I/O for 1 seconds...[2024-11-18 01:48:12.934025] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:38.603 [2024-11-18 01:48:12.934092] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083227 ] 00:05:38.603 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.603 [2024-11-18 01:48:12.989564] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:38.861 [2024-11-18 01:48:13.072334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:38.861 [2024-11-18 01:48:13.072392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:38.861 [2024-11-18 01:48:13.072458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:38.861 [2024-11-18 01:48:13.072461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.795 Running I/O for 1 seconds... 00:05:39.795 lcore 0: 231938 00:05:39.795 lcore 1: 231937 00:05:39.795 lcore 2: 231937 00:05:39.795 lcore 3: 231937 00:05:39.795 done. 00:05:39.795 00:05:39.795 real 0m1.226s 00:05:39.795 user 0m4.148s 00:05:39.795 sys 0m0.073s 00:05:39.795 01:48:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.795 01:48:14 -- common/autotest_common.sh@10 -- # set +x 00:05:39.795 ************************************ 00:05:39.795 END TEST event_perf 00:05:39.795 ************************************ 00:05:39.795 01:48:14 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:39.795 01:48:14 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:39.795 01:48:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.795 01:48:14 -- common/autotest_common.sh@10 -- # set +x 00:05:39.795 ************************************ 00:05:39.795 START TEST event_reactor 00:05:39.795 ************************************ 00:05:39.795 01:48:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:39.795 [2024-11-18 01:48:14.185211] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:39.795 [2024-11-18 01:48:14.185282] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083386 ] 00:05:40.053 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.053 [2024-11-18 01:48:14.242833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.053 [2024-11-18 01:48:14.324199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.426 test_start 00:05:41.426 oneshot 00:05:41.426 tick 100 00:05:41.426 tick 100 00:05:41.426 tick 250 00:05:41.426 tick 100 00:05:41.426 tick 100 00:05:41.426 tick 100 00:05:41.426 tick 250 00:05:41.426 tick 500 00:05:41.426 tick 100 00:05:41.426 tick 100 00:05:41.426 tick 250 00:05:41.426 tick 100 00:05:41.426 tick 100 00:05:41.426 test_end 00:05:41.426 00:05:41.426 real 0m1.226s 00:05:41.426 user 0m1.154s 00:05:41.426 sys 0m0.068s 00:05:41.426 01:48:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.426 01:48:15 -- common/autotest_common.sh@10 -- # set +x 00:05:41.426 ************************************ 00:05:41.426 END TEST event_reactor 00:05:41.426 ************************************ 00:05:41.426 01:48:15 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:41.426 01:48:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:41.426 01:48:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.426 01:48:15 -- common/autotest_common.sh@10 -- # set +x 00:05:41.426 ************************************ 00:05:41.426 START TEST event_reactor_perf 00:05:41.426 ************************************ 00:05:41.426 01:48:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:41.426 [2024-11-18 01:48:15.441380] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:41.426 [2024-11-18 01:48:15.441452] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083540 ] 00:05:41.426 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.426 [2024-11-18 01:48:15.499203] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.426 [2024-11-18 01:48:15.580199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.359 test_start 00:05:42.359 test_end 00:05:42.359 Performance: 436053 events per second 00:05:42.359 00:05:42.359 real 0m1.228s 00:05:42.359 user 0m1.137s 00:05:42.359 sys 0m0.086s 00:05:42.359 01:48:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.359 01:48:16 -- common/autotest_common.sh@10 -- # set +x 00:05:42.359 ************************************ 00:05:42.359 END TEST event_reactor_perf 00:05:42.359 ************************************ 00:05:42.359 01:48:16 -- event/event.sh@49 -- # uname -s 00:05:42.359 01:48:16 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:42.359 01:48:16 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:42.359 01:48:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:42.359 01:48:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.359 01:48:16 -- common/autotest_common.sh@10 -- # set +x 00:05:42.359 ************************************ 00:05:42.359 START TEST event_scheduler 00:05:42.359 ************************************ 00:05:42.359 01:48:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:42.359 * Looking for test storage... 00:05:42.359 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:05:42.359 01:48:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:42.359 01:48:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:42.359 01:48:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:42.617 01:48:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:42.617 01:48:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:42.617 01:48:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:42.617 01:48:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:42.617 01:48:16 -- scripts/common.sh@335 -- # IFS=.-: 00:05:42.617 01:48:16 -- scripts/common.sh@335 -- # read -ra ver1 00:05:42.617 01:48:16 -- scripts/common.sh@336 -- # IFS=.-: 00:05:42.617 01:48:16 -- scripts/common.sh@336 -- # read -ra ver2 00:05:42.617 01:48:16 -- scripts/common.sh@337 -- # local 'op=<' 00:05:42.617 01:48:16 -- scripts/common.sh@339 -- # ver1_l=2 00:05:42.618 01:48:16 -- scripts/common.sh@340 -- # ver2_l=1 00:05:42.618 01:48:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:42.618 01:48:16 -- scripts/common.sh@343 -- # case "$op" in 00:05:42.618 01:48:16 -- scripts/common.sh@344 -- # : 1 00:05:42.618 01:48:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:42.618 01:48:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:42.618 01:48:16 -- scripts/common.sh@364 -- # decimal 1 00:05:42.618 01:48:16 -- scripts/common.sh@352 -- # local d=1 00:05:42.618 01:48:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:42.618 01:48:16 -- scripts/common.sh@354 -- # echo 1 00:05:42.618 01:48:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:42.618 01:48:16 -- scripts/common.sh@365 -- # decimal 2 00:05:42.618 01:48:16 -- scripts/common.sh@352 -- # local d=2 00:05:42.618 01:48:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:42.618 01:48:16 -- scripts/common.sh@354 -- # echo 2 00:05:42.618 01:48:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:42.618 01:48:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:42.618 01:48:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:42.618 01:48:16 -- scripts/common.sh@367 -- # return 0 00:05:42.618 01:48:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:42.618 01:48:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:42.618 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.618 --rc genhtml_branch_coverage=1 00:05:42.618 --rc genhtml_function_coverage=1 00:05:42.618 --rc genhtml_legend=1 00:05:42.618 --rc geninfo_all_blocks=1 00:05:42.618 --rc geninfo_unexecuted_blocks=1 00:05:42.618 00:05:42.618 ' 00:05:42.618 01:48:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:42.618 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.618 --rc genhtml_branch_coverage=1 00:05:42.618 --rc genhtml_function_coverage=1 00:05:42.618 --rc genhtml_legend=1 00:05:42.618 --rc geninfo_all_blocks=1 00:05:42.618 --rc geninfo_unexecuted_blocks=1 00:05:42.618 00:05:42.618 ' 00:05:42.618 01:48:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:42.618 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.618 --rc genhtml_branch_coverage=1 00:05:42.618 --rc genhtml_function_coverage=1 00:05:42.618 --rc genhtml_legend=1 00:05:42.618 --rc geninfo_all_blocks=1 00:05:42.618 --rc geninfo_unexecuted_blocks=1 00:05:42.618 00:05:42.618 ' 00:05:42.618 01:48:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:42.618 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.618 --rc genhtml_branch_coverage=1 00:05:42.618 --rc genhtml_function_coverage=1 00:05:42.618 --rc genhtml_legend=1 00:05:42.618 --rc geninfo_all_blocks=1 00:05:42.618 --rc geninfo_unexecuted_blocks=1 00:05:42.618 00:05:42.618 ' 00:05:42.618 01:48:16 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:42.618 01:48:16 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1083778 00:05:42.618 01:48:16 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:42.618 01:48:16 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:42.618 01:48:16 -- scheduler/scheduler.sh@37 -- # waitforlisten 1083778 00:05:42.618 01:48:16 -- common/autotest_common.sh@829 -- # '[' -z 1083778 ']' 00:05:42.618 01:48:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:42.618 01:48:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:42.618 01:48:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:42.618 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:42.618 01:48:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:42.618 01:48:16 -- common/autotest_common.sh@10 -- # set +x 00:05:42.618 [2024-11-18 01:48:16.874128] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:42.618 [2024-11-18 01:48:16.874253] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083778 ] 00:05:42.618 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.618 [2024-11-18 01:48:16.939300] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:42.876 [2024-11-18 01:48:17.032485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.876 [2024-11-18 01:48:17.032542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:42.876 [2024-11-18 01:48:17.032608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:42.876 [2024-11-18 01:48:17.032611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:42.876 01:48:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:42.876 01:48:17 -- common/autotest_common.sh@862 -- # return 0 00:05:42.876 01:48:17 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:42.876 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.876 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:42.876 POWER: Env isn't set yet! 00:05:42.876 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:42.876 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:05:42.876 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:05:42.876 POWER: Cannot get available frequencies of lcore 0 00:05:42.876 POWER: Attempting to initialise PSTAT power management... 00:05:42.876 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:42.876 POWER: Initialized successfully for lcore 0 power management 00:05:42.876 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:42.876 POWER: Initialized successfully for lcore 1 power management 00:05:42.876 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:42.876 POWER: Initialized successfully for lcore 2 power management 00:05:42.876 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:42.876 POWER: Initialized successfully for lcore 3 power management 00:05:42.876 [2024-11-18 01:48:17.149554] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:05:42.876 [2024-11-18 01:48:17.149576] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:05:42.876 [2024-11-18 01:48:17.149588] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:05:42.876 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.876 01:48:17 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:42.876 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.876 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:42.876 [2024-11-18 01:48:17.251000] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:42.876 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.876 01:48:17 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:42.876 01:48:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:42.876 01:48:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.876 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:42.876 ************************************ 00:05:42.876 START TEST scheduler_create_thread 00:05:42.876 ************************************ 00:05:42.876 01:48:17 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:05:42.876 01:48:17 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:42.876 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.876 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:42.876 2 00:05:42.876 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.876 01:48:17 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:42.876 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.876 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:43.134 3 00:05:43.134 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.134 01:48:17 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:43.134 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.134 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:43.134 4 00:05:43.134 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.134 01:48:17 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:43.134 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.134 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:43.134 5 00:05:43.134 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.134 01:48:17 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:43.134 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.134 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:43.134 6 00:05:43.134 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.134 01:48:17 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:43.134 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.134 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:43.134 7 00:05:43.134 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.134 01:48:17 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:43.134 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.134 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:43.134 8 00:05:43.134 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.134 01:48:17 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:43.134 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.134 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:43.134 9 00:05:43.134 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.134 01:48:17 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:43.134 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.134 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:43.134 10 00:05:43.134 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.134 01:48:17 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:43.134 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.134 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:43.134 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.134 01:48:17 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:43.134 01:48:17 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:43.134 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.134 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:43.134 01:48:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.134 01:48:17 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:43.134 01:48:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.134 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:05:44.504 01:48:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:44.504 01:48:18 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:44.504 01:48:18 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:44.504 01:48:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:44.504 01:48:18 -- common/autotest_common.sh@10 -- # set +x 00:05:45.877 01:48:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.877 00:05:45.877 real 0m2.620s 00:05:45.877 user 0m0.014s 00:05:45.877 sys 0m0.002s 00:05:45.877 01:48:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.877 01:48:19 -- common/autotest_common.sh@10 -- # set +x 00:05:45.877 ************************************ 00:05:45.877 END TEST scheduler_create_thread 00:05:45.877 ************************************ 00:05:45.877 01:48:19 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:45.877 01:48:19 -- scheduler/scheduler.sh@46 -- # killprocess 1083778 00:05:45.877 01:48:19 -- common/autotest_common.sh@936 -- # '[' -z 1083778 ']' 00:05:45.877 01:48:19 -- common/autotest_common.sh@940 -- # kill -0 1083778 00:05:45.877 01:48:19 -- common/autotest_common.sh@941 -- # uname 00:05:45.877 01:48:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:45.877 01:48:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1083778 00:05:45.877 01:48:19 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:45.877 01:48:19 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:45.877 01:48:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1083778' 00:05:45.877 killing process with pid 1083778 00:05:45.877 01:48:19 -- common/autotest_common.sh@955 -- # kill 1083778 00:05:45.877 01:48:19 -- common/autotest_common.sh@960 -- # wait 1083778 00:05:46.135 [2024-11-18 01:48:20.358130] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:46.135 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:05:46.135 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:46.135 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:05:46.135 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:46.135 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:05:46.135 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:46.135 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:05:46.135 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:46.393 00:05:46.393 real 0m3.906s 00:05:46.393 user 0m5.949s 00:05:46.393 sys 0m0.342s 00:05:46.393 01:48:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.393 01:48:20 -- common/autotest_common.sh@10 -- # set +x 00:05:46.393 ************************************ 00:05:46.393 END TEST event_scheduler 00:05:46.393 ************************************ 00:05:46.393 01:48:20 -- event/event.sh@51 -- # modprobe -n nbd 00:05:46.393 01:48:20 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:46.393 01:48:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:46.393 01:48:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.393 01:48:20 -- common/autotest_common.sh@10 -- # set +x 00:05:46.393 ************************************ 00:05:46.393 START TEST app_repeat 00:05:46.393 ************************************ 00:05:46.393 01:48:20 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:05:46.393 01:48:20 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:46.393 01:48:20 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:46.393 01:48:20 -- event/event.sh@13 -- # local nbd_list 00:05:46.393 01:48:20 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:46.393 01:48:20 -- event/event.sh@14 -- # local bdev_list 00:05:46.393 01:48:20 -- event/event.sh@15 -- # local repeat_times=4 00:05:46.393 01:48:20 -- event/event.sh@17 -- # modprobe nbd 00:05:46.393 01:48:20 -- event/event.sh@19 -- # repeat_pid=1084325 00:05:46.393 01:48:20 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:46.393 01:48:20 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:46.393 01:48:20 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1084325' 00:05:46.393 Process app_repeat pid: 1084325 00:05:46.393 01:48:20 -- event/event.sh@23 -- # for i in {0..2} 00:05:46.393 01:48:20 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:46.393 spdk_app_start Round 0 00:05:46.393 01:48:20 -- event/event.sh@25 -- # waitforlisten 1084325 /var/tmp/spdk-nbd.sock 00:05:46.393 01:48:20 -- common/autotest_common.sh@829 -- # '[' -z 1084325 ']' 00:05:46.393 01:48:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:46.393 01:48:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:46.393 01:48:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:46.393 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:46.393 01:48:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:46.393 01:48:20 -- common/autotest_common.sh@10 -- # set +x 00:05:46.393 [2024-11-18 01:48:20.654330] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:46.393 [2024-11-18 01:48:20.654426] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084325 ] 00:05:46.393 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.393 [2024-11-18 01:48:20.716017] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:46.652 [2024-11-18 01:48:20.804269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:46.652 [2024-11-18 01:48:20.804275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.586 01:48:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:47.586 01:48:21 -- common/autotest_common.sh@862 -- # return 0 00:05:47.586 01:48:21 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:47.586 Malloc0 00:05:47.586 01:48:21 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:47.844 Malloc1 00:05:47.844 01:48:22 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@12 -- # local i 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:47.844 01:48:22 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:48.102 /dev/nbd0 00:05:48.102 01:48:22 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:48.102 01:48:22 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:48.102 01:48:22 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:48.102 01:48:22 -- common/autotest_common.sh@867 -- # local i 00:05:48.102 01:48:22 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:48.102 01:48:22 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:48.102 01:48:22 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:48.102 01:48:22 -- common/autotest_common.sh@871 -- # break 00:05:48.102 01:48:22 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:48.102 01:48:22 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:48.102 01:48:22 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:48.102 1+0 records in 00:05:48.102 1+0 records out 00:05:48.102 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000188219 s, 21.8 MB/s 00:05:48.102 01:48:22 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:48.102 01:48:22 -- common/autotest_common.sh@884 -- # size=4096 00:05:48.102 01:48:22 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:48.102 01:48:22 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:48.102 01:48:22 -- common/autotest_common.sh@887 -- # return 0 00:05:48.102 01:48:22 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:48.102 01:48:22 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:48.102 01:48:22 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:48.361 /dev/nbd1 00:05:48.361 01:48:22 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:48.361 01:48:22 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:48.361 01:48:22 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:48.361 01:48:22 -- common/autotest_common.sh@867 -- # local i 00:05:48.361 01:48:22 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:48.361 01:48:22 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:48.361 01:48:22 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:48.361 01:48:22 -- common/autotest_common.sh@871 -- # break 00:05:48.361 01:48:22 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:48.361 01:48:22 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:48.361 01:48:22 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:48.361 1+0 records in 00:05:48.361 1+0 records out 00:05:48.361 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000216119 s, 19.0 MB/s 00:05:48.361 01:48:22 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:48.361 01:48:22 -- common/autotest_common.sh@884 -- # size=4096 00:05:48.361 01:48:22 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:48.361 01:48:22 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:48.361 01:48:22 -- common/autotest_common.sh@887 -- # return 0 00:05:48.361 01:48:22 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:48.361 01:48:22 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:48.361 01:48:22 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:48.361 01:48:22 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:48.361 01:48:22 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:48.620 01:48:22 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:48.620 { 00:05:48.620 "nbd_device": "/dev/nbd0", 00:05:48.620 "bdev_name": "Malloc0" 00:05:48.620 }, 00:05:48.620 { 00:05:48.620 "nbd_device": "/dev/nbd1", 00:05:48.620 "bdev_name": "Malloc1" 00:05:48.620 } 00:05:48.620 ]' 00:05:48.620 01:48:22 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:48.620 { 00:05:48.620 "nbd_device": "/dev/nbd0", 00:05:48.620 "bdev_name": "Malloc0" 00:05:48.620 }, 00:05:48.620 { 00:05:48.620 "nbd_device": "/dev/nbd1", 00:05:48.620 "bdev_name": "Malloc1" 00:05:48.620 } 00:05:48.620 ]' 00:05:48.620 01:48:22 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:48.878 /dev/nbd1' 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:48.878 /dev/nbd1' 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@65 -- # count=2 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@95 -- # count=2 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:48.878 256+0 records in 00:05:48.878 256+0 records out 00:05:48.878 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00515508 s, 203 MB/s 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:48.878 256+0 records in 00:05:48.878 256+0 records out 00:05:48.878 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222206 s, 47.2 MB/s 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:48.878 256+0 records in 00:05:48.878 256+0 records out 00:05:48.878 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235571 s, 44.5 MB/s 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@51 -- # local i 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:48.878 01:48:23 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:49.137 01:48:23 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:49.137 01:48:23 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:49.137 01:48:23 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:49.137 01:48:23 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:49.137 01:48:23 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:49.137 01:48:23 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:49.137 01:48:23 -- bdev/nbd_common.sh@41 -- # break 00:05:49.137 01:48:23 -- bdev/nbd_common.sh@45 -- # return 0 00:05:49.137 01:48:23 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:49.137 01:48:23 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:49.395 01:48:23 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:49.395 01:48:23 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:49.395 01:48:23 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:49.395 01:48:23 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:49.395 01:48:23 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:49.395 01:48:23 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:49.395 01:48:23 -- bdev/nbd_common.sh@41 -- # break 00:05:49.395 01:48:23 -- bdev/nbd_common.sh@45 -- # return 0 00:05:49.395 01:48:23 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:49.395 01:48:23 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:49.395 01:48:23 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:49.653 01:48:23 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:49.653 01:48:23 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:49.653 01:48:23 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:49.653 01:48:23 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:49.653 01:48:23 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:49.653 01:48:23 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:49.653 01:48:23 -- bdev/nbd_common.sh@65 -- # true 00:05:49.653 01:48:23 -- bdev/nbd_common.sh@65 -- # count=0 00:05:49.653 01:48:23 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:49.653 01:48:23 -- bdev/nbd_common.sh@104 -- # count=0 00:05:49.653 01:48:23 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:49.653 01:48:23 -- bdev/nbd_common.sh@109 -- # return 0 00:05:49.653 01:48:23 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:49.911 01:48:24 -- event/event.sh@35 -- # sleep 3 00:05:50.169 [2024-11-18 01:48:24.475129] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:50.169 [2024-11-18 01:48:24.562923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.169 [2024-11-18 01:48:24.562923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:50.428 [2024-11-18 01:48:24.623700] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:50.428 [2024-11-18 01:48:24.623775] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:52.957 01:48:27 -- event/event.sh@23 -- # for i in {0..2} 00:05:52.957 01:48:27 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:52.957 spdk_app_start Round 1 00:05:52.957 01:48:27 -- event/event.sh@25 -- # waitforlisten 1084325 /var/tmp/spdk-nbd.sock 00:05:52.957 01:48:27 -- common/autotest_common.sh@829 -- # '[' -z 1084325 ']' 00:05:52.957 01:48:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:52.957 01:48:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:52.957 01:48:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:52.957 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:52.957 01:48:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:52.957 01:48:27 -- common/autotest_common.sh@10 -- # set +x 00:05:53.215 01:48:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:53.215 01:48:27 -- common/autotest_common.sh@862 -- # return 0 00:05:53.215 01:48:27 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:53.473 Malloc0 00:05:53.473 01:48:27 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:53.732 Malloc1 00:05:53.732 01:48:28 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@12 -- # local i 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:53.732 01:48:28 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:53.990 /dev/nbd0 00:05:53.991 01:48:28 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:53.991 01:48:28 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:53.991 01:48:28 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:53.991 01:48:28 -- common/autotest_common.sh@867 -- # local i 00:05:53.991 01:48:28 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:53.991 01:48:28 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:53.991 01:48:28 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:53.991 01:48:28 -- common/autotest_common.sh@871 -- # break 00:05:53.991 01:48:28 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:53.991 01:48:28 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:53.991 01:48:28 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:53.991 1+0 records in 00:05:53.991 1+0 records out 00:05:53.991 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000199603 s, 20.5 MB/s 00:05:53.991 01:48:28 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:53.991 01:48:28 -- common/autotest_common.sh@884 -- # size=4096 00:05:53.991 01:48:28 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:53.991 01:48:28 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:53.991 01:48:28 -- common/autotest_common.sh@887 -- # return 0 00:05:53.991 01:48:28 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:53.991 01:48:28 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:53.991 01:48:28 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:54.249 /dev/nbd1 00:05:54.249 01:48:28 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:54.249 01:48:28 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:54.249 01:48:28 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:54.249 01:48:28 -- common/autotest_common.sh@867 -- # local i 00:05:54.249 01:48:28 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:54.249 01:48:28 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:54.249 01:48:28 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:54.249 01:48:28 -- common/autotest_common.sh@871 -- # break 00:05:54.249 01:48:28 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:54.249 01:48:28 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:54.249 01:48:28 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:54.249 1+0 records in 00:05:54.249 1+0 records out 00:05:54.249 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000225791 s, 18.1 MB/s 00:05:54.249 01:48:28 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:54.249 01:48:28 -- common/autotest_common.sh@884 -- # size=4096 00:05:54.249 01:48:28 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:54.249 01:48:28 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:54.249 01:48:28 -- common/autotest_common.sh@887 -- # return 0 00:05:54.249 01:48:28 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:54.249 01:48:28 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:54.249 01:48:28 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:54.249 01:48:28 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:54.249 01:48:28 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:54.507 { 00:05:54.507 "nbd_device": "/dev/nbd0", 00:05:54.507 "bdev_name": "Malloc0" 00:05:54.507 }, 00:05:54.507 { 00:05:54.507 "nbd_device": "/dev/nbd1", 00:05:54.507 "bdev_name": "Malloc1" 00:05:54.507 } 00:05:54.507 ]' 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:54.507 { 00:05:54.507 "nbd_device": "/dev/nbd0", 00:05:54.507 "bdev_name": "Malloc0" 00:05:54.507 }, 00:05:54.507 { 00:05:54.507 "nbd_device": "/dev/nbd1", 00:05:54.507 "bdev_name": "Malloc1" 00:05:54.507 } 00:05:54.507 ]' 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:54.507 /dev/nbd1' 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:54.507 /dev/nbd1' 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@65 -- # count=2 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@95 -- # count=2 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:54.507 256+0 records in 00:05:54.507 256+0 records out 00:05:54.507 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0050725 s, 207 MB/s 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:54.507 01:48:28 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:54.766 256+0 records in 00:05:54.766 256+0 records out 00:05:54.766 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199139 s, 52.7 MB/s 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:54.766 256+0 records in 00:05:54.766 256+0 records out 00:05:54.766 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023575 s, 44.5 MB/s 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@51 -- # local i 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:54.766 01:48:28 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:55.025 01:48:29 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:55.025 01:48:29 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:55.025 01:48:29 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:55.025 01:48:29 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:55.025 01:48:29 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:55.025 01:48:29 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:55.025 01:48:29 -- bdev/nbd_common.sh@41 -- # break 00:05:55.025 01:48:29 -- bdev/nbd_common.sh@45 -- # return 0 00:05:55.025 01:48:29 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:55.025 01:48:29 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:55.283 01:48:29 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:55.283 01:48:29 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:55.283 01:48:29 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:55.283 01:48:29 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:55.283 01:48:29 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:55.283 01:48:29 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:55.283 01:48:29 -- bdev/nbd_common.sh@41 -- # break 00:05:55.283 01:48:29 -- bdev/nbd_common.sh@45 -- # return 0 00:05:55.283 01:48:29 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:55.283 01:48:29 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:55.283 01:48:29 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:55.541 01:48:29 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:55.541 01:48:29 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:55.541 01:48:29 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:55.541 01:48:29 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:55.541 01:48:29 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:55.541 01:48:29 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:55.541 01:48:29 -- bdev/nbd_common.sh@65 -- # true 00:05:55.541 01:48:29 -- bdev/nbd_common.sh@65 -- # count=0 00:05:55.541 01:48:29 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:55.541 01:48:29 -- bdev/nbd_common.sh@104 -- # count=0 00:05:55.541 01:48:29 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:55.541 01:48:29 -- bdev/nbd_common.sh@109 -- # return 0 00:05:55.541 01:48:29 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:55.799 01:48:30 -- event/event.sh@35 -- # sleep 3 00:05:56.057 [2024-11-18 01:48:30.313630] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:56.057 [2024-11-18 01:48:30.404092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:56.057 [2024-11-18 01:48:30.404094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.316 [2024-11-18 01:48:30.465630] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:56.316 [2024-11-18 01:48:30.465706] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:58.844 01:48:33 -- event/event.sh@23 -- # for i in {0..2} 00:05:58.844 01:48:33 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:58.844 spdk_app_start Round 2 00:05:58.844 01:48:33 -- event/event.sh@25 -- # waitforlisten 1084325 /var/tmp/spdk-nbd.sock 00:05:58.844 01:48:33 -- common/autotest_common.sh@829 -- # '[' -z 1084325 ']' 00:05:58.844 01:48:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:58.844 01:48:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:58.844 01:48:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:58.844 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:58.844 01:48:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:58.844 01:48:33 -- common/autotest_common.sh@10 -- # set +x 00:05:59.102 01:48:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:59.102 01:48:33 -- common/autotest_common.sh@862 -- # return 0 00:05:59.102 01:48:33 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:59.374 Malloc0 00:05:59.375 01:48:33 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:59.691 Malloc1 00:05:59.691 01:48:33 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@12 -- # local i 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:59.691 01:48:33 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:59.974 /dev/nbd0 00:05:59.974 01:48:34 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:59.974 01:48:34 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:59.974 01:48:34 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:59.974 01:48:34 -- common/autotest_common.sh@867 -- # local i 00:05:59.974 01:48:34 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:59.974 01:48:34 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:59.974 01:48:34 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:59.974 01:48:34 -- common/autotest_common.sh@871 -- # break 00:05:59.974 01:48:34 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:59.974 01:48:34 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:59.974 01:48:34 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:59.974 1+0 records in 00:05:59.974 1+0 records out 00:05:59.974 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000179392 s, 22.8 MB/s 00:05:59.974 01:48:34 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:59.974 01:48:34 -- common/autotest_common.sh@884 -- # size=4096 00:05:59.974 01:48:34 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:59.974 01:48:34 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:59.974 01:48:34 -- common/autotest_common.sh@887 -- # return 0 00:05:59.974 01:48:34 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:59.974 01:48:34 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:59.974 01:48:34 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:59.974 /dev/nbd1 00:06:00.233 01:48:34 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:00.233 01:48:34 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:00.233 01:48:34 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:00.233 01:48:34 -- common/autotest_common.sh@867 -- # local i 00:06:00.233 01:48:34 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:00.233 01:48:34 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:00.233 01:48:34 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:00.233 01:48:34 -- common/autotest_common.sh@871 -- # break 00:06:00.233 01:48:34 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:00.233 01:48:34 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:00.233 01:48:34 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:00.233 1+0 records in 00:06:00.233 1+0 records out 00:06:00.233 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000184463 s, 22.2 MB/s 00:06:00.233 01:48:34 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:00.233 01:48:34 -- common/autotest_common.sh@884 -- # size=4096 00:06:00.233 01:48:34 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:00.233 01:48:34 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:00.233 01:48:34 -- common/autotest_common.sh@887 -- # return 0 00:06:00.233 01:48:34 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:00.233 01:48:34 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:00.233 01:48:34 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:00.233 01:48:34 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:00.233 01:48:34 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:00.491 { 00:06:00.491 "nbd_device": "/dev/nbd0", 00:06:00.491 "bdev_name": "Malloc0" 00:06:00.491 }, 00:06:00.491 { 00:06:00.491 "nbd_device": "/dev/nbd1", 00:06:00.491 "bdev_name": "Malloc1" 00:06:00.491 } 00:06:00.491 ]' 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:00.491 { 00:06:00.491 "nbd_device": "/dev/nbd0", 00:06:00.491 "bdev_name": "Malloc0" 00:06:00.491 }, 00:06:00.491 { 00:06:00.491 "nbd_device": "/dev/nbd1", 00:06:00.491 "bdev_name": "Malloc1" 00:06:00.491 } 00:06:00.491 ]' 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:00.491 /dev/nbd1' 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:00.491 /dev/nbd1' 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@65 -- # count=2 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@95 -- # count=2 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:00.491 256+0 records in 00:06:00.491 256+0 records out 00:06:00.491 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00489005 s, 214 MB/s 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:00.491 256+0 records in 00:06:00.491 256+0 records out 00:06:00.491 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226649 s, 46.3 MB/s 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:00.491 256+0 records in 00:06:00.491 256+0 records out 00:06:00.491 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212544 s, 49.3 MB/s 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@51 -- # local i 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:00.491 01:48:34 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:00.749 01:48:35 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:00.749 01:48:35 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:00.749 01:48:35 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:00.749 01:48:35 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:00.749 01:48:35 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:00.749 01:48:35 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:00.749 01:48:35 -- bdev/nbd_common.sh@41 -- # break 00:06:00.749 01:48:35 -- bdev/nbd_common.sh@45 -- # return 0 00:06:00.749 01:48:35 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:00.749 01:48:35 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:01.011 01:48:35 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:01.011 01:48:35 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:01.011 01:48:35 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:01.011 01:48:35 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:01.011 01:48:35 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:01.011 01:48:35 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:01.011 01:48:35 -- bdev/nbd_common.sh@41 -- # break 00:06:01.011 01:48:35 -- bdev/nbd_common.sh@45 -- # return 0 00:06:01.011 01:48:35 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:01.011 01:48:35 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:01.011 01:48:35 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:01.271 01:48:35 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:01.271 01:48:35 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:01.271 01:48:35 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:01.271 01:48:35 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:01.271 01:48:35 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:01.271 01:48:35 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:01.271 01:48:35 -- bdev/nbd_common.sh@65 -- # true 00:06:01.271 01:48:35 -- bdev/nbd_common.sh@65 -- # count=0 00:06:01.271 01:48:35 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:01.271 01:48:35 -- bdev/nbd_common.sh@104 -- # count=0 00:06:01.271 01:48:35 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:01.271 01:48:35 -- bdev/nbd_common.sh@109 -- # return 0 00:06:01.271 01:48:35 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:01.528 01:48:35 -- event/event.sh@35 -- # sleep 3 00:06:01.786 [2024-11-18 01:48:36.104747] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:02.044 [2024-11-18 01:48:36.193814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:02.044 [2024-11-18 01:48:36.193818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.044 [2024-11-18 01:48:36.255425] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:02.044 [2024-11-18 01:48:36.255493] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:04.571 01:48:38 -- event/event.sh@38 -- # waitforlisten 1084325 /var/tmp/spdk-nbd.sock 00:06:04.571 01:48:38 -- common/autotest_common.sh@829 -- # '[' -z 1084325 ']' 00:06:04.571 01:48:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:04.571 01:48:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:04.571 01:48:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:04.571 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:04.571 01:48:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:04.571 01:48:38 -- common/autotest_common.sh@10 -- # set +x 00:06:04.829 01:48:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:04.829 01:48:39 -- common/autotest_common.sh@862 -- # return 0 00:06:04.829 01:48:39 -- event/event.sh@39 -- # killprocess 1084325 00:06:04.829 01:48:39 -- common/autotest_common.sh@936 -- # '[' -z 1084325 ']' 00:06:04.829 01:48:39 -- common/autotest_common.sh@940 -- # kill -0 1084325 00:06:04.829 01:48:39 -- common/autotest_common.sh@941 -- # uname 00:06:04.829 01:48:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:04.829 01:48:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1084325 00:06:04.829 01:48:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:04.829 01:48:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:04.829 01:48:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1084325' 00:06:04.829 killing process with pid 1084325 00:06:04.829 01:48:39 -- common/autotest_common.sh@955 -- # kill 1084325 00:06:04.829 01:48:39 -- common/autotest_common.sh@960 -- # wait 1084325 00:06:05.087 spdk_app_start is called in Round 0. 00:06:05.087 Shutdown signal received, stop current app iteration 00:06:05.087 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:05.087 spdk_app_start is called in Round 1. 00:06:05.087 Shutdown signal received, stop current app iteration 00:06:05.087 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:05.087 spdk_app_start is called in Round 2. 00:06:05.087 Shutdown signal received, stop current app iteration 00:06:05.087 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:05.087 spdk_app_start is called in Round 3. 00:06:05.087 Shutdown signal received, stop current app iteration 00:06:05.087 01:48:39 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:05.087 01:48:39 -- event/event.sh@42 -- # return 0 00:06:05.087 00:06:05.087 real 0m18.749s 00:06:05.087 user 0m41.117s 00:06:05.087 sys 0m3.176s 00:06:05.087 01:48:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.087 01:48:39 -- common/autotest_common.sh@10 -- # set +x 00:06:05.087 ************************************ 00:06:05.087 END TEST app_repeat 00:06:05.087 ************************************ 00:06:05.087 01:48:39 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:05.087 01:48:39 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:05.087 01:48:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:05.087 01:48:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.087 01:48:39 -- common/autotest_common.sh@10 -- # set +x 00:06:05.087 ************************************ 00:06:05.087 START TEST cpu_locks 00:06:05.087 ************************************ 00:06:05.087 01:48:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:05.087 * Looking for test storage... 00:06:05.087 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:05.087 01:48:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:05.087 01:48:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:05.087 01:48:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:05.346 01:48:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:05.346 01:48:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:05.346 01:48:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:05.346 01:48:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:05.346 01:48:39 -- scripts/common.sh@335 -- # IFS=.-: 00:06:05.346 01:48:39 -- scripts/common.sh@335 -- # read -ra ver1 00:06:05.346 01:48:39 -- scripts/common.sh@336 -- # IFS=.-: 00:06:05.346 01:48:39 -- scripts/common.sh@336 -- # read -ra ver2 00:06:05.346 01:48:39 -- scripts/common.sh@337 -- # local 'op=<' 00:06:05.346 01:48:39 -- scripts/common.sh@339 -- # ver1_l=2 00:06:05.346 01:48:39 -- scripts/common.sh@340 -- # ver2_l=1 00:06:05.346 01:48:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:05.346 01:48:39 -- scripts/common.sh@343 -- # case "$op" in 00:06:05.346 01:48:39 -- scripts/common.sh@344 -- # : 1 00:06:05.346 01:48:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:05.346 01:48:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:05.346 01:48:39 -- scripts/common.sh@364 -- # decimal 1 00:06:05.346 01:48:39 -- scripts/common.sh@352 -- # local d=1 00:06:05.346 01:48:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:05.346 01:48:39 -- scripts/common.sh@354 -- # echo 1 00:06:05.346 01:48:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:05.346 01:48:39 -- scripts/common.sh@365 -- # decimal 2 00:06:05.346 01:48:39 -- scripts/common.sh@352 -- # local d=2 00:06:05.346 01:48:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:05.346 01:48:39 -- scripts/common.sh@354 -- # echo 2 00:06:05.346 01:48:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:05.346 01:48:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:05.346 01:48:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:05.346 01:48:39 -- scripts/common.sh@367 -- # return 0 00:06:05.346 01:48:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:05.346 01:48:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:05.346 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.346 --rc genhtml_branch_coverage=1 00:06:05.346 --rc genhtml_function_coverage=1 00:06:05.346 --rc genhtml_legend=1 00:06:05.346 --rc geninfo_all_blocks=1 00:06:05.346 --rc geninfo_unexecuted_blocks=1 00:06:05.346 00:06:05.346 ' 00:06:05.346 01:48:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:05.346 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.346 --rc genhtml_branch_coverage=1 00:06:05.346 --rc genhtml_function_coverage=1 00:06:05.346 --rc genhtml_legend=1 00:06:05.346 --rc geninfo_all_blocks=1 00:06:05.346 --rc geninfo_unexecuted_blocks=1 00:06:05.346 00:06:05.346 ' 00:06:05.346 01:48:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:05.346 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.346 --rc genhtml_branch_coverage=1 00:06:05.346 --rc genhtml_function_coverage=1 00:06:05.346 --rc genhtml_legend=1 00:06:05.346 --rc geninfo_all_blocks=1 00:06:05.346 --rc geninfo_unexecuted_blocks=1 00:06:05.346 00:06:05.346 ' 00:06:05.346 01:48:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:05.346 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.346 --rc genhtml_branch_coverage=1 00:06:05.346 --rc genhtml_function_coverage=1 00:06:05.346 --rc genhtml_legend=1 00:06:05.346 --rc geninfo_all_blocks=1 00:06:05.346 --rc geninfo_unexecuted_blocks=1 00:06:05.346 00:06:05.346 ' 00:06:05.346 01:48:39 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:05.346 01:48:39 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:05.346 01:48:39 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:05.346 01:48:39 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:05.346 01:48:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:05.346 01:48:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.346 01:48:39 -- common/autotest_common.sh@10 -- # set +x 00:06:05.346 ************************************ 00:06:05.346 START TEST default_locks 00:06:05.346 ************************************ 00:06:05.346 01:48:39 -- common/autotest_common.sh@1114 -- # default_locks 00:06:05.346 01:48:39 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1086875 00:06:05.346 01:48:39 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:05.346 01:48:39 -- event/cpu_locks.sh@47 -- # waitforlisten 1086875 00:06:05.346 01:48:39 -- common/autotest_common.sh@829 -- # '[' -z 1086875 ']' 00:06:05.346 01:48:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:05.346 01:48:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:05.346 01:48:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:05.346 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:05.347 01:48:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:05.347 01:48:39 -- common/autotest_common.sh@10 -- # set +x 00:06:05.347 [2024-11-18 01:48:39.582789] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:05.347 [2024-11-18 01:48:39.582892] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086875 ] 00:06:05.347 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.347 [2024-11-18 01:48:39.641452] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.347 [2024-11-18 01:48:39.726338] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:05.347 [2024-11-18 01:48:39.726542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.280 01:48:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:06.280 01:48:40 -- common/autotest_common.sh@862 -- # return 0 00:06:06.280 01:48:40 -- event/cpu_locks.sh@49 -- # locks_exist 1086875 00:06:06.280 01:48:40 -- event/cpu_locks.sh@22 -- # lslocks -p 1086875 00:06:06.280 01:48:40 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:06.537 lslocks: write error 00:06:06.537 01:48:40 -- event/cpu_locks.sh@50 -- # killprocess 1086875 00:06:06.537 01:48:40 -- common/autotest_common.sh@936 -- # '[' -z 1086875 ']' 00:06:06.537 01:48:40 -- common/autotest_common.sh@940 -- # kill -0 1086875 00:06:06.537 01:48:40 -- common/autotest_common.sh@941 -- # uname 00:06:06.537 01:48:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:06.537 01:48:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1086875 00:06:06.537 01:48:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:06.537 01:48:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:06.537 01:48:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1086875' 00:06:06.537 killing process with pid 1086875 00:06:06.537 01:48:40 -- common/autotest_common.sh@955 -- # kill 1086875 00:06:06.538 01:48:40 -- common/autotest_common.sh@960 -- # wait 1086875 00:06:07.113 01:48:41 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1086875 00:06:07.113 01:48:41 -- common/autotest_common.sh@650 -- # local es=0 00:06:07.113 01:48:41 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1086875 00:06:07.113 01:48:41 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:07.113 01:48:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:07.113 01:48:41 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:07.113 01:48:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:07.113 01:48:41 -- common/autotest_common.sh@653 -- # waitforlisten 1086875 00:06:07.113 01:48:41 -- common/autotest_common.sh@829 -- # '[' -z 1086875 ']' 00:06:07.113 01:48:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:07.113 01:48:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:07.113 01:48:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:07.113 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:07.113 01:48:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:07.113 01:48:41 -- common/autotest_common.sh@10 -- # set +x 00:06:07.113 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1086875) - No such process 00:06:07.113 ERROR: process (pid: 1086875) is no longer running 00:06:07.113 01:48:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:07.113 01:48:41 -- common/autotest_common.sh@862 -- # return 1 00:06:07.113 01:48:41 -- common/autotest_common.sh@653 -- # es=1 00:06:07.113 01:48:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:07.113 01:48:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:07.113 01:48:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:07.113 01:48:41 -- event/cpu_locks.sh@54 -- # no_locks 00:06:07.113 01:48:41 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:07.113 01:48:41 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:07.113 01:48:41 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:07.113 00:06:07.113 real 0m1.828s 00:06:07.113 user 0m1.985s 00:06:07.113 sys 0m0.563s 00:06:07.113 01:48:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:07.113 01:48:41 -- common/autotest_common.sh@10 -- # set +x 00:06:07.113 ************************************ 00:06:07.113 END TEST default_locks 00:06:07.113 ************************************ 00:06:07.113 01:48:41 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:07.113 01:48:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:07.113 01:48:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.113 01:48:41 -- common/autotest_common.sh@10 -- # set +x 00:06:07.113 ************************************ 00:06:07.113 START TEST default_locks_via_rpc 00:06:07.113 ************************************ 00:06:07.113 01:48:41 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:07.113 01:48:41 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1087053 00:06:07.113 01:48:41 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:07.113 01:48:41 -- event/cpu_locks.sh@63 -- # waitforlisten 1087053 00:06:07.113 01:48:41 -- common/autotest_common.sh@829 -- # '[' -z 1087053 ']' 00:06:07.113 01:48:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:07.113 01:48:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:07.113 01:48:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:07.113 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:07.113 01:48:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:07.113 01:48:41 -- common/autotest_common.sh@10 -- # set +x 00:06:07.113 [2024-11-18 01:48:41.439304] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:07.113 [2024-11-18 01:48:41.439443] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087053 ] 00:06:07.113 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.113 [2024-11-18 01:48:41.501437] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.372 [2024-11-18 01:48:41.591468] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:07.372 [2024-11-18 01:48:41.591649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.305 01:48:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:08.305 01:48:42 -- common/autotest_common.sh@862 -- # return 0 00:06:08.305 01:48:42 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:08.305 01:48:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:08.305 01:48:42 -- common/autotest_common.sh@10 -- # set +x 00:06:08.305 01:48:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:08.305 01:48:42 -- event/cpu_locks.sh@67 -- # no_locks 00:06:08.305 01:48:42 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:08.305 01:48:42 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:08.305 01:48:42 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:08.305 01:48:42 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:08.305 01:48:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:08.305 01:48:42 -- common/autotest_common.sh@10 -- # set +x 00:06:08.305 01:48:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:08.305 01:48:42 -- event/cpu_locks.sh@71 -- # locks_exist 1087053 00:06:08.305 01:48:42 -- event/cpu_locks.sh@22 -- # lslocks -p 1087053 00:06:08.305 01:48:42 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:08.305 01:48:42 -- event/cpu_locks.sh@73 -- # killprocess 1087053 00:06:08.305 01:48:42 -- common/autotest_common.sh@936 -- # '[' -z 1087053 ']' 00:06:08.305 01:48:42 -- common/autotest_common.sh@940 -- # kill -0 1087053 00:06:08.305 01:48:42 -- common/autotest_common.sh@941 -- # uname 00:06:08.305 01:48:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:08.305 01:48:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1087053 00:06:08.305 01:48:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:08.305 01:48:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:08.305 01:48:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1087053' 00:06:08.305 killing process with pid 1087053 00:06:08.305 01:48:42 -- common/autotest_common.sh@955 -- # kill 1087053 00:06:08.305 01:48:42 -- common/autotest_common.sh@960 -- # wait 1087053 00:06:08.870 00:06:08.870 real 0m1.648s 00:06:08.870 user 0m1.796s 00:06:08.870 sys 0m0.538s 00:06:08.870 01:48:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:08.870 01:48:43 -- common/autotest_common.sh@10 -- # set +x 00:06:08.870 ************************************ 00:06:08.870 END TEST default_locks_via_rpc 00:06:08.870 ************************************ 00:06:08.871 01:48:43 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:08.871 01:48:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:08.871 01:48:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:08.871 01:48:43 -- common/autotest_common.sh@10 -- # set +x 00:06:08.871 ************************************ 00:06:08.871 START TEST non_locking_app_on_locked_coremask 00:06:08.871 ************************************ 00:06:08.871 01:48:43 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:08.871 01:48:43 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1087347 00:06:08.871 01:48:43 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:08.871 01:48:43 -- event/cpu_locks.sh@81 -- # waitforlisten 1087347 /var/tmp/spdk.sock 00:06:08.871 01:48:43 -- common/autotest_common.sh@829 -- # '[' -z 1087347 ']' 00:06:08.871 01:48:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:08.871 01:48:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:08.871 01:48:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:08.871 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:08.871 01:48:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:08.871 01:48:43 -- common/autotest_common.sh@10 -- # set +x 00:06:08.871 [2024-11-18 01:48:43.114106] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:08.871 [2024-11-18 01:48:43.114194] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087347 ] 00:06:08.871 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.871 [2024-11-18 01:48:43.172728] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.871 [2024-11-18 01:48:43.259796] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:08.871 [2024-11-18 01:48:43.259947] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.804 01:48:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:09.804 01:48:44 -- common/autotest_common.sh@862 -- # return 0 00:06:09.804 01:48:44 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1087487 00:06:09.804 01:48:44 -- event/cpu_locks.sh@85 -- # waitforlisten 1087487 /var/tmp/spdk2.sock 00:06:09.804 01:48:44 -- common/autotest_common.sh@829 -- # '[' -z 1087487 ']' 00:06:09.804 01:48:44 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:09.804 01:48:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:09.804 01:48:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:09.804 01:48:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:09.804 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:09.804 01:48:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:09.804 01:48:44 -- common/autotest_common.sh@10 -- # set +x 00:06:09.804 [2024-11-18 01:48:44.123230] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:09.804 [2024-11-18 01:48:44.123299] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087487 ] 00:06:09.804 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.062 [2024-11-18 01:48:44.213527] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:10.062 [2024-11-18 01:48:44.213559] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.062 [2024-11-18 01:48:44.394882] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:10.062 [2024-11-18 01:48:44.395053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.996 01:48:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:10.996 01:48:45 -- common/autotest_common.sh@862 -- # return 0 00:06:10.996 01:48:45 -- event/cpu_locks.sh@87 -- # locks_exist 1087347 00:06:10.996 01:48:45 -- event/cpu_locks.sh@22 -- # lslocks -p 1087347 00:06:10.996 01:48:45 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:11.254 lslocks: write error 00:06:11.254 01:48:45 -- event/cpu_locks.sh@89 -- # killprocess 1087347 00:06:11.254 01:48:45 -- common/autotest_common.sh@936 -- # '[' -z 1087347 ']' 00:06:11.254 01:48:45 -- common/autotest_common.sh@940 -- # kill -0 1087347 00:06:11.254 01:48:45 -- common/autotest_common.sh@941 -- # uname 00:06:11.254 01:48:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:11.254 01:48:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1087347 00:06:11.254 01:48:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:11.254 01:48:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:11.254 01:48:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1087347' 00:06:11.254 killing process with pid 1087347 00:06:11.254 01:48:45 -- common/autotest_common.sh@955 -- # kill 1087347 00:06:11.254 01:48:45 -- common/autotest_common.sh@960 -- # wait 1087347 00:06:12.187 01:48:46 -- event/cpu_locks.sh@90 -- # killprocess 1087487 00:06:12.187 01:48:46 -- common/autotest_common.sh@936 -- # '[' -z 1087487 ']' 00:06:12.187 01:48:46 -- common/autotest_common.sh@940 -- # kill -0 1087487 00:06:12.187 01:48:46 -- common/autotest_common.sh@941 -- # uname 00:06:12.187 01:48:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:12.187 01:48:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1087487 00:06:12.187 01:48:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:12.187 01:48:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:12.187 01:48:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1087487' 00:06:12.187 killing process with pid 1087487 00:06:12.187 01:48:46 -- common/autotest_common.sh@955 -- # kill 1087487 00:06:12.187 01:48:46 -- common/autotest_common.sh@960 -- # wait 1087487 00:06:12.445 00:06:12.445 real 0m3.646s 00:06:12.445 user 0m4.008s 00:06:12.445 sys 0m1.093s 00:06:12.445 01:48:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.445 01:48:46 -- common/autotest_common.sh@10 -- # set +x 00:06:12.445 ************************************ 00:06:12.445 END TEST non_locking_app_on_locked_coremask 00:06:12.445 ************************************ 00:06:12.445 01:48:46 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:12.445 01:48:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:12.445 01:48:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.445 01:48:46 -- common/autotest_common.sh@10 -- # set +x 00:06:12.445 ************************************ 00:06:12.445 START TEST locking_app_on_unlocked_coremask 00:06:12.445 ************************************ 00:06:12.445 01:48:46 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:12.445 01:48:46 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1087798 00:06:12.445 01:48:46 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:12.445 01:48:46 -- event/cpu_locks.sh@99 -- # waitforlisten 1087798 /var/tmp/spdk.sock 00:06:12.445 01:48:46 -- common/autotest_common.sh@829 -- # '[' -z 1087798 ']' 00:06:12.445 01:48:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:12.445 01:48:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:12.445 01:48:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:12.445 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:12.445 01:48:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:12.445 01:48:46 -- common/autotest_common.sh@10 -- # set +x 00:06:12.445 [2024-11-18 01:48:46.788390] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:12.445 [2024-11-18 01:48:46.788477] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087798 ] 00:06:12.445 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.703 [2024-11-18 01:48:46.850091] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:12.703 [2024-11-18 01:48:46.850136] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.703 [2024-11-18 01:48:46.937342] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:12.703 [2024-11-18 01:48:46.937530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.637 01:48:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:13.637 01:48:47 -- common/autotest_common.sh@862 -- # return 0 00:06:13.637 01:48:47 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1087937 00:06:13.637 01:48:47 -- event/cpu_locks.sh@103 -- # waitforlisten 1087937 /var/tmp/spdk2.sock 00:06:13.637 01:48:47 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:13.637 01:48:47 -- common/autotest_common.sh@829 -- # '[' -z 1087937 ']' 00:06:13.637 01:48:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:13.637 01:48:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:13.637 01:48:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:13.637 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:13.637 01:48:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:13.637 01:48:47 -- common/autotest_common.sh@10 -- # set +x 00:06:13.637 [2024-11-18 01:48:47.774528] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:13.637 [2024-11-18 01:48:47.774608] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087937 ] 00:06:13.637 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.637 [2024-11-18 01:48:47.860705] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.637 [2024-11-18 01:48:48.037324] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:13.637 [2024-11-18 01:48:48.037500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.571 01:48:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:14.571 01:48:48 -- common/autotest_common.sh@862 -- # return 0 00:06:14.571 01:48:48 -- event/cpu_locks.sh@105 -- # locks_exist 1087937 00:06:14.571 01:48:48 -- event/cpu_locks.sh@22 -- # lslocks -p 1087937 00:06:14.571 01:48:48 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:14.829 lslocks: write error 00:06:14.829 01:48:49 -- event/cpu_locks.sh@107 -- # killprocess 1087798 00:06:14.829 01:48:49 -- common/autotest_common.sh@936 -- # '[' -z 1087798 ']' 00:06:14.829 01:48:49 -- common/autotest_common.sh@940 -- # kill -0 1087798 00:06:14.829 01:48:49 -- common/autotest_common.sh@941 -- # uname 00:06:14.829 01:48:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:14.829 01:48:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1087798 00:06:14.829 01:48:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:14.829 01:48:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:14.829 01:48:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1087798' 00:06:14.829 killing process with pid 1087798 00:06:14.829 01:48:49 -- common/autotest_common.sh@955 -- # kill 1087798 00:06:14.829 01:48:49 -- common/autotest_common.sh@960 -- # wait 1087798 00:06:15.761 01:48:50 -- event/cpu_locks.sh@108 -- # killprocess 1087937 00:06:15.761 01:48:50 -- common/autotest_common.sh@936 -- # '[' -z 1087937 ']' 00:06:15.761 01:48:50 -- common/autotest_common.sh@940 -- # kill -0 1087937 00:06:15.761 01:48:50 -- common/autotest_common.sh@941 -- # uname 00:06:15.761 01:48:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:15.761 01:48:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1087937 00:06:15.761 01:48:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:15.761 01:48:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:15.761 01:48:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1087937' 00:06:15.761 killing process with pid 1087937 00:06:15.761 01:48:50 -- common/autotest_common.sh@955 -- # kill 1087937 00:06:15.761 01:48:50 -- common/autotest_common.sh@960 -- # wait 1087937 00:06:16.327 00:06:16.327 real 0m3.726s 00:06:16.327 user 0m4.082s 00:06:16.327 sys 0m1.077s 00:06:16.327 01:48:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:16.327 01:48:50 -- common/autotest_common.sh@10 -- # set +x 00:06:16.327 ************************************ 00:06:16.327 END TEST locking_app_on_unlocked_coremask 00:06:16.327 ************************************ 00:06:16.327 01:48:50 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:16.327 01:48:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:16.327 01:48:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.327 01:48:50 -- common/autotest_common.sh@10 -- # set +x 00:06:16.327 ************************************ 00:06:16.327 START TEST locking_app_on_locked_coremask 00:06:16.327 ************************************ 00:06:16.327 01:48:50 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:16.327 01:48:50 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1088252 00:06:16.327 01:48:50 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:16.327 01:48:50 -- event/cpu_locks.sh@116 -- # waitforlisten 1088252 /var/tmp/spdk.sock 00:06:16.327 01:48:50 -- common/autotest_common.sh@829 -- # '[' -z 1088252 ']' 00:06:16.327 01:48:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:16.327 01:48:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:16.327 01:48:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:16.327 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:16.327 01:48:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:16.327 01:48:50 -- common/autotest_common.sh@10 -- # set +x 00:06:16.327 [2024-11-18 01:48:50.543182] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:16.327 [2024-11-18 01:48:50.543280] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088252 ] 00:06:16.327 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.327 [2024-11-18 01:48:50.607839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.327 [2024-11-18 01:48:50.701143] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:16.327 [2024-11-18 01:48:50.701367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.258 01:48:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:17.258 01:48:51 -- common/autotest_common.sh@862 -- # return 0 00:06:17.258 01:48:51 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1088392 00:06:17.258 01:48:51 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:17.258 01:48:51 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1088392 /var/tmp/spdk2.sock 00:06:17.258 01:48:51 -- common/autotest_common.sh@650 -- # local es=0 00:06:17.258 01:48:51 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1088392 /var/tmp/spdk2.sock 00:06:17.259 01:48:51 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:17.259 01:48:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:17.259 01:48:51 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:17.259 01:48:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:17.259 01:48:51 -- common/autotest_common.sh@653 -- # waitforlisten 1088392 /var/tmp/spdk2.sock 00:06:17.259 01:48:51 -- common/autotest_common.sh@829 -- # '[' -z 1088392 ']' 00:06:17.259 01:48:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:17.259 01:48:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:17.259 01:48:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:17.259 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:17.259 01:48:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:17.259 01:48:51 -- common/autotest_common.sh@10 -- # set +x 00:06:17.259 [2024-11-18 01:48:51.549089] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:17.259 [2024-11-18 01:48:51.549167] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088392 ] 00:06:17.259 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.259 [2024-11-18 01:48:51.644679] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1088252 has claimed it. 00:06:17.259 [2024-11-18 01:48:51.644741] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:18.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1088392) - No such process 00:06:18.192 ERROR: process (pid: 1088392) is no longer running 00:06:18.192 01:48:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:18.192 01:48:52 -- common/autotest_common.sh@862 -- # return 1 00:06:18.192 01:48:52 -- common/autotest_common.sh@653 -- # es=1 00:06:18.192 01:48:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:18.192 01:48:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:18.192 01:48:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:18.192 01:48:52 -- event/cpu_locks.sh@122 -- # locks_exist 1088252 00:06:18.192 01:48:52 -- event/cpu_locks.sh@22 -- # lslocks -p 1088252 00:06:18.192 01:48:52 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:18.192 lslocks: write error 00:06:18.192 01:48:52 -- event/cpu_locks.sh@124 -- # killprocess 1088252 00:06:18.192 01:48:52 -- common/autotest_common.sh@936 -- # '[' -z 1088252 ']' 00:06:18.192 01:48:52 -- common/autotest_common.sh@940 -- # kill -0 1088252 00:06:18.192 01:48:52 -- common/autotest_common.sh@941 -- # uname 00:06:18.192 01:48:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:18.192 01:48:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1088252 00:06:18.192 01:48:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:18.192 01:48:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:18.192 01:48:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1088252' 00:06:18.192 killing process with pid 1088252 00:06:18.192 01:48:52 -- common/autotest_common.sh@955 -- # kill 1088252 00:06:18.192 01:48:52 -- common/autotest_common.sh@960 -- # wait 1088252 00:06:18.757 00:06:18.757 real 0m2.419s 00:06:18.757 user 0m2.798s 00:06:18.757 sys 0m0.638s 00:06:18.757 01:48:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.757 01:48:52 -- common/autotest_common.sh@10 -- # set +x 00:06:18.757 ************************************ 00:06:18.757 END TEST locking_app_on_locked_coremask 00:06:18.757 ************************************ 00:06:18.757 01:48:52 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:18.757 01:48:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:18.757 01:48:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.758 01:48:52 -- common/autotest_common.sh@10 -- # set +x 00:06:18.758 ************************************ 00:06:18.758 START TEST locking_overlapped_coremask 00:06:18.758 ************************************ 00:06:18.758 01:48:52 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:18.758 01:48:52 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1088679 00:06:18.758 01:48:52 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:18.758 01:48:52 -- event/cpu_locks.sh@133 -- # waitforlisten 1088679 /var/tmp/spdk.sock 00:06:18.758 01:48:52 -- common/autotest_common.sh@829 -- # '[' -z 1088679 ']' 00:06:18.758 01:48:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:18.758 01:48:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:18.758 01:48:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:18.758 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:18.758 01:48:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:18.758 01:48:52 -- common/autotest_common.sh@10 -- # set +x 00:06:18.758 [2024-11-18 01:48:52.989093] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:18.758 [2024-11-18 01:48:52.989178] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088679 ] 00:06:18.758 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.758 [2024-11-18 01:48:53.046577] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:18.758 [2024-11-18 01:48:53.135845] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:18.758 [2024-11-18 01:48:53.136119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:18.758 [2024-11-18 01:48:53.136176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:18.758 [2024-11-18 01:48:53.136193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.692 01:48:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:19.692 01:48:53 -- common/autotest_common.sh@862 -- # return 0 00:06:19.692 01:48:53 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1088707 00:06:19.692 01:48:53 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:19.692 01:48:53 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1088707 /var/tmp/spdk2.sock 00:06:19.692 01:48:53 -- common/autotest_common.sh@650 -- # local es=0 00:06:19.692 01:48:53 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1088707 /var/tmp/spdk2.sock 00:06:19.692 01:48:53 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:19.692 01:48:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:19.692 01:48:53 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:19.692 01:48:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:19.692 01:48:53 -- common/autotest_common.sh@653 -- # waitforlisten 1088707 /var/tmp/spdk2.sock 00:06:19.692 01:48:53 -- common/autotest_common.sh@829 -- # '[' -z 1088707 ']' 00:06:19.692 01:48:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:19.692 01:48:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:19.692 01:48:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:19.692 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:19.692 01:48:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:19.692 01:48:53 -- common/autotest_common.sh@10 -- # set +x 00:06:19.692 [2024-11-18 01:48:53.978897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:19.692 [2024-11-18 01:48:53.978993] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088707 ] 00:06:19.692 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.692 [2024-11-18 01:48:54.072339] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1088679 has claimed it. 00:06:19.692 [2024-11-18 01:48:54.072407] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:20.626 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1088707) - No such process 00:06:20.626 ERROR: process (pid: 1088707) is no longer running 00:06:20.626 01:48:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:20.626 01:48:54 -- common/autotest_common.sh@862 -- # return 1 00:06:20.626 01:48:54 -- common/autotest_common.sh@653 -- # es=1 00:06:20.626 01:48:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:20.626 01:48:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:20.626 01:48:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:20.626 01:48:54 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:20.626 01:48:54 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:20.626 01:48:54 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:20.626 01:48:54 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:20.626 01:48:54 -- event/cpu_locks.sh@141 -- # killprocess 1088679 00:06:20.626 01:48:54 -- common/autotest_common.sh@936 -- # '[' -z 1088679 ']' 00:06:20.626 01:48:54 -- common/autotest_common.sh@940 -- # kill -0 1088679 00:06:20.626 01:48:54 -- common/autotest_common.sh@941 -- # uname 00:06:20.626 01:48:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:20.626 01:48:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1088679 00:06:20.626 01:48:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:20.626 01:48:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:20.626 01:48:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1088679' 00:06:20.626 killing process with pid 1088679 00:06:20.626 01:48:54 -- common/autotest_common.sh@955 -- # kill 1088679 00:06:20.626 01:48:54 -- common/autotest_common.sh@960 -- # wait 1088679 00:06:20.884 00:06:20.884 real 0m2.201s 00:06:20.884 user 0m6.349s 00:06:20.884 sys 0m0.504s 00:06:20.884 01:48:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:20.884 01:48:55 -- common/autotest_common.sh@10 -- # set +x 00:06:20.884 ************************************ 00:06:20.884 END TEST locking_overlapped_coremask 00:06:20.884 ************************************ 00:06:20.884 01:48:55 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:20.884 01:48:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:20.884 01:48:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:20.884 01:48:55 -- common/autotest_common.sh@10 -- # set +x 00:06:20.884 ************************************ 00:06:20.884 START TEST locking_overlapped_coremask_via_rpc 00:06:20.884 ************************************ 00:06:20.884 01:48:55 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:20.884 01:48:55 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1088989 00:06:20.884 01:48:55 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:20.884 01:48:55 -- event/cpu_locks.sh@149 -- # waitforlisten 1088989 /var/tmp/spdk.sock 00:06:20.884 01:48:55 -- common/autotest_common.sh@829 -- # '[' -z 1088989 ']' 00:06:20.884 01:48:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:20.884 01:48:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:20.884 01:48:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:20.884 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:20.884 01:48:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:20.884 01:48:55 -- common/autotest_common.sh@10 -- # set +x 00:06:20.884 [2024-11-18 01:48:55.217052] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:20.884 [2024-11-18 01:48:55.217124] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088989 ] 00:06:20.884 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.884 [2024-11-18 01:48:55.275352] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:20.884 [2024-11-18 01:48:55.275392] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:21.142 [2024-11-18 01:48:55.364269] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:21.142 [2024-11-18 01:48:55.364506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:21.142 [2024-11-18 01:48:55.364564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:21.142 [2024-11-18 01:48:55.364582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.074 01:48:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:22.074 01:48:56 -- common/autotest_common.sh@862 -- # return 0 00:06:22.074 01:48:56 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1089014 00:06:22.074 01:48:56 -- event/cpu_locks.sh@153 -- # waitforlisten 1089014 /var/tmp/spdk2.sock 00:06:22.074 01:48:56 -- common/autotest_common.sh@829 -- # '[' -z 1089014 ']' 00:06:22.074 01:48:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:22.074 01:48:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:22.074 01:48:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:22.075 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:22.075 01:48:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:22.075 01:48:56 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:22.075 01:48:56 -- common/autotest_common.sh@10 -- # set +x 00:06:22.075 [2024-11-18 01:48:56.213032] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:22.075 [2024-11-18 01:48:56.213113] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089014 ] 00:06:22.075 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.075 [2024-11-18 01:48:56.306353] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:22.075 [2024-11-18 01:48:56.306387] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:22.333 [2024-11-18 01:48:56.482657] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:22.333 [2024-11-18 01:48:56.482981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:22.333 [2024-11-18 01:48:56.483046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:22.333 [2024-11-18 01:48:56.483048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:22.900 01:48:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:22.900 01:48:57 -- common/autotest_common.sh@862 -- # return 0 00:06:22.900 01:48:57 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:22.900 01:48:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:22.900 01:48:57 -- common/autotest_common.sh@10 -- # set +x 00:06:22.900 01:48:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:22.900 01:48:57 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:22.900 01:48:57 -- common/autotest_common.sh@650 -- # local es=0 00:06:22.900 01:48:57 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:22.900 01:48:57 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:22.900 01:48:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:22.900 01:48:57 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:22.900 01:48:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:22.900 01:48:57 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:22.900 01:48:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:22.900 01:48:57 -- common/autotest_common.sh@10 -- # set +x 00:06:22.900 [2024-11-18 01:48:57.199413] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1088989 has claimed it. 00:06:22.900 request: 00:06:22.900 { 00:06:22.900 "method": "framework_enable_cpumask_locks", 00:06:22.900 "req_id": 1 00:06:22.900 } 00:06:22.900 Got JSON-RPC error response 00:06:22.900 response: 00:06:22.900 { 00:06:22.900 "code": -32603, 00:06:22.900 "message": "Failed to claim CPU core: 2" 00:06:22.900 } 00:06:22.900 01:48:57 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:22.900 01:48:57 -- common/autotest_common.sh@653 -- # es=1 00:06:22.900 01:48:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:22.900 01:48:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:22.900 01:48:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:22.900 01:48:57 -- event/cpu_locks.sh@158 -- # waitforlisten 1088989 /var/tmp/spdk.sock 00:06:22.900 01:48:57 -- common/autotest_common.sh@829 -- # '[' -z 1088989 ']' 00:06:22.900 01:48:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:22.900 01:48:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:22.900 01:48:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:22.900 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:22.900 01:48:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:22.900 01:48:57 -- common/autotest_common.sh@10 -- # set +x 00:06:23.168 01:48:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:23.168 01:48:57 -- common/autotest_common.sh@862 -- # return 0 00:06:23.168 01:48:57 -- event/cpu_locks.sh@159 -- # waitforlisten 1089014 /var/tmp/spdk2.sock 00:06:23.168 01:48:57 -- common/autotest_common.sh@829 -- # '[' -z 1089014 ']' 00:06:23.168 01:48:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:23.168 01:48:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:23.168 01:48:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:23.168 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:23.168 01:48:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:23.168 01:48:57 -- common/autotest_common.sh@10 -- # set +x 00:06:23.426 01:48:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:23.426 01:48:57 -- common/autotest_common.sh@862 -- # return 0 00:06:23.426 01:48:57 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:23.426 01:48:57 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:23.426 01:48:57 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:23.426 01:48:57 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:23.426 00:06:23.426 real 0m2.548s 00:06:23.426 user 0m1.282s 00:06:23.426 sys 0m0.196s 00:06:23.426 01:48:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:23.426 01:48:57 -- common/autotest_common.sh@10 -- # set +x 00:06:23.426 ************************************ 00:06:23.426 END TEST locking_overlapped_coremask_via_rpc 00:06:23.426 ************************************ 00:06:23.426 01:48:57 -- event/cpu_locks.sh@174 -- # cleanup 00:06:23.426 01:48:57 -- event/cpu_locks.sh@15 -- # [[ -z 1088989 ]] 00:06:23.426 01:48:57 -- event/cpu_locks.sh@15 -- # killprocess 1088989 00:06:23.426 01:48:57 -- common/autotest_common.sh@936 -- # '[' -z 1088989 ']' 00:06:23.426 01:48:57 -- common/autotest_common.sh@940 -- # kill -0 1088989 00:06:23.426 01:48:57 -- common/autotest_common.sh@941 -- # uname 00:06:23.426 01:48:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:23.426 01:48:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1088989 00:06:23.426 01:48:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:23.426 01:48:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:23.426 01:48:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1088989' 00:06:23.426 killing process with pid 1088989 00:06:23.426 01:48:57 -- common/autotest_common.sh@955 -- # kill 1088989 00:06:23.426 01:48:57 -- common/autotest_common.sh@960 -- # wait 1088989 00:06:23.992 01:48:58 -- event/cpu_locks.sh@16 -- # [[ -z 1089014 ]] 00:06:23.992 01:48:58 -- event/cpu_locks.sh@16 -- # killprocess 1089014 00:06:23.992 01:48:58 -- common/autotest_common.sh@936 -- # '[' -z 1089014 ']' 00:06:23.992 01:48:58 -- common/autotest_common.sh@940 -- # kill -0 1089014 00:06:23.992 01:48:58 -- common/autotest_common.sh@941 -- # uname 00:06:23.992 01:48:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:23.992 01:48:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1089014 00:06:23.992 01:48:58 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:23.992 01:48:58 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:23.992 01:48:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1089014' 00:06:23.992 killing process with pid 1089014 00:06:23.992 01:48:58 -- common/autotest_common.sh@955 -- # kill 1089014 00:06:23.992 01:48:58 -- common/autotest_common.sh@960 -- # wait 1089014 00:06:24.250 01:48:58 -- event/cpu_locks.sh@18 -- # rm -f 00:06:24.250 01:48:58 -- event/cpu_locks.sh@1 -- # cleanup 00:06:24.250 01:48:58 -- event/cpu_locks.sh@15 -- # [[ -z 1088989 ]] 00:06:24.250 01:48:58 -- event/cpu_locks.sh@15 -- # killprocess 1088989 00:06:24.250 01:48:58 -- common/autotest_common.sh@936 -- # '[' -z 1088989 ']' 00:06:24.250 01:48:58 -- common/autotest_common.sh@940 -- # kill -0 1088989 00:06:24.250 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1088989) - No such process 00:06:24.250 01:48:58 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1088989 is not found' 00:06:24.250 Process with pid 1088989 is not found 00:06:24.250 01:48:58 -- event/cpu_locks.sh@16 -- # [[ -z 1089014 ]] 00:06:24.250 01:48:58 -- event/cpu_locks.sh@16 -- # killprocess 1089014 00:06:24.250 01:48:58 -- common/autotest_common.sh@936 -- # '[' -z 1089014 ']' 00:06:24.250 01:48:58 -- common/autotest_common.sh@940 -- # kill -0 1089014 00:06:24.250 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1089014) - No such process 00:06:24.250 01:48:58 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1089014 is not found' 00:06:24.250 Process with pid 1089014 is not found 00:06:24.250 01:48:58 -- event/cpu_locks.sh@18 -- # rm -f 00:06:24.250 00:06:24.250 real 0m19.207s 00:06:24.250 user 0m34.945s 00:06:24.250 sys 0m5.473s 00:06:24.250 01:48:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.250 01:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:24.250 ************************************ 00:06:24.250 END TEST cpu_locks 00:06:24.250 ************************************ 00:06:24.250 00:06:24.250 real 0m45.858s 00:06:24.250 user 1m28.624s 00:06:24.250 sys 0m9.396s 00:06:24.250 01:48:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.250 01:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:24.250 ************************************ 00:06:24.250 END TEST event 00:06:24.250 ************************************ 00:06:24.250 01:48:58 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:24.250 01:48:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:24.250 01:48:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.250 01:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:24.508 ************************************ 00:06:24.508 START TEST thread 00:06:24.508 ************************************ 00:06:24.508 01:48:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:24.508 * Looking for test storage... 00:06:24.508 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:24.508 01:48:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:24.508 01:48:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:24.508 01:48:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:24.508 01:48:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:24.508 01:48:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:24.508 01:48:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:24.508 01:48:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:24.508 01:48:58 -- scripts/common.sh@335 -- # IFS=.-: 00:06:24.508 01:48:58 -- scripts/common.sh@335 -- # read -ra ver1 00:06:24.508 01:48:58 -- scripts/common.sh@336 -- # IFS=.-: 00:06:24.508 01:48:58 -- scripts/common.sh@336 -- # read -ra ver2 00:06:24.508 01:48:58 -- scripts/common.sh@337 -- # local 'op=<' 00:06:24.508 01:48:58 -- scripts/common.sh@339 -- # ver1_l=2 00:06:24.508 01:48:58 -- scripts/common.sh@340 -- # ver2_l=1 00:06:24.508 01:48:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:24.508 01:48:58 -- scripts/common.sh@343 -- # case "$op" in 00:06:24.508 01:48:58 -- scripts/common.sh@344 -- # : 1 00:06:24.508 01:48:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:24.508 01:48:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:24.508 01:48:58 -- scripts/common.sh@364 -- # decimal 1 00:06:24.508 01:48:58 -- scripts/common.sh@352 -- # local d=1 00:06:24.508 01:48:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:24.508 01:48:58 -- scripts/common.sh@354 -- # echo 1 00:06:24.508 01:48:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:24.508 01:48:58 -- scripts/common.sh@365 -- # decimal 2 00:06:24.508 01:48:58 -- scripts/common.sh@352 -- # local d=2 00:06:24.508 01:48:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:24.508 01:48:58 -- scripts/common.sh@354 -- # echo 2 00:06:24.508 01:48:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:24.508 01:48:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:24.508 01:48:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:24.508 01:48:58 -- scripts/common.sh@367 -- # return 0 00:06:24.508 01:48:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:24.508 01:48:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:24.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.508 --rc genhtml_branch_coverage=1 00:06:24.508 --rc genhtml_function_coverage=1 00:06:24.508 --rc genhtml_legend=1 00:06:24.508 --rc geninfo_all_blocks=1 00:06:24.508 --rc geninfo_unexecuted_blocks=1 00:06:24.508 00:06:24.508 ' 00:06:24.508 01:48:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:24.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.509 --rc genhtml_branch_coverage=1 00:06:24.509 --rc genhtml_function_coverage=1 00:06:24.509 --rc genhtml_legend=1 00:06:24.509 --rc geninfo_all_blocks=1 00:06:24.509 --rc geninfo_unexecuted_blocks=1 00:06:24.509 00:06:24.509 ' 00:06:24.509 01:48:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:24.509 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.509 --rc genhtml_branch_coverage=1 00:06:24.509 --rc genhtml_function_coverage=1 00:06:24.509 --rc genhtml_legend=1 00:06:24.509 --rc geninfo_all_blocks=1 00:06:24.509 --rc geninfo_unexecuted_blocks=1 00:06:24.509 00:06:24.509 ' 00:06:24.509 01:48:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:24.509 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.509 --rc genhtml_branch_coverage=1 00:06:24.509 --rc genhtml_function_coverage=1 00:06:24.509 --rc genhtml_legend=1 00:06:24.509 --rc geninfo_all_blocks=1 00:06:24.509 --rc geninfo_unexecuted_blocks=1 00:06:24.509 00:06:24.509 ' 00:06:24.509 01:48:58 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:24.509 01:48:58 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:24.509 01:48:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.509 01:48:58 -- common/autotest_common.sh@10 -- # set +x 00:06:24.509 ************************************ 00:06:24.509 START TEST thread_poller_perf 00:06:24.509 ************************************ 00:06:24.509 01:48:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:24.509 [2024-11-18 01:48:58.810089] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:24.509 [2024-11-18 01:48:58.810177] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089510 ] 00:06:24.509 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.509 [2024-11-18 01:48:58.869304] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.767 [2024-11-18 01:48:58.958579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.767 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:25.710 [2024-11-18T00:49:00.112Z] ====================================== 00:06:25.710 [2024-11-18T00:49:00.112Z] busy:2712853026 (cyc) 00:06:25.710 [2024-11-18T00:49:00.112Z] total_run_count: 279000 00:06:25.710 [2024-11-18T00:49:00.112Z] tsc_hz: 2700000000 (cyc) 00:06:25.710 [2024-11-18T00:49:00.112Z] ====================================== 00:06:25.710 [2024-11-18T00:49:00.112Z] poller_cost: 9723 (cyc), 3601 (nsec) 00:06:25.710 00:06:25.710 real 0m1.254s 00:06:25.710 user 0m1.163s 00:06:25.710 sys 0m0.083s 00:06:25.710 01:49:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.710 01:49:00 -- common/autotest_common.sh@10 -- # set +x 00:06:25.710 ************************************ 00:06:25.710 END TEST thread_poller_perf 00:06:25.710 ************************************ 00:06:25.710 01:49:00 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:25.710 01:49:00 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:25.710 01:49:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.710 01:49:00 -- common/autotest_common.sh@10 -- # set +x 00:06:25.710 ************************************ 00:06:25.710 START TEST thread_poller_perf 00:06:25.710 ************************************ 00:06:25.710 01:49:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:25.710 [2024-11-18 01:49:00.093258] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:25.710 [2024-11-18 01:49:00.093373] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089672 ] 00:06:25.968 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.968 [2024-11-18 01:49:00.157000] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.968 [2024-11-18 01:49:00.248123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.968 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:27.343 [2024-11-18T00:49:01.745Z] ====================================== 00:06:27.343 [2024-11-18T00:49:01.745Z] busy:2703552878 (cyc) 00:06:27.343 [2024-11-18T00:49:01.745Z] total_run_count: 3828000 00:06:27.343 [2024-11-18T00:49:01.745Z] tsc_hz: 2700000000 (cyc) 00:06:27.343 [2024-11-18T00:49:01.745Z] ====================================== 00:06:27.343 [2024-11-18T00:49:01.745Z] poller_cost: 706 (cyc), 261 (nsec) 00:06:27.343 00:06:27.343 real 0m1.252s 00:06:27.343 user 0m1.156s 00:06:27.343 sys 0m0.089s 00:06:27.343 01:49:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.343 01:49:01 -- common/autotest_common.sh@10 -- # set +x 00:06:27.343 ************************************ 00:06:27.343 END TEST thread_poller_perf 00:06:27.343 ************************************ 00:06:27.343 01:49:01 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:27.343 00:06:27.343 real 0m2.701s 00:06:27.343 user 0m2.435s 00:06:27.343 sys 0m0.269s 00:06:27.343 01:49:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.343 01:49:01 -- common/autotest_common.sh@10 -- # set +x 00:06:27.343 ************************************ 00:06:27.343 END TEST thread 00:06:27.343 ************************************ 00:06:27.343 01:49:01 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:27.343 01:49:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.343 01:49:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.343 01:49:01 -- common/autotest_common.sh@10 -- # set +x 00:06:27.343 ************************************ 00:06:27.343 START TEST accel 00:06:27.343 ************************************ 00:06:27.343 01:49:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:27.343 * Looking for test storage... 00:06:27.343 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:27.343 01:49:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:27.343 01:49:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:27.343 01:49:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:27.343 01:49:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:27.343 01:49:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:27.343 01:49:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:27.343 01:49:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:27.343 01:49:01 -- scripts/common.sh@335 -- # IFS=.-: 00:06:27.343 01:49:01 -- scripts/common.sh@335 -- # read -ra ver1 00:06:27.343 01:49:01 -- scripts/common.sh@336 -- # IFS=.-: 00:06:27.343 01:49:01 -- scripts/common.sh@336 -- # read -ra ver2 00:06:27.343 01:49:01 -- scripts/common.sh@337 -- # local 'op=<' 00:06:27.343 01:49:01 -- scripts/common.sh@339 -- # ver1_l=2 00:06:27.343 01:49:01 -- scripts/common.sh@340 -- # ver2_l=1 00:06:27.343 01:49:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:27.343 01:49:01 -- scripts/common.sh@343 -- # case "$op" in 00:06:27.343 01:49:01 -- scripts/common.sh@344 -- # : 1 00:06:27.343 01:49:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:27.343 01:49:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:27.343 01:49:01 -- scripts/common.sh@364 -- # decimal 1 00:06:27.343 01:49:01 -- scripts/common.sh@352 -- # local d=1 00:06:27.343 01:49:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:27.343 01:49:01 -- scripts/common.sh@354 -- # echo 1 00:06:27.343 01:49:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:27.343 01:49:01 -- scripts/common.sh@365 -- # decimal 2 00:06:27.343 01:49:01 -- scripts/common.sh@352 -- # local d=2 00:06:27.343 01:49:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:27.343 01:49:01 -- scripts/common.sh@354 -- # echo 2 00:06:27.343 01:49:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:27.343 01:49:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:27.343 01:49:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:27.343 01:49:01 -- scripts/common.sh@367 -- # return 0 00:06:27.343 01:49:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:27.343 01:49:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:27.343 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.343 --rc genhtml_branch_coverage=1 00:06:27.343 --rc genhtml_function_coverage=1 00:06:27.343 --rc genhtml_legend=1 00:06:27.343 --rc geninfo_all_blocks=1 00:06:27.343 --rc geninfo_unexecuted_blocks=1 00:06:27.343 00:06:27.343 ' 00:06:27.343 01:49:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:27.343 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.343 --rc genhtml_branch_coverage=1 00:06:27.343 --rc genhtml_function_coverage=1 00:06:27.343 --rc genhtml_legend=1 00:06:27.343 --rc geninfo_all_blocks=1 00:06:27.343 --rc geninfo_unexecuted_blocks=1 00:06:27.343 00:06:27.343 ' 00:06:27.343 01:49:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:27.343 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.343 --rc genhtml_branch_coverage=1 00:06:27.343 --rc genhtml_function_coverage=1 00:06:27.343 --rc genhtml_legend=1 00:06:27.343 --rc geninfo_all_blocks=1 00:06:27.343 --rc geninfo_unexecuted_blocks=1 00:06:27.343 00:06:27.343 ' 00:06:27.343 01:49:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:27.343 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.343 --rc genhtml_branch_coverage=1 00:06:27.343 --rc genhtml_function_coverage=1 00:06:27.343 --rc genhtml_legend=1 00:06:27.343 --rc geninfo_all_blocks=1 00:06:27.343 --rc geninfo_unexecuted_blocks=1 00:06:27.343 00:06:27.343 ' 00:06:27.343 01:49:01 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:27.343 01:49:01 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:27.343 01:49:01 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:27.343 01:49:01 -- accel/accel.sh@59 -- # spdk_tgt_pid=1089876 00:06:27.343 01:49:01 -- accel/accel.sh@60 -- # waitforlisten 1089876 00:06:27.343 01:49:01 -- common/autotest_common.sh@829 -- # '[' -z 1089876 ']' 00:06:27.343 01:49:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.343 01:49:01 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:27.343 01:49:01 -- accel/accel.sh@58 -- # build_accel_config 00:06:27.343 01:49:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.343 01:49:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.343 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.343 01:49:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.343 01:49:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.343 01:49:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.343 01:49:01 -- common/autotest_common.sh@10 -- # set +x 00:06:27.343 01:49:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.343 01:49:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.343 01:49:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.343 01:49:01 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.343 01:49:01 -- accel/accel.sh@42 -- # jq -r . 00:06:27.343 [2024-11-18 01:49:01.572374] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:27.343 [2024-11-18 01:49:01.572480] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089876 ] 00:06:27.343 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.343 [2024-11-18 01:49:01.631813] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.343 [2024-11-18 01:49:01.725856] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:27.343 [2024-11-18 01:49:01.726038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.277 01:49:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:28.277 01:49:02 -- common/autotest_common.sh@862 -- # return 0 00:06:28.277 01:49:02 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:28.277 01:49:02 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:28.277 01:49:02 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:28.277 01:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.277 01:49:02 -- common/autotest_common.sh@10 -- # set +x 00:06:28.277 01:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # IFS== 00:06:28.277 01:49:02 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.277 01:49:02 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.277 01:49:02 -- accel/accel.sh@67 -- # killprocess 1089876 00:06:28.277 01:49:02 -- common/autotest_common.sh@936 -- # '[' -z 1089876 ']' 00:06:28.277 01:49:02 -- common/autotest_common.sh@940 -- # kill -0 1089876 00:06:28.277 01:49:02 -- common/autotest_common.sh@941 -- # uname 00:06:28.277 01:49:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:28.277 01:49:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1089876 00:06:28.277 01:49:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:28.277 01:49:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:28.277 01:49:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1089876' 00:06:28.277 killing process with pid 1089876 00:06:28.277 01:49:02 -- common/autotest_common.sh@955 -- # kill 1089876 00:06:28.277 01:49:02 -- common/autotest_common.sh@960 -- # wait 1089876 00:06:28.843 01:49:03 -- accel/accel.sh@68 -- # trap - ERR 00:06:28.843 01:49:03 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:28.843 01:49:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:28.843 01:49:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:28.843 01:49:03 -- common/autotest_common.sh@10 -- # set +x 00:06:28.843 01:49:03 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:28.843 01:49:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:28.843 01:49:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:28.843 01:49:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:28.843 01:49:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:28.843 01:49:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:28.843 01:49:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:28.843 01:49:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:28.843 01:49:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:28.843 01:49:03 -- accel/accel.sh@42 -- # jq -r . 00:06:28.843 01:49:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:28.843 01:49:03 -- common/autotest_common.sh@10 -- # set +x 00:06:28.843 01:49:03 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:28.843 01:49:03 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:28.843 01:49:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:28.843 01:49:03 -- common/autotest_common.sh@10 -- # set +x 00:06:28.843 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/scheduler/common.sh: trap: line 2: unexpected EOF while looking for matching `)' 00:06:28.843 ************************************ 00:06:28.843 START TEST accel_missing_filename 00:06:28.843 ************************************ 00:06:28.843 01:49:03 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:28.843 01:49:03 -- common/autotest_common.sh@650 -- # local es=0 00:06:28.843 01:49:03 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:28.843 01:49:03 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:28.843 01:49:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:28.843 01:49:03 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:28.843 01:49:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:28.843 01:49:03 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:28.843 01:49:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:28.843 01:49:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:28.843 01:49:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:28.843 01:49:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:28.843 01:49:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:28.843 01:49:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:28.843 01:49:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:28.843 01:49:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:28.843 01:49:03 -- accel/accel.sh@42 -- # jq -r . 00:06:28.843 [2024-11-18 01:49:03.099356] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:28.843 [2024-11-18 01:49:03.099440] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090178 ] 00:06:28.843 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.843 [2024-11-18 01:49:03.162922] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.103 [2024-11-18 01:49:03.253445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.103 [2024-11-18 01:49:03.315346] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:29.103 [2024-11-18 01:49:03.403972] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:29.103 A filename is required. 00:06:29.103 01:49:03 -- common/autotest_common.sh@653 -- # es=234 00:06:29.103 01:49:03 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:29.103 01:49:03 -- common/autotest_common.sh@662 -- # es=106 00:06:29.103 01:49:03 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:29.103 01:49:03 -- common/autotest_common.sh@670 -- # es=1 00:06:29.103 01:49:03 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:29.103 00:06:29.103 real 0m0.403s 00:06:29.103 user 0m0.289s 00:06:29.103 sys 0m0.146s 00:06:29.103 01:49:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.103 01:49:03 -- common/autotest_common.sh@10 -- # set +x 00:06:29.103 ************************************ 00:06:29.103 END TEST accel_missing_filename 00:06:29.103 ************************************ 00:06:29.361 01:49:03 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:29.361 01:49:03 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:29.361 01:49:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.361 01:49:03 -- common/autotest_common.sh@10 -- # set +x 00:06:29.361 ************************************ 00:06:29.361 START TEST accel_compress_verify 00:06:29.361 ************************************ 00:06:29.361 01:49:03 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:29.361 01:49:03 -- common/autotest_common.sh@650 -- # local es=0 00:06:29.361 01:49:03 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:29.361 01:49:03 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:29.361 01:49:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.361 01:49:03 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:29.361 01:49:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.361 01:49:03 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:29.361 01:49:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:29.361 01:49:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.361 01:49:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.361 01:49:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.361 01:49:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.362 01:49:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.362 01:49:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.362 01:49:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.362 01:49:03 -- accel/accel.sh@42 -- # jq -r . 00:06:29.362 [2024-11-18 01:49:03.535250] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:29.362 [2024-11-18 01:49:03.535343] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090198 ] 00:06:29.362 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.362 [2024-11-18 01:49:03.598037] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.362 [2024-11-18 01:49:03.685957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.362 [2024-11-18 01:49:03.747407] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:29.620 [2024-11-18 01:49:03.825526] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:29.620 00:06:29.620 Compression does not support the verify option, aborting. 00:06:29.620 01:49:03 -- common/autotest_common.sh@653 -- # es=161 00:06:29.620 01:49:03 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:29.620 01:49:03 -- common/autotest_common.sh@662 -- # es=33 00:06:29.620 01:49:03 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:29.620 01:49:03 -- common/autotest_common.sh@670 -- # es=1 00:06:29.620 01:49:03 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:29.620 00:06:29.620 real 0m0.394s 00:06:29.620 user 0m0.282s 00:06:29.620 sys 0m0.146s 00:06:29.620 01:49:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.620 01:49:03 -- common/autotest_common.sh@10 -- # set +x 00:06:29.620 ************************************ 00:06:29.620 END TEST accel_compress_verify 00:06:29.620 ************************************ 00:06:29.620 01:49:03 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:29.620 01:49:03 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:29.620 01:49:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.620 01:49:03 -- common/autotest_common.sh@10 -- # set +x 00:06:29.620 ************************************ 00:06:29.620 START TEST accel_wrong_workload 00:06:29.620 ************************************ 00:06:29.620 01:49:03 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:29.620 01:49:03 -- common/autotest_common.sh@650 -- # local es=0 00:06:29.620 01:49:03 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:29.620 01:49:03 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:29.620 01:49:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.620 01:49:03 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:29.620 01:49:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.620 01:49:03 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:29.620 01:49:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:29.620 01:49:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.620 01:49:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.620 01:49:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.620 01:49:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.620 01:49:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.620 01:49:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.620 01:49:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.620 01:49:03 -- accel/accel.sh@42 -- # jq -r . 00:06:29.620 Unsupported workload type: foobar 00:06:29.620 [2024-11-18 01:49:03.954208] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:29.620 accel_perf options: 00:06:29.620 [-h help message] 00:06:29.620 [-q queue depth per core] 00:06:29.620 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:29.620 [-T number of threads per core 00:06:29.620 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:29.620 [-t time in seconds] 00:06:29.620 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:29.620 [ dif_verify, , dif_generate, dif_generate_copy 00:06:29.620 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:29.620 [-l for compress/decompress workloads, name of uncompressed input file 00:06:29.620 [-S for crc32c workload, use this seed value (default 0) 00:06:29.620 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:29.620 [-f for fill workload, use this BYTE value (default 255) 00:06:29.620 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:29.620 [-y verify result if this switch is on] 00:06:29.620 [-a tasks to allocate per core (default: same value as -q)] 00:06:29.620 Can be used to spread operations across a wider range of memory. 00:06:29.620 01:49:03 -- common/autotest_common.sh@653 -- # es=1 00:06:29.620 01:49:03 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:29.620 01:49:03 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:29.620 01:49:03 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:29.620 00:06:29.620 real 0m0.024s 00:06:29.620 user 0m0.013s 00:06:29.620 sys 0m0.011s 00:06:29.620 01:49:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.620 01:49:03 -- common/autotest_common.sh@10 -- # set +x 00:06:29.620 ************************************ 00:06:29.620 END TEST accel_wrong_workload 00:06:29.620 ************************************ 00:06:29.620 Error: writing output failed: Broken pipe 00:06:29.620 01:49:03 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:29.620 01:49:03 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:29.620 01:49:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.620 01:49:03 -- common/autotest_common.sh@10 -- # set +x 00:06:29.620 ************************************ 00:06:29.620 START TEST accel_negative_buffers 00:06:29.620 ************************************ 00:06:29.620 01:49:03 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:29.620 01:49:03 -- common/autotest_common.sh@650 -- # local es=0 00:06:29.620 01:49:03 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:29.620 01:49:03 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:29.620 01:49:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.620 01:49:03 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:29.620 01:49:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.620 01:49:03 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:29.620 01:49:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:29.620 01:49:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.620 01:49:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.620 01:49:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.620 01:49:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.620 01:49:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.620 01:49:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.620 01:49:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.620 01:49:03 -- accel/accel.sh@42 -- # jq -r . 00:06:29.620 -x option must be non-negative. 00:06:29.620 [2024-11-18 01:49:04.003502] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:29.620 accel_perf options: 00:06:29.620 [-h help message] 00:06:29.620 [-q queue depth per core] 00:06:29.620 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:29.620 [-T number of threads per core 00:06:29.620 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:29.620 [-t time in seconds] 00:06:29.620 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:29.620 [ dif_verify, , dif_generate, dif_generate_copy 00:06:29.621 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:29.621 [-l for compress/decompress workloads, name of uncompressed input file 00:06:29.621 [-S for crc32c workload, use this seed value (default 0) 00:06:29.621 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:29.621 [-f for fill workload, use this BYTE value (default 255) 00:06:29.621 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:29.621 [-y verify result if this switch is on] 00:06:29.621 [-a tasks to allocate per core (default: same value as -q)] 00:06:29.621 Can be used to spread operations across a wider range of memory. 00:06:29.621 01:49:04 -- common/autotest_common.sh@653 -- # es=1 00:06:29.621 01:49:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:29.621 01:49:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:29.621 01:49:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:29.621 00:06:29.621 real 0m0.023s 00:06:29.621 user 0m0.018s 00:06:29.621 sys 0m0.005s 00:06:29.621 01:49:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.621 01:49:04 -- common/autotest_common.sh@10 -- # set +x 00:06:29.621 ************************************ 00:06:29.621 END TEST accel_negative_buffers 00:06:29.621 ************************************ 00:06:29.879 Error: writing output failed: Broken pipe 00:06:29.879 01:49:04 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:29.879 01:49:04 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:29.879 01:49:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.879 01:49:04 -- common/autotest_common.sh@10 -- # set +x 00:06:29.879 ************************************ 00:06:29.879 START TEST accel_crc32c 00:06:29.879 ************************************ 00:06:29.879 01:49:04 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:29.879 01:49:04 -- accel/accel.sh@16 -- # local accel_opc 00:06:29.879 01:49:04 -- accel/accel.sh@17 -- # local accel_module 00:06:29.879 01:49:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:29.879 01:49:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:29.879 01:49:04 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.879 01:49:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.879 01:49:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.879 01:49:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.879 01:49:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.879 01:49:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.879 01:49:04 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.879 01:49:04 -- accel/accel.sh@42 -- # jq -r . 00:06:29.879 [2024-11-18 01:49:04.051755] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:29.879 [2024-11-18 01:49:04.051815] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090256 ] 00:06:29.879 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.879 [2024-11-18 01:49:04.115066] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.879 [2024-11-18 01:49:04.206069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.285 01:49:05 -- accel/accel.sh@18 -- # out=' 00:06:31.285 SPDK Configuration: 00:06:31.285 Core mask: 0x1 00:06:31.285 00:06:31.285 Accel Perf Configuration: 00:06:31.285 Workload Type: crc32c 00:06:31.285 CRC-32C seed: 32 00:06:31.285 Transfer size: 4096 bytes 00:06:31.285 Vector count 1 00:06:31.285 Module: software 00:06:31.285 Queue depth: 32 00:06:31.285 Allocate depth: 32 00:06:31.285 # threads/core: 1 00:06:31.285 Run time: 1 seconds 00:06:31.285 Verify: Yes 00:06:31.285 00:06:31.285 Running for 1 seconds... 00:06:31.285 00:06:31.285 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:31.285 ------------------------------------------------------------------------------------ 00:06:31.285 0,0 406688/s 1588 MiB/s 0 0 00:06:31.285 ==================================================================================== 00:06:31.285 Total 406688/s 1588 MiB/s 0 0' 00:06:31.285 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.285 01:49:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:31.285 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.285 01:49:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:31.285 01:49:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:31.285 01:49:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:31.285 01:49:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:31.285 01:49:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:31.285 01:49:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:31.285 01:49:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:31.285 01:49:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:31.285 01:49:05 -- accel/accel.sh@42 -- # jq -r . 00:06:31.285 [2024-11-18 01:49:05.448760] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:31.285 [2024-11-18 01:49:05.448838] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090525 ] 00:06:31.285 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.285 [2024-11-18 01:49:05.510473] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.285 [2024-11-18 01:49:05.601043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.285 01:49:05 -- accel/accel.sh@21 -- # val= 00:06:31.285 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.285 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.285 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.285 01:49:05 -- accel/accel.sh@21 -- # val= 00:06:31.285 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.285 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.285 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.285 01:49:05 -- accel/accel.sh@21 -- # val=0x1 00:06:31.286 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.286 01:49:05 -- accel/accel.sh@21 -- # val= 00:06:31.286 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.286 01:49:05 -- accel/accel.sh@21 -- # val= 00:06:31.286 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.286 01:49:05 -- accel/accel.sh@21 -- # val=crc32c 00:06:31.286 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.286 01:49:05 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.286 01:49:05 -- accel/accel.sh@21 -- # val=32 00:06:31.286 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.286 01:49:05 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:31.286 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.286 01:49:05 -- accel/accel.sh@21 -- # val= 00:06:31.286 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.286 01:49:05 -- accel/accel.sh@21 -- # val=software 00:06:31.286 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.286 01:49:05 -- accel/accel.sh@23 -- # accel_module=software 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.286 01:49:05 -- accel/accel.sh@21 -- # val=32 00:06:31.286 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.286 01:49:05 -- accel/accel.sh@21 -- # val=32 00:06:31.286 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.286 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.286 01:49:05 -- accel/accel.sh@21 -- # val=1 00:06:31.566 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.566 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.566 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.566 01:49:05 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:31.566 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.566 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.566 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.566 01:49:05 -- accel/accel.sh@21 -- # val=Yes 00:06:31.566 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.566 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.566 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.566 01:49:05 -- accel/accel.sh@21 -- # val= 00:06:31.566 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.567 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.567 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:31.567 01:49:05 -- accel/accel.sh@21 -- # val= 00:06:31.567 01:49:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.567 01:49:05 -- accel/accel.sh@20 -- # IFS=: 00:06:31.567 01:49:05 -- accel/accel.sh@20 -- # read -r var val 00:06:32.500 01:49:06 -- accel/accel.sh@21 -- # val= 00:06:32.500 01:49:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.500 01:49:06 -- accel/accel.sh@20 -- # IFS=: 00:06:32.500 01:49:06 -- accel/accel.sh@20 -- # read -r var val 00:06:32.500 01:49:06 -- accel/accel.sh@21 -- # val= 00:06:32.500 01:49:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.500 01:49:06 -- accel/accel.sh@20 -- # IFS=: 00:06:32.500 01:49:06 -- accel/accel.sh@20 -- # read -r var val 00:06:32.500 01:49:06 -- accel/accel.sh@21 -- # val= 00:06:32.500 01:49:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.500 01:49:06 -- accel/accel.sh@20 -- # IFS=: 00:06:32.500 01:49:06 -- accel/accel.sh@20 -- # read -r var val 00:06:32.500 01:49:06 -- accel/accel.sh@21 -- # val= 00:06:32.500 01:49:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.500 01:49:06 -- accel/accel.sh@20 -- # IFS=: 00:06:32.500 01:49:06 -- accel/accel.sh@20 -- # read -r var val 00:06:32.500 01:49:06 -- accel/accel.sh@21 -- # val= 00:06:32.500 01:49:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.500 01:49:06 -- accel/accel.sh@20 -- # IFS=: 00:06:32.501 01:49:06 -- accel/accel.sh@20 -- # read -r var val 00:06:32.501 01:49:06 -- accel/accel.sh@21 -- # val= 00:06:32.501 01:49:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.501 01:49:06 -- accel/accel.sh@20 -- # IFS=: 00:06:32.501 01:49:06 -- accel/accel.sh@20 -- # read -r var val 00:06:32.501 01:49:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:32.501 01:49:06 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:32.501 01:49:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:32.501 00:06:32.501 real 0m2.806s 00:06:32.501 user 0m2.511s 00:06:32.501 sys 0m0.288s 00:06:32.501 01:49:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:32.501 01:49:06 -- common/autotest_common.sh@10 -- # set +x 00:06:32.501 ************************************ 00:06:32.501 END TEST accel_crc32c 00:06:32.501 ************************************ 00:06:32.501 01:49:06 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:32.501 01:49:06 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:32.501 01:49:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.501 01:49:06 -- common/autotest_common.sh@10 -- # set +x 00:06:32.501 ************************************ 00:06:32.501 START TEST accel_crc32c_C2 00:06:32.501 ************************************ 00:06:32.501 01:49:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:32.501 01:49:06 -- accel/accel.sh@16 -- # local accel_opc 00:06:32.501 01:49:06 -- accel/accel.sh@17 -- # local accel_module 00:06:32.501 01:49:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:32.501 01:49:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:32.501 01:49:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.501 01:49:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:32.501 01:49:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.501 01:49:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.501 01:49:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:32.501 01:49:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:32.501 01:49:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:32.501 01:49:06 -- accel/accel.sh@42 -- # jq -r . 00:06:32.501 [2024-11-18 01:49:06.885602] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:32.501 [2024-11-18 01:49:06.885695] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090683 ] 00:06:32.759 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.759 [2024-11-18 01:49:06.947704] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.759 [2024-11-18 01:49:07.037787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.133 01:49:08 -- accel/accel.sh@18 -- # out=' 00:06:34.133 SPDK Configuration: 00:06:34.133 Core mask: 0x1 00:06:34.133 00:06:34.133 Accel Perf Configuration: 00:06:34.133 Workload Type: crc32c 00:06:34.133 CRC-32C seed: 0 00:06:34.133 Transfer size: 4096 bytes 00:06:34.133 Vector count 2 00:06:34.133 Module: software 00:06:34.133 Queue depth: 32 00:06:34.133 Allocate depth: 32 00:06:34.133 # threads/core: 1 00:06:34.133 Run time: 1 seconds 00:06:34.133 Verify: Yes 00:06:34.133 00:06:34.133 Running for 1 seconds... 00:06:34.133 00:06:34.133 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:34.133 ------------------------------------------------------------------------------------ 00:06:34.133 0,0 314880/s 2460 MiB/s 0 0 00:06:34.133 ==================================================================================== 00:06:34.133 Total 314880/s 1230 MiB/s 0 0' 00:06:34.133 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.133 01:49:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:34.133 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.133 01:49:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:34.133 01:49:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:34.134 01:49:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:34.134 01:49:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:34.134 01:49:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:34.134 01:49:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:34.134 01:49:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:34.134 01:49:08 -- accel/accel.sh@41 -- # local IFS=, 00:06:34.134 01:49:08 -- accel/accel.sh@42 -- # jq -r . 00:06:34.134 [2024-11-18 01:49:08.292533] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:34.134 [2024-11-18 01:49:08.292611] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090829 ] 00:06:34.134 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.134 [2024-11-18 01:49:08.354855] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.134 [2024-11-18 01:49:08.444071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val= 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val= 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val=0x1 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val= 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val= 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val=crc32c 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val=0 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val= 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val=software 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@23 -- # accel_module=software 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val=32 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val=32 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val=1 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val=Yes 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val= 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:34.134 01:49:08 -- accel/accel.sh@21 -- # val= 00:06:34.134 01:49:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # IFS=: 00:06:34.134 01:49:08 -- accel/accel.sh@20 -- # read -r var val 00:06:35.506 01:49:09 -- accel/accel.sh@21 -- # val= 00:06:35.506 01:49:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.506 01:49:09 -- accel/accel.sh@20 -- # IFS=: 00:06:35.506 01:49:09 -- accel/accel.sh@20 -- # read -r var val 00:06:35.506 01:49:09 -- accel/accel.sh@21 -- # val= 00:06:35.506 01:49:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.506 01:49:09 -- accel/accel.sh@20 -- # IFS=: 00:06:35.506 01:49:09 -- accel/accel.sh@20 -- # read -r var val 00:06:35.506 01:49:09 -- accel/accel.sh@21 -- # val= 00:06:35.506 01:49:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.506 01:49:09 -- accel/accel.sh@20 -- # IFS=: 00:06:35.506 01:49:09 -- accel/accel.sh@20 -- # read -r var val 00:06:35.506 01:49:09 -- accel/accel.sh@21 -- # val= 00:06:35.506 01:49:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.506 01:49:09 -- accel/accel.sh@20 -- # IFS=: 00:06:35.506 01:49:09 -- accel/accel.sh@20 -- # read -r var val 00:06:35.506 01:49:09 -- accel/accel.sh@21 -- # val= 00:06:35.506 01:49:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.506 01:49:09 -- accel/accel.sh@20 -- # IFS=: 00:06:35.506 01:49:09 -- accel/accel.sh@20 -- # read -r var val 00:06:35.506 01:49:09 -- accel/accel.sh@21 -- # val= 00:06:35.506 01:49:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.506 01:49:09 -- accel/accel.sh@20 -- # IFS=: 00:06:35.506 01:49:09 -- accel/accel.sh@20 -- # read -r var val 00:06:35.506 01:49:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:35.506 01:49:09 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:35.506 01:49:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:35.506 00:06:35.506 real 0m2.808s 00:06:35.506 user 0m2.501s 00:06:35.506 sys 0m0.299s 00:06:35.506 01:49:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.506 01:49:09 -- common/autotest_common.sh@10 -- # set +x 00:06:35.506 ************************************ 00:06:35.506 END TEST accel_crc32c_C2 00:06:35.506 ************************************ 00:06:35.506 01:49:09 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:35.506 01:49:09 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:35.506 01:49:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.506 01:49:09 -- common/autotest_common.sh@10 -- # set +x 00:06:35.506 ************************************ 00:06:35.506 START TEST accel_copy 00:06:35.506 ************************************ 00:06:35.506 01:49:09 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:06:35.506 01:49:09 -- accel/accel.sh@16 -- # local accel_opc 00:06:35.506 01:49:09 -- accel/accel.sh@17 -- # local accel_module 00:06:35.506 01:49:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:35.506 01:49:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:35.506 01:49:09 -- accel/accel.sh@12 -- # build_accel_config 00:06:35.506 01:49:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:35.506 01:49:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:35.506 01:49:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:35.506 01:49:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:35.506 01:49:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:35.506 01:49:09 -- accel/accel.sh@41 -- # local IFS=, 00:06:35.506 01:49:09 -- accel/accel.sh@42 -- # jq -r . 00:06:35.506 [2024-11-18 01:49:09.723448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:35.506 [2024-11-18 01:49:09.723538] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090987 ] 00:06:35.506 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.506 [2024-11-18 01:49:09.787326] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:35.506 [2024-11-18 01:49:09.874050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.880 01:49:11 -- accel/accel.sh@18 -- # out=' 00:06:36.880 SPDK Configuration: 00:06:36.880 Core mask: 0x1 00:06:36.880 00:06:36.880 Accel Perf Configuration: 00:06:36.880 Workload Type: copy 00:06:36.880 Transfer size: 4096 bytes 00:06:36.880 Vector count 1 00:06:36.880 Module: software 00:06:36.880 Queue depth: 32 00:06:36.880 Allocate depth: 32 00:06:36.880 # threads/core: 1 00:06:36.880 Run time: 1 seconds 00:06:36.880 Verify: Yes 00:06:36.880 00:06:36.880 Running for 1 seconds... 00:06:36.880 00:06:36.880 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:36.880 ------------------------------------------------------------------------------------ 00:06:36.880 0,0 276128/s 1078 MiB/s 0 0 00:06:36.880 ==================================================================================== 00:06:36.880 Total 276128/s 1078 MiB/s 0 0' 00:06:36.880 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:36.880 01:49:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:36.880 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:36.880 01:49:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:36.880 01:49:11 -- accel/accel.sh@12 -- # build_accel_config 00:06:36.880 01:49:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.880 01:49:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.880 01:49:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.880 01:49:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.880 01:49:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.880 01:49:11 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.880 01:49:11 -- accel/accel.sh@42 -- # jq -r . 00:06:36.880 [2024-11-18 01:49:11.113528] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:36.880 [2024-11-18 01:49:11.113601] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091248 ] 00:06:36.880 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.880 [2024-11-18 01:49:11.173533] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.880 [2024-11-18 01:49:11.264267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val= 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val= 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val=0x1 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val= 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val= 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val=copy 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val= 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val=software 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@23 -- # accel_module=software 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val=32 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val=32 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val=1 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.138 01:49:11 -- accel/accel.sh@21 -- # val=Yes 00:06:37.138 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.138 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.139 01:49:11 -- accel/accel.sh@21 -- # val= 00:06:37.139 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.139 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.139 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:37.139 01:49:11 -- accel/accel.sh@21 -- # val= 00:06:37.139 01:49:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.139 01:49:11 -- accel/accel.sh@20 -- # IFS=: 00:06:37.139 01:49:11 -- accel/accel.sh@20 -- # read -r var val 00:06:38.513 01:49:12 -- accel/accel.sh@21 -- # val= 00:06:38.513 01:49:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.513 01:49:12 -- accel/accel.sh@20 -- # IFS=: 00:06:38.513 01:49:12 -- accel/accel.sh@20 -- # read -r var val 00:06:38.513 01:49:12 -- accel/accel.sh@21 -- # val= 00:06:38.513 01:49:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.513 01:49:12 -- accel/accel.sh@20 -- # IFS=: 00:06:38.513 01:49:12 -- accel/accel.sh@20 -- # read -r var val 00:06:38.513 01:49:12 -- accel/accel.sh@21 -- # val= 00:06:38.513 01:49:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.513 01:49:12 -- accel/accel.sh@20 -- # IFS=: 00:06:38.513 01:49:12 -- accel/accel.sh@20 -- # read -r var val 00:06:38.513 01:49:12 -- accel/accel.sh@21 -- # val= 00:06:38.513 01:49:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.513 01:49:12 -- accel/accel.sh@20 -- # IFS=: 00:06:38.513 01:49:12 -- accel/accel.sh@20 -- # read -r var val 00:06:38.513 01:49:12 -- accel/accel.sh@21 -- # val= 00:06:38.513 01:49:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.513 01:49:12 -- accel/accel.sh@20 -- # IFS=: 00:06:38.513 01:49:12 -- accel/accel.sh@20 -- # read -r var val 00:06:38.513 01:49:12 -- accel/accel.sh@21 -- # val= 00:06:38.513 01:49:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.513 01:49:12 -- accel/accel.sh@20 -- # IFS=: 00:06:38.513 01:49:12 -- accel/accel.sh@20 -- # read -r var val 00:06:38.513 01:49:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:38.513 01:49:12 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:38.513 01:49:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:38.513 00:06:38.513 real 0m2.792s 00:06:38.513 user 0m2.505s 00:06:38.513 sys 0m0.277s 00:06:38.513 01:49:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:38.513 01:49:12 -- common/autotest_common.sh@10 -- # set +x 00:06:38.513 ************************************ 00:06:38.513 END TEST accel_copy 00:06:38.513 ************************************ 00:06:38.513 01:49:12 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:38.513 01:49:12 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:38.513 01:49:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:38.513 01:49:12 -- common/autotest_common.sh@10 -- # set +x 00:06:38.513 ************************************ 00:06:38.513 START TEST accel_fill 00:06:38.513 ************************************ 00:06:38.513 01:49:12 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:38.513 01:49:12 -- accel/accel.sh@16 -- # local accel_opc 00:06:38.513 01:49:12 -- accel/accel.sh@17 -- # local accel_module 00:06:38.513 01:49:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:38.513 01:49:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:38.513 01:49:12 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.513 01:49:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:38.513 01:49:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.513 01:49:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.513 01:49:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:38.513 01:49:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:38.513 01:49:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:38.513 01:49:12 -- accel/accel.sh@42 -- # jq -r . 00:06:38.513 [2024-11-18 01:49:12.538936] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:38.513 [2024-11-18 01:49:12.539016] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091410 ] 00:06:38.513 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.513 [2024-11-18 01:49:12.601627] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.513 [2024-11-18 01:49:12.692648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.888 01:49:13 -- accel/accel.sh@18 -- # out=' 00:06:39.888 SPDK Configuration: 00:06:39.888 Core mask: 0x1 00:06:39.888 00:06:39.888 Accel Perf Configuration: 00:06:39.888 Workload Type: fill 00:06:39.888 Fill pattern: 0x80 00:06:39.888 Transfer size: 4096 bytes 00:06:39.888 Vector count 1 00:06:39.888 Module: software 00:06:39.888 Queue depth: 64 00:06:39.888 Allocate depth: 64 00:06:39.888 # threads/core: 1 00:06:39.888 Run time: 1 seconds 00:06:39.888 Verify: Yes 00:06:39.888 00:06:39.888 Running for 1 seconds... 00:06:39.888 00:06:39.888 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:39.888 ------------------------------------------------------------------------------------ 00:06:39.888 0,0 404672/s 1580 MiB/s 0 0 00:06:39.888 ==================================================================================== 00:06:39.888 Total 404672/s 1580 MiB/s 0 0' 00:06:39.888 01:49:13 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:39.888 01:49:13 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:39.888 01:49:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:39.888 01:49:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:39.888 01:49:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:39.888 01:49:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:39.888 01:49:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:39.888 01:49:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:39.888 01:49:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:39.888 01:49:13 -- accel/accel.sh@42 -- # jq -r . 00:06:39.888 [2024-11-18 01:49:13.947149] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:39.888 [2024-11-18 01:49:13.947232] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091548 ] 00:06:39.888 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.888 [2024-11-18 01:49:14.008485] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.888 [2024-11-18 01:49:14.098619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val= 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val= 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val=0x1 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val= 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val= 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val=fill 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@24 -- # accel_opc=fill 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val=0x80 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val= 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val=software 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@23 -- # accel_module=software 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val=64 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val=64 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val=1 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val=Yes 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val= 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:39.888 01:49:14 -- accel/accel.sh@21 -- # val= 00:06:39.888 01:49:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # IFS=: 00:06:39.888 01:49:14 -- accel/accel.sh@20 -- # read -r var val 00:06:41.262 01:49:15 -- accel/accel.sh@21 -- # val= 00:06:41.262 01:49:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.262 01:49:15 -- accel/accel.sh@20 -- # IFS=: 00:06:41.262 01:49:15 -- accel/accel.sh@20 -- # read -r var val 00:06:41.262 01:49:15 -- accel/accel.sh@21 -- # val= 00:06:41.262 01:49:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.262 01:49:15 -- accel/accel.sh@20 -- # IFS=: 00:06:41.262 01:49:15 -- accel/accel.sh@20 -- # read -r var val 00:06:41.262 01:49:15 -- accel/accel.sh@21 -- # val= 00:06:41.262 01:49:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.262 01:49:15 -- accel/accel.sh@20 -- # IFS=: 00:06:41.262 01:49:15 -- accel/accel.sh@20 -- # read -r var val 00:06:41.262 01:49:15 -- accel/accel.sh@21 -- # val= 00:06:41.262 01:49:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.262 01:49:15 -- accel/accel.sh@20 -- # IFS=: 00:06:41.262 01:49:15 -- accel/accel.sh@20 -- # read -r var val 00:06:41.262 01:49:15 -- accel/accel.sh@21 -- # val= 00:06:41.262 01:49:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.262 01:49:15 -- accel/accel.sh@20 -- # IFS=: 00:06:41.262 01:49:15 -- accel/accel.sh@20 -- # read -r var val 00:06:41.262 01:49:15 -- accel/accel.sh@21 -- # val= 00:06:41.262 01:49:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.262 01:49:15 -- accel/accel.sh@20 -- # IFS=: 00:06:41.262 01:49:15 -- accel/accel.sh@20 -- # read -r var val 00:06:41.262 01:49:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:41.262 01:49:15 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:06:41.262 01:49:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:41.262 00:06:41.262 real 0m2.809s 00:06:41.262 user 0m2.521s 00:06:41.262 sys 0m0.281s 00:06:41.262 01:49:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:41.262 01:49:15 -- common/autotest_common.sh@10 -- # set +x 00:06:41.262 ************************************ 00:06:41.262 END TEST accel_fill 00:06:41.262 ************************************ 00:06:41.263 01:49:15 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:06:41.263 01:49:15 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:41.263 01:49:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.263 01:49:15 -- common/autotest_common.sh@10 -- # set +x 00:06:41.263 ************************************ 00:06:41.263 START TEST accel_copy_crc32c 00:06:41.263 ************************************ 00:06:41.263 01:49:15 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:06:41.263 01:49:15 -- accel/accel.sh@16 -- # local accel_opc 00:06:41.263 01:49:15 -- accel/accel.sh@17 -- # local accel_module 00:06:41.263 01:49:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:41.263 01:49:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:41.263 01:49:15 -- accel/accel.sh@12 -- # build_accel_config 00:06:41.263 01:49:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:41.263 01:49:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:41.263 01:49:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:41.263 01:49:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:41.263 01:49:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:41.263 01:49:15 -- accel/accel.sh@41 -- # local IFS=, 00:06:41.263 01:49:15 -- accel/accel.sh@42 -- # jq -r . 00:06:41.263 [2024-11-18 01:49:15.374509] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:41.263 [2024-11-18 01:49:15.374581] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091713 ] 00:06:41.263 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.263 [2024-11-18 01:49:15.437745] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.263 [2024-11-18 01:49:15.530512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.636 01:49:16 -- accel/accel.sh@18 -- # out=' 00:06:42.636 SPDK Configuration: 00:06:42.636 Core mask: 0x1 00:06:42.636 00:06:42.636 Accel Perf Configuration: 00:06:42.636 Workload Type: copy_crc32c 00:06:42.636 CRC-32C seed: 0 00:06:42.636 Vector size: 4096 bytes 00:06:42.636 Transfer size: 4096 bytes 00:06:42.636 Vector count 1 00:06:42.636 Module: software 00:06:42.636 Queue depth: 32 00:06:42.636 Allocate depth: 32 00:06:42.636 # threads/core: 1 00:06:42.636 Run time: 1 seconds 00:06:42.636 Verify: Yes 00:06:42.636 00:06:42.636 Running for 1 seconds... 00:06:42.636 00:06:42.636 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:42.636 ------------------------------------------------------------------------------------ 00:06:42.636 0,0 217696/s 850 MiB/s 0 0 00:06:42.636 ==================================================================================== 00:06:42.636 Total 217696/s 850 MiB/s 0 0' 00:06:42.636 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.636 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.636 01:49:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:42.636 01:49:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:42.636 01:49:16 -- accel/accel.sh@12 -- # build_accel_config 00:06:42.636 01:49:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:42.636 01:49:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:42.636 01:49:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:42.636 01:49:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:42.636 01:49:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:42.636 01:49:16 -- accel/accel.sh@41 -- # local IFS=, 00:06:42.636 01:49:16 -- accel/accel.sh@42 -- # jq -r . 00:06:42.636 [2024-11-18 01:49:16.768394] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:42.636 [2024-11-18 01:49:16.768473] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091975 ] 00:06:42.636 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.636 [2024-11-18 01:49:16.830055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.636 [2024-11-18 01:49:16.918892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.636 01:49:16 -- accel/accel.sh@21 -- # val= 00:06:42.636 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.636 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.636 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.636 01:49:16 -- accel/accel.sh@21 -- # val= 00:06:42.636 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.636 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.636 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.636 01:49:16 -- accel/accel.sh@21 -- # val=0x1 00:06:42.636 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.636 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.636 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.636 01:49:16 -- accel/accel.sh@21 -- # val= 00:06:42.636 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val= 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val=0 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val= 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val=software 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@23 -- # accel_module=software 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val=32 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val=32 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val=1 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val=Yes 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val= 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:42.637 01:49:16 -- accel/accel.sh@21 -- # val= 00:06:42.637 01:49:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # IFS=: 00:06:42.637 01:49:16 -- accel/accel.sh@20 -- # read -r var val 00:06:44.011 01:49:18 -- accel/accel.sh@21 -- # val= 00:06:44.011 01:49:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.011 01:49:18 -- accel/accel.sh@20 -- # IFS=: 00:06:44.011 01:49:18 -- accel/accel.sh@20 -- # read -r var val 00:06:44.011 01:49:18 -- accel/accel.sh@21 -- # val= 00:06:44.011 01:49:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.011 01:49:18 -- accel/accel.sh@20 -- # IFS=: 00:06:44.011 01:49:18 -- accel/accel.sh@20 -- # read -r var val 00:06:44.011 01:49:18 -- accel/accel.sh@21 -- # val= 00:06:44.011 01:49:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.011 01:49:18 -- accel/accel.sh@20 -- # IFS=: 00:06:44.011 01:49:18 -- accel/accel.sh@20 -- # read -r var val 00:06:44.011 01:49:18 -- accel/accel.sh@21 -- # val= 00:06:44.011 01:49:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.011 01:49:18 -- accel/accel.sh@20 -- # IFS=: 00:06:44.011 01:49:18 -- accel/accel.sh@20 -- # read -r var val 00:06:44.011 01:49:18 -- accel/accel.sh@21 -- # val= 00:06:44.011 01:49:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.011 01:49:18 -- accel/accel.sh@20 -- # IFS=: 00:06:44.011 01:49:18 -- accel/accel.sh@20 -- # read -r var val 00:06:44.011 01:49:18 -- accel/accel.sh@21 -- # val= 00:06:44.011 01:49:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.011 01:49:18 -- accel/accel.sh@20 -- # IFS=: 00:06:44.011 01:49:18 -- accel/accel.sh@20 -- # read -r var val 00:06:44.011 01:49:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:44.011 01:49:18 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:44.011 01:49:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:44.011 00:06:44.011 real 0m2.800s 00:06:44.011 user 0m2.492s 00:06:44.011 sys 0m0.300s 00:06:44.011 01:49:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.011 01:49:18 -- common/autotest_common.sh@10 -- # set +x 00:06:44.011 ************************************ 00:06:44.011 END TEST accel_copy_crc32c 00:06:44.011 ************************************ 00:06:44.011 01:49:18 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:06:44.011 01:49:18 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:44.011 01:49:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.011 01:49:18 -- common/autotest_common.sh@10 -- # set +x 00:06:44.011 ************************************ 00:06:44.011 START TEST accel_copy_crc32c_C2 00:06:44.011 ************************************ 00:06:44.011 01:49:18 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:06:44.011 01:49:18 -- accel/accel.sh@16 -- # local accel_opc 00:06:44.011 01:49:18 -- accel/accel.sh@17 -- # local accel_module 00:06:44.011 01:49:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:44.011 01:49:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:44.011 01:49:18 -- accel/accel.sh@12 -- # build_accel_config 00:06:44.011 01:49:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:44.011 01:49:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:44.011 01:49:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:44.011 01:49:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:44.011 01:49:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:44.011 01:49:18 -- accel/accel.sh@41 -- # local IFS=, 00:06:44.011 01:49:18 -- accel/accel.sh@42 -- # jq -r . 00:06:44.011 [2024-11-18 01:49:18.203395] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:44.011 [2024-11-18 01:49:18.203468] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092131 ] 00:06:44.011 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.011 [2024-11-18 01:49:18.266320] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:44.011 [2024-11-18 01:49:18.356757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.393 01:49:19 -- accel/accel.sh@18 -- # out=' 00:06:45.393 SPDK Configuration: 00:06:45.393 Core mask: 0x1 00:06:45.393 00:06:45.393 Accel Perf Configuration: 00:06:45.393 Workload Type: copy_crc32c 00:06:45.393 CRC-32C seed: 0 00:06:45.393 Vector size: 4096 bytes 00:06:45.393 Transfer size: 8192 bytes 00:06:45.393 Vector count 2 00:06:45.393 Module: software 00:06:45.393 Queue depth: 32 00:06:45.393 Allocate depth: 32 00:06:45.393 # threads/core: 1 00:06:45.393 Run time: 1 seconds 00:06:45.393 Verify: Yes 00:06:45.393 00:06:45.393 Running for 1 seconds... 00:06:45.393 00:06:45.393 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:45.393 ------------------------------------------------------------------------------------ 00:06:45.393 0,0 156608/s 1223 MiB/s 0 0 00:06:45.393 ==================================================================================== 00:06:45.393 Total 156608/s 611 MiB/s 0 0' 00:06:45.393 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.393 01:49:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:45.393 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.393 01:49:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:45.393 01:49:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:45.393 01:49:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:45.393 01:49:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:45.393 01:49:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:45.393 01:49:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:45.394 01:49:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:45.394 01:49:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:45.394 01:49:19 -- accel/accel.sh@42 -- # jq -r . 00:06:45.394 [2024-11-18 01:49:19.612773] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:45.394 [2024-11-18 01:49:19.612857] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092275 ] 00:06:45.394 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.394 [2024-11-18 01:49:19.674811] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.394 [2024-11-18 01:49:19.765298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.652 01:49:19 -- accel/accel.sh@21 -- # val= 00:06:45.652 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.652 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.652 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val= 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val=0x1 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val= 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val= 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val=0 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val='8192 bytes' 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val= 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val=software 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@23 -- # accel_module=software 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val=32 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val=32 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val=1 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val=Yes 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val= 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:45.653 01:49:19 -- accel/accel.sh@21 -- # val= 00:06:45.653 01:49:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # IFS=: 00:06:45.653 01:49:19 -- accel/accel.sh@20 -- # read -r var val 00:06:47.028 01:49:20 -- accel/accel.sh@21 -- # val= 00:06:47.028 01:49:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.028 01:49:20 -- accel/accel.sh@20 -- # IFS=: 00:06:47.028 01:49:20 -- accel/accel.sh@20 -- # read -r var val 00:06:47.028 01:49:20 -- accel/accel.sh@21 -- # val= 00:06:47.028 01:49:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.028 01:49:20 -- accel/accel.sh@20 -- # IFS=: 00:06:47.028 01:49:20 -- accel/accel.sh@20 -- # read -r var val 00:06:47.028 01:49:20 -- accel/accel.sh@21 -- # val= 00:06:47.028 01:49:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.028 01:49:20 -- accel/accel.sh@20 -- # IFS=: 00:06:47.028 01:49:20 -- accel/accel.sh@20 -- # read -r var val 00:06:47.028 01:49:20 -- accel/accel.sh@21 -- # val= 00:06:47.028 01:49:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.028 01:49:20 -- accel/accel.sh@20 -- # IFS=: 00:06:47.028 01:49:20 -- accel/accel.sh@20 -- # read -r var val 00:06:47.028 01:49:20 -- accel/accel.sh@21 -- # val= 00:06:47.028 01:49:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.028 01:49:20 -- accel/accel.sh@20 -- # IFS=: 00:06:47.028 01:49:20 -- accel/accel.sh@20 -- # read -r var val 00:06:47.028 01:49:20 -- accel/accel.sh@21 -- # val= 00:06:47.028 01:49:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.028 01:49:20 -- accel/accel.sh@20 -- # IFS=: 00:06:47.028 01:49:20 -- accel/accel.sh@20 -- # read -r var val 00:06:47.028 01:49:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:47.028 01:49:20 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:47.028 01:49:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:47.028 00:06:47.028 real 0m2.812s 00:06:47.028 user 0m2.512s 00:06:47.028 sys 0m0.292s 00:06:47.028 01:49:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:47.028 01:49:20 -- common/autotest_common.sh@10 -- # set +x 00:06:47.028 ************************************ 00:06:47.028 END TEST accel_copy_crc32c_C2 00:06:47.028 ************************************ 00:06:47.028 01:49:21 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:06:47.028 01:49:21 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:47.028 01:49:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.028 01:49:21 -- common/autotest_common.sh@10 -- # set +x 00:06:47.028 ************************************ 00:06:47.028 START TEST accel_dualcast 00:06:47.028 ************************************ 00:06:47.028 01:49:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:06:47.028 01:49:21 -- accel/accel.sh@16 -- # local accel_opc 00:06:47.028 01:49:21 -- accel/accel.sh@17 -- # local accel_module 00:06:47.028 01:49:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:06:47.028 01:49:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:47.028 01:49:21 -- accel/accel.sh@12 -- # build_accel_config 00:06:47.028 01:49:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:47.028 01:49:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:47.028 01:49:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:47.028 01:49:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:47.028 01:49:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:47.028 01:49:21 -- accel/accel.sh@41 -- # local IFS=, 00:06:47.028 01:49:21 -- accel/accel.sh@42 -- # jq -r . 00:06:47.028 [2024-11-18 01:49:21.041904] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:47.028 [2024-11-18 01:49:21.041979] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092434 ] 00:06:47.028 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.028 [2024-11-18 01:49:21.104635] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:47.028 [2024-11-18 01:49:21.196729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.402 01:49:22 -- accel/accel.sh@18 -- # out=' 00:06:48.402 SPDK Configuration: 00:06:48.402 Core mask: 0x1 00:06:48.402 00:06:48.402 Accel Perf Configuration: 00:06:48.402 Workload Type: dualcast 00:06:48.402 Transfer size: 4096 bytes 00:06:48.402 Vector count 1 00:06:48.402 Module: software 00:06:48.402 Queue depth: 32 00:06:48.402 Allocate depth: 32 00:06:48.402 # threads/core: 1 00:06:48.402 Run time: 1 seconds 00:06:48.402 Verify: Yes 00:06:48.402 00:06:48.402 Running for 1 seconds... 00:06:48.402 00:06:48.402 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:48.402 ------------------------------------------------------------------------------------ 00:06:48.402 0,0 301472/s 1177 MiB/s 0 0 00:06:48.402 ==================================================================================== 00:06:48.402 Total 301472/s 1177 MiB/s 0 0' 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:48.402 01:49:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.402 01:49:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.402 01:49:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.402 01:49:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.402 01:49:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.402 01:49:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.402 01:49:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.402 01:49:22 -- accel/accel.sh@42 -- # jq -r . 00:06:48.402 [2024-11-18 01:49:22.442430] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:48.402 [2024-11-18 01:49:22.442507] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092698 ] 00:06:48.402 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.402 [2024-11-18 01:49:22.503905] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:48.402 [2024-11-18 01:49:22.591860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val= 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val= 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val=0x1 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val= 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val= 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val=dualcast 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val= 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val=software 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@23 -- # accel_module=software 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val=32 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val=32 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val=1 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val=Yes 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.402 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.402 01:49:22 -- accel/accel.sh@21 -- # val= 00:06:48.402 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.403 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.403 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:48.403 01:49:22 -- accel/accel.sh@21 -- # val= 00:06:48.403 01:49:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.403 01:49:22 -- accel/accel.sh@20 -- # IFS=: 00:06:48.403 01:49:22 -- accel/accel.sh@20 -- # read -r var val 00:06:49.776 01:49:23 -- accel/accel.sh@21 -- # val= 00:06:49.776 01:49:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.776 01:49:23 -- accel/accel.sh@20 -- # IFS=: 00:06:49.776 01:49:23 -- accel/accel.sh@20 -- # read -r var val 00:06:49.776 01:49:23 -- accel/accel.sh@21 -- # val= 00:06:49.776 01:49:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.776 01:49:23 -- accel/accel.sh@20 -- # IFS=: 00:06:49.776 01:49:23 -- accel/accel.sh@20 -- # read -r var val 00:06:49.776 01:49:23 -- accel/accel.sh@21 -- # val= 00:06:49.776 01:49:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.776 01:49:23 -- accel/accel.sh@20 -- # IFS=: 00:06:49.776 01:49:23 -- accel/accel.sh@20 -- # read -r var val 00:06:49.776 01:49:23 -- accel/accel.sh@21 -- # val= 00:06:49.776 01:49:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.776 01:49:23 -- accel/accel.sh@20 -- # IFS=: 00:06:49.776 01:49:23 -- accel/accel.sh@20 -- # read -r var val 00:06:49.776 01:49:23 -- accel/accel.sh@21 -- # val= 00:06:49.776 01:49:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.776 01:49:23 -- accel/accel.sh@20 -- # IFS=: 00:06:49.776 01:49:23 -- accel/accel.sh@20 -- # read -r var val 00:06:49.776 01:49:23 -- accel/accel.sh@21 -- # val= 00:06:49.776 01:49:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.776 01:49:23 -- accel/accel.sh@20 -- # IFS=: 00:06:49.776 01:49:23 -- accel/accel.sh@20 -- # read -r var val 00:06:49.776 01:49:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:49.776 01:49:23 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:06:49.776 01:49:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:49.776 00:06:49.776 real 0m2.795s 00:06:49.776 user 0m2.486s 00:06:49.776 sys 0m0.300s 00:06:49.776 01:49:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:49.776 01:49:23 -- common/autotest_common.sh@10 -- # set +x 00:06:49.776 ************************************ 00:06:49.776 END TEST accel_dualcast 00:06:49.776 ************************************ 00:06:49.776 01:49:23 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:49.776 01:49:23 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:49.776 01:49:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.776 01:49:23 -- common/autotest_common.sh@10 -- # set +x 00:06:49.776 ************************************ 00:06:49.776 START TEST accel_compare 00:06:49.776 ************************************ 00:06:49.776 01:49:23 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:06:49.776 01:49:23 -- accel/accel.sh@16 -- # local accel_opc 00:06:49.776 01:49:23 -- accel/accel.sh@17 -- # local accel_module 00:06:49.776 01:49:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:06:49.776 01:49:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:49.776 01:49:23 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.776 01:49:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.776 01:49:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.776 01:49:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.776 01:49:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.776 01:49:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.776 01:49:23 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.776 01:49:23 -- accel/accel.sh@42 -- # jq -r . 00:06:49.776 [2024-11-18 01:49:23.864381] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:49.776 [2024-11-18 01:49:23.864457] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092858 ] 00:06:49.776 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.776 [2024-11-18 01:49:23.926067] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.776 [2024-11-18 01:49:24.017647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.149 01:49:25 -- accel/accel.sh@18 -- # out=' 00:06:51.149 SPDK Configuration: 00:06:51.149 Core mask: 0x1 00:06:51.149 00:06:51.149 Accel Perf Configuration: 00:06:51.149 Workload Type: compare 00:06:51.149 Transfer size: 4096 bytes 00:06:51.149 Vector count 1 00:06:51.149 Module: software 00:06:51.149 Queue depth: 32 00:06:51.149 Allocate depth: 32 00:06:51.149 # threads/core: 1 00:06:51.149 Run time: 1 seconds 00:06:51.150 Verify: Yes 00:06:51.150 00:06:51.150 Running for 1 seconds... 00:06:51.150 00:06:51.150 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:51.150 ------------------------------------------------------------------------------------ 00:06:51.150 0,0 401824/s 1569 MiB/s 0 0 00:06:51.150 ==================================================================================== 00:06:51.150 Total 401824/s 1569 MiB/s 0 0' 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:51.150 01:49:25 -- accel/accel.sh@12 -- # build_accel_config 00:06:51.150 01:49:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:51.150 01:49:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:51.150 01:49:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:51.150 01:49:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:51.150 01:49:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:51.150 01:49:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:51.150 01:49:25 -- accel/accel.sh@42 -- # jq -r . 00:06:51.150 [2024-11-18 01:49:25.269441] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:51.150 [2024-11-18 01:49:25.269520] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092996 ] 00:06:51.150 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.150 [2024-11-18 01:49:25.330814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:51.150 [2024-11-18 01:49:25.421694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val= 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val= 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val=0x1 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val= 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val= 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val=compare 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@24 -- # accel_opc=compare 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val= 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val=software 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@23 -- # accel_module=software 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val=32 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val=32 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val=1 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val=Yes 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val= 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:51.150 01:49:25 -- accel/accel.sh@21 -- # val= 00:06:51.150 01:49:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # IFS=: 00:06:51.150 01:49:25 -- accel/accel.sh@20 -- # read -r var val 00:06:52.524 01:49:26 -- accel/accel.sh@21 -- # val= 00:06:52.524 01:49:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.524 01:49:26 -- accel/accel.sh@20 -- # IFS=: 00:06:52.524 01:49:26 -- accel/accel.sh@20 -- # read -r var val 00:06:52.524 01:49:26 -- accel/accel.sh@21 -- # val= 00:06:52.524 01:49:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.524 01:49:26 -- accel/accel.sh@20 -- # IFS=: 00:06:52.524 01:49:26 -- accel/accel.sh@20 -- # read -r var val 00:06:52.524 01:49:26 -- accel/accel.sh@21 -- # val= 00:06:52.524 01:49:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.524 01:49:26 -- accel/accel.sh@20 -- # IFS=: 00:06:52.524 01:49:26 -- accel/accel.sh@20 -- # read -r var val 00:06:52.524 01:49:26 -- accel/accel.sh@21 -- # val= 00:06:52.524 01:49:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.524 01:49:26 -- accel/accel.sh@20 -- # IFS=: 00:06:52.524 01:49:26 -- accel/accel.sh@20 -- # read -r var val 00:06:52.524 01:49:26 -- accel/accel.sh@21 -- # val= 00:06:52.524 01:49:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.524 01:49:26 -- accel/accel.sh@20 -- # IFS=: 00:06:52.524 01:49:26 -- accel/accel.sh@20 -- # read -r var val 00:06:52.524 01:49:26 -- accel/accel.sh@21 -- # val= 00:06:52.524 01:49:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.524 01:49:26 -- accel/accel.sh@20 -- # IFS=: 00:06:52.524 01:49:26 -- accel/accel.sh@20 -- # read -r var val 00:06:52.524 01:49:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:52.524 01:49:26 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:06:52.524 01:49:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:52.524 00:06:52.524 real 0m2.811s 00:06:52.524 user 0m2.525s 00:06:52.524 sys 0m0.278s 00:06:52.524 01:49:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:52.524 01:49:26 -- common/autotest_common.sh@10 -- # set +x 00:06:52.524 ************************************ 00:06:52.524 END TEST accel_compare 00:06:52.524 ************************************ 00:06:52.524 01:49:26 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:52.524 01:49:26 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:52.524 01:49:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:52.524 01:49:26 -- common/autotest_common.sh@10 -- # set +x 00:06:52.524 ************************************ 00:06:52.524 START TEST accel_xor 00:06:52.524 ************************************ 00:06:52.524 01:49:26 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:06:52.524 01:49:26 -- accel/accel.sh@16 -- # local accel_opc 00:06:52.524 01:49:26 -- accel/accel.sh@17 -- # local accel_module 00:06:52.524 01:49:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:06:52.524 01:49:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:52.524 01:49:26 -- accel/accel.sh@12 -- # build_accel_config 00:06:52.524 01:49:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:52.524 01:49:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:52.524 01:49:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:52.524 01:49:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:52.524 01:49:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:52.524 01:49:26 -- accel/accel.sh@41 -- # local IFS=, 00:06:52.524 01:49:26 -- accel/accel.sh@42 -- # jq -r . 00:06:52.524 [2024-11-18 01:49:26.704189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:52.524 [2024-11-18 01:49:26.704280] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1093157 ] 00:06:52.524 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.524 [2024-11-18 01:49:26.766417] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:52.524 [2024-11-18 01:49:26.861214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:53.898 01:49:28 -- accel/accel.sh@18 -- # out=' 00:06:53.898 SPDK Configuration: 00:06:53.898 Core mask: 0x1 00:06:53.898 00:06:53.898 Accel Perf Configuration: 00:06:53.898 Workload Type: xor 00:06:53.898 Source buffers: 2 00:06:53.898 Transfer size: 4096 bytes 00:06:53.898 Vector count 1 00:06:53.898 Module: software 00:06:53.898 Queue depth: 32 00:06:53.898 Allocate depth: 32 00:06:53.898 # threads/core: 1 00:06:53.898 Run time: 1 seconds 00:06:53.898 Verify: Yes 00:06:53.898 00:06:53.898 Running for 1 seconds... 00:06:53.898 00:06:53.898 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:53.898 ------------------------------------------------------------------------------------ 00:06:53.898 0,0 192544/s 752 MiB/s 0 0 00:06:53.898 ==================================================================================== 00:06:53.898 Total 192544/s 752 MiB/s 0 0' 00:06:53.898 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:53.898 01:49:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:53.898 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:53.898 01:49:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:53.898 01:49:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.898 01:49:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.898 01:49:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.898 01:49:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.898 01:49:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.898 01:49:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.898 01:49:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.898 01:49:28 -- accel/accel.sh@42 -- # jq -r . 00:06:53.898 [2024-11-18 01:49:28.102216] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:53.898 [2024-11-18 01:49:28.102292] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1093419 ] 00:06:53.898 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.898 [2024-11-18 01:49:28.163327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.898 [2024-11-18 01:49:28.250902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.156 01:49:28 -- accel/accel.sh@21 -- # val= 00:06:54.156 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.156 01:49:28 -- accel/accel.sh@21 -- # val= 00:06:54.156 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.156 01:49:28 -- accel/accel.sh@21 -- # val=0x1 00:06:54.156 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.156 01:49:28 -- accel/accel.sh@21 -- # val= 00:06:54.156 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.156 01:49:28 -- accel/accel.sh@21 -- # val= 00:06:54.156 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.156 01:49:28 -- accel/accel.sh@21 -- # val=xor 00:06:54.156 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.156 01:49:28 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.156 01:49:28 -- accel/accel.sh@21 -- # val=2 00:06:54.156 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.156 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.156 01:49:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:54.157 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.157 01:49:28 -- accel/accel.sh@21 -- # val= 00:06:54.157 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.157 01:49:28 -- accel/accel.sh@21 -- # val=software 00:06:54.157 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.157 01:49:28 -- accel/accel.sh@23 -- # accel_module=software 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.157 01:49:28 -- accel/accel.sh@21 -- # val=32 00:06:54.157 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.157 01:49:28 -- accel/accel.sh@21 -- # val=32 00:06:54.157 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.157 01:49:28 -- accel/accel.sh@21 -- # val=1 00:06:54.157 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.157 01:49:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:54.157 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.157 01:49:28 -- accel/accel.sh@21 -- # val=Yes 00:06:54.157 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.157 01:49:28 -- accel/accel.sh@21 -- # val= 00:06:54.157 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:54.157 01:49:28 -- accel/accel.sh@21 -- # val= 00:06:54.157 01:49:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # IFS=: 00:06:54.157 01:49:28 -- accel/accel.sh@20 -- # read -r var val 00:06:55.089 01:49:29 -- accel/accel.sh@21 -- # val= 00:06:55.089 01:49:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.089 01:49:29 -- accel/accel.sh@20 -- # IFS=: 00:06:55.089 01:49:29 -- accel/accel.sh@20 -- # read -r var val 00:06:55.089 01:49:29 -- accel/accel.sh@21 -- # val= 00:06:55.089 01:49:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.089 01:49:29 -- accel/accel.sh@20 -- # IFS=: 00:06:55.089 01:49:29 -- accel/accel.sh@20 -- # read -r var val 00:06:55.089 01:49:29 -- accel/accel.sh@21 -- # val= 00:06:55.089 01:49:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.089 01:49:29 -- accel/accel.sh@20 -- # IFS=: 00:06:55.089 01:49:29 -- accel/accel.sh@20 -- # read -r var val 00:06:55.089 01:49:29 -- accel/accel.sh@21 -- # val= 00:06:55.089 01:49:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.089 01:49:29 -- accel/accel.sh@20 -- # IFS=: 00:06:55.089 01:49:29 -- accel/accel.sh@20 -- # read -r var val 00:06:55.089 01:49:29 -- accel/accel.sh@21 -- # val= 00:06:55.089 01:49:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.089 01:49:29 -- accel/accel.sh@20 -- # IFS=: 00:06:55.089 01:49:29 -- accel/accel.sh@20 -- # read -r var val 00:06:55.089 01:49:29 -- accel/accel.sh@21 -- # val= 00:06:55.089 01:49:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.089 01:49:29 -- accel/accel.sh@20 -- # IFS=: 00:06:55.089 01:49:29 -- accel/accel.sh@20 -- # read -r var val 00:06:55.089 01:49:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:55.089 01:49:29 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:55.089 01:49:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:55.089 00:06:55.089 real 0m2.795s 00:06:55.089 user 0m2.499s 00:06:55.089 sys 0m0.288s 00:06:55.089 01:49:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:55.089 01:49:29 -- common/autotest_common.sh@10 -- # set +x 00:06:55.089 ************************************ 00:06:55.089 END TEST accel_xor 00:06:55.089 ************************************ 00:06:55.348 01:49:29 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:55.348 01:49:29 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:55.348 01:49:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.348 01:49:29 -- common/autotest_common.sh@10 -- # set +x 00:06:55.348 ************************************ 00:06:55.348 START TEST accel_xor 00:06:55.348 ************************************ 00:06:55.348 01:49:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:06:55.348 01:49:29 -- accel/accel.sh@16 -- # local accel_opc 00:06:55.348 01:49:29 -- accel/accel.sh@17 -- # local accel_module 00:06:55.348 01:49:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:55.348 01:49:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:55.348 01:49:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.348 01:49:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.348 01:49:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.348 01:49:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.348 01:49:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.348 01:49:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.348 01:49:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.348 01:49:29 -- accel/accel.sh@42 -- # jq -r . 00:06:55.348 [2024-11-18 01:49:29.527814] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:55.348 [2024-11-18 01:49:29.527903] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1093585 ] 00:06:55.348 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.348 [2024-11-18 01:49:29.590786] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.348 [2024-11-18 01:49:29.680475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:56.721 01:49:30 -- accel/accel.sh@18 -- # out=' 00:06:56.721 SPDK Configuration: 00:06:56.721 Core mask: 0x1 00:06:56.721 00:06:56.721 Accel Perf Configuration: 00:06:56.721 Workload Type: xor 00:06:56.721 Source buffers: 3 00:06:56.721 Transfer size: 4096 bytes 00:06:56.721 Vector count 1 00:06:56.721 Module: software 00:06:56.721 Queue depth: 32 00:06:56.721 Allocate depth: 32 00:06:56.721 # threads/core: 1 00:06:56.721 Run time: 1 seconds 00:06:56.721 Verify: Yes 00:06:56.721 00:06:56.721 Running for 1 seconds... 00:06:56.721 00:06:56.721 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:56.721 ------------------------------------------------------------------------------------ 00:06:56.721 0,0 184512/s 720 MiB/s 0 0 00:06:56.721 ==================================================================================== 00:06:56.721 Total 184512/s 720 MiB/s 0 0' 00:06:56.721 01:49:30 -- accel/accel.sh@20 -- # IFS=: 00:06:56.721 01:49:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:56.721 01:49:30 -- accel/accel.sh@20 -- # read -r var val 00:06:56.721 01:49:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:56.721 01:49:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.721 01:49:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.721 01:49:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.721 01:49:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.721 01:49:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.721 01:49:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.721 01:49:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.721 01:49:30 -- accel/accel.sh@42 -- # jq -r . 00:06:56.721 [2024-11-18 01:49:30.932162] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:56.721 [2024-11-18 01:49:30.932245] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1093723 ] 00:06:56.721 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.721 [2024-11-18 01:49:30.993883] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.721 [2024-11-18 01:49:31.084729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val= 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val= 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val=0x1 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val= 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val= 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val=xor 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val=3 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val= 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val=software 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@23 -- # accel_module=software 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val=32 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val=32 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val=1 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val=Yes 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val= 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:56.980 01:49:31 -- accel/accel.sh@21 -- # val= 00:06:56.980 01:49:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # IFS=: 00:06:56.980 01:49:31 -- accel/accel.sh@20 -- # read -r var val 00:06:57.915 01:49:32 -- accel/accel.sh@21 -- # val= 00:06:57.915 01:49:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.915 01:49:32 -- accel/accel.sh@20 -- # IFS=: 00:06:57.915 01:49:32 -- accel/accel.sh@20 -- # read -r var val 00:06:57.915 01:49:32 -- accel/accel.sh@21 -- # val= 00:06:57.915 01:49:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.915 01:49:32 -- accel/accel.sh@20 -- # IFS=: 00:06:57.915 01:49:32 -- accel/accel.sh@20 -- # read -r var val 00:06:57.915 01:49:32 -- accel/accel.sh@21 -- # val= 00:06:57.915 01:49:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.915 01:49:32 -- accel/accel.sh@20 -- # IFS=: 00:06:57.915 01:49:32 -- accel/accel.sh@20 -- # read -r var val 00:06:57.915 01:49:32 -- accel/accel.sh@21 -- # val= 00:06:57.915 01:49:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.915 01:49:32 -- accel/accel.sh@20 -- # IFS=: 00:06:57.915 01:49:32 -- accel/accel.sh@20 -- # read -r var val 00:06:57.915 01:49:32 -- accel/accel.sh@21 -- # val= 00:06:57.915 01:49:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.915 01:49:32 -- accel/accel.sh@20 -- # IFS=: 00:06:57.915 01:49:32 -- accel/accel.sh@20 -- # read -r var val 00:06:57.915 01:49:32 -- accel/accel.sh@21 -- # val= 00:06:57.915 01:49:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.915 01:49:32 -- accel/accel.sh@20 -- # IFS=: 00:06:57.915 01:49:32 -- accel/accel.sh@20 -- # read -r var val 00:06:57.915 01:49:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:57.915 01:49:32 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:57.915 01:49:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:58.174 00:06:58.174 real 0m2.809s 00:06:58.174 user 0m2.503s 00:06:58.174 sys 0m0.297s 00:06:58.174 01:49:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:58.174 01:49:32 -- common/autotest_common.sh@10 -- # set +x 00:06:58.174 ************************************ 00:06:58.174 END TEST accel_xor 00:06:58.174 ************************************ 00:06:58.174 01:49:32 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:58.174 01:49:32 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:58.174 01:49:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.174 01:49:32 -- common/autotest_common.sh@10 -- # set +x 00:06:58.174 ************************************ 00:06:58.174 START TEST accel_dif_verify 00:06:58.174 ************************************ 00:06:58.174 01:49:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:06:58.174 01:49:32 -- accel/accel.sh@16 -- # local accel_opc 00:06:58.174 01:49:32 -- accel/accel.sh@17 -- # local accel_module 00:06:58.174 01:49:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:58.174 01:49:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:58.174 01:49:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:58.174 01:49:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:58.174 01:49:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:58.174 01:49:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:58.174 01:49:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:58.174 01:49:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:58.174 01:49:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:58.174 01:49:32 -- accel/accel.sh@42 -- # jq -r . 00:06:58.174 [2024-11-18 01:49:32.365834] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:58.174 [2024-11-18 01:49:32.365924] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1093878 ] 00:06:58.174 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.174 [2024-11-18 01:49:32.429382] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.174 [2024-11-18 01:49:32.522026] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.548 01:49:33 -- accel/accel.sh@18 -- # out=' 00:06:59.548 SPDK Configuration: 00:06:59.548 Core mask: 0x1 00:06:59.548 00:06:59.548 Accel Perf Configuration: 00:06:59.548 Workload Type: dif_verify 00:06:59.548 Vector size: 4096 bytes 00:06:59.548 Transfer size: 4096 bytes 00:06:59.548 Block size: 512 bytes 00:06:59.548 Metadata size: 8 bytes 00:06:59.548 Vector count 1 00:06:59.548 Module: software 00:06:59.548 Queue depth: 32 00:06:59.548 Allocate depth: 32 00:06:59.548 # threads/core: 1 00:06:59.548 Run time: 1 seconds 00:06:59.548 Verify: No 00:06:59.548 00:06:59.548 Running for 1 seconds... 00:06:59.548 00:06:59.548 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:59.548 ------------------------------------------------------------------------------------ 00:06:59.548 0,0 82016/s 325 MiB/s 0 0 00:06:59.548 ==================================================================================== 00:06:59.548 Total 82016/s 320 MiB/s 0 0' 00:06:59.548 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.548 01:49:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:59.548 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.548 01:49:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:59.548 01:49:33 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.549 01:49:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.549 01:49:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.549 01:49:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.549 01:49:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.549 01:49:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.549 01:49:33 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.549 01:49:33 -- accel/accel.sh@42 -- # jq -r . 00:06:59.549 [2024-11-18 01:49:33.761178] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:59.549 [2024-11-18 01:49:33.761262] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1094145 ] 00:06:59.549 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.549 [2024-11-18 01:49:33.823825] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.549 [2024-11-18 01:49:33.911323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.807 01:49:33 -- accel/accel.sh@21 -- # val= 00:06:59.807 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.807 01:49:33 -- accel/accel.sh@21 -- # val= 00:06:59.807 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.807 01:49:33 -- accel/accel.sh@21 -- # val=0x1 00:06:59.807 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.807 01:49:33 -- accel/accel.sh@21 -- # val= 00:06:59.807 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.807 01:49:33 -- accel/accel.sh@21 -- # val= 00:06:59.807 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.807 01:49:33 -- accel/accel.sh@21 -- # val=dif_verify 00:06:59.807 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.807 01:49:33 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.807 01:49:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:59.807 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.807 01:49:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:59.807 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.807 01:49:33 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:59.807 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.807 01:49:33 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:59.807 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.807 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.807 01:49:33 -- accel/accel.sh@21 -- # val= 00:06:59.808 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.808 01:49:33 -- accel/accel.sh@21 -- # val=software 00:06:59.808 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.808 01:49:33 -- accel/accel.sh@23 -- # accel_module=software 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.808 01:49:33 -- accel/accel.sh@21 -- # val=32 00:06:59.808 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.808 01:49:33 -- accel/accel.sh@21 -- # val=32 00:06:59.808 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.808 01:49:33 -- accel/accel.sh@21 -- # val=1 00:06:59.808 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.808 01:49:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:59.808 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.808 01:49:33 -- accel/accel.sh@21 -- # val=No 00:06:59.808 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.808 01:49:33 -- accel/accel.sh@21 -- # val= 00:06:59.808 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:06:59.808 01:49:33 -- accel/accel.sh@21 -- # val= 00:06:59.808 01:49:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # IFS=: 00:06:59.808 01:49:33 -- accel/accel.sh@20 -- # read -r var val 00:07:00.742 01:49:35 -- accel/accel.sh@21 -- # val= 00:07:00.742 01:49:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.742 01:49:35 -- accel/accel.sh@20 -- # IFS=: 00:07:00.742 01:49:35 -- accel/accel.sh@20 -- # read -r var val 00:07:00.742 01:49:35 -- accel/accel.sh@21 -- # val= 00:07:00.742 01:49:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.742 01:49:35 -- accel/accel.sh@20 -- # IFS=: 00:07:00.742 01:49:35 -- accel/accel.sh@20 -- # read -r var val 00:07:00.742 01:49:35 -- accel/accel.sh@21 -- # val= 00:07:00.742 01:49:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.742 01:49:35 -- accel/accel.sh@20 -- # IFS=: 00:07:00.742 01:49:35 -- accel/accel.sh@20 -- # read -r var val 00:07:00.742 01:49:35 -- accel/accel.sh@21 -- # val= 00:07:00.742 01:49:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.742 01:49:35 -- accel/accel.sh@20 -- # IFS=: 00:07:00.742 01:49:35 -- accel/accel.sh@20 -- # read -r var val 00:07:00.742 01:49:35 -- accel/accel.sh@21 -- # val= 00:07:00.742 01:49:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.742 01:49:35 -- accel/accel.sh@20 -- # IFS=: 00:07:00.742 01:49:35 -- accel/accel.sh@20 -- # read -r var val 00:07:00.742 01:49:35 -- accel/accel.sh@21 -- # val= 00:07:00.742 01:49:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.742 01:49:35 -- accel/accel.sh@20 -- # IFS=: 00:07:00.742 01:49:35 -- accel/accel.sh@20 -- # read -r var val 00:07:00.742 01:49:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:00.742 01:49:35 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:00.742 01:49:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:00.742 00:07:00.742 real 0m2.792s 00:07:00.742 user 0m2.505s 00:07:00.742 sys 0m0.281s 00:07:00.742 01:49:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:00.742 01:49:35 -- common/autotest_common.sh@10 -- # set +x 00:07:00.742 ************************************ 00:07:00.742 END TEST accel_dif_verify 00:07:00.742 ************************************ 00:07:01.000 01:49:35 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:01.000 01:49:35 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:01.000 01:49:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.001 01:49:35 -- common/autotest_common.sh@10 -- # set +x 00:07:01.001 ************************************ 00:07:01.001 START TEST accel_dif_generate 00:07:01.001 ************************************ 00:07:01.001 01:49:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:01.001 01:49:35 -- accel/accel.sh@16 -- # local accel_opc 00:07:01.001 01:49:35 -- accel/accel.sh@17 -- # local accel_module 00:07:01.001 01:49:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:01.001 01:49:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:01.001 01:49:35 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.001 01:49:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:01.001 01:49:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.001 01:49:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.001 01:49:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:01.001 01:49:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:01.001 01:49:35 -- accel/accel.sh@41 -- # local IFS=, 00:07:01.001 01:49:35 -- accel/accel.sh@42 -- # jq -r . 00:07:01.001 [2024-11-18 01:49:35.187991] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:01.001 [2024-11-18 01:49:35.188079] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1094304 ] 00:07:01.001 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.001 [2024-11-18 01:49:35.251037] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.001 [2024-11-18 01:49:35.341065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.375 01:49:36 -- accel/accel.sh@18 -- # out=' 00:07:02.375 SPDK Configuration: 00:07:02.375 Core mask: 0x1 00:07:02.375 00:07:02.375 Accel Perf Configuration: 00:07:02.375 Workload Type: dif_generate 00:07:02.375 Vector size: 4096 bytes 00:07:02.375 Transfer size: 4096 bytes 00:07:02.375 Block size: 512 bytes 00:07:02.375 Metadata size: 8 bytes 00:07:02.375 Vector count 1 00:07:02.375 Module: software 00:07:02.375 Queue depth: 32 00:07:02.375 Allocate depth: 32 00:07:02.375 # threads/core: 1 00:07:02.375 Run time: 1 seconds 00:07:02.375 Verify: No 00:07:02.375 00:07:02.375 Running for 1 seconds... 00:07:02.375 00:07:02.375 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:02.375 ------------------------------------------------------------------------------------ 00:07:02.375 0,0 96128/s 381 MiB/s 0 0 00:07:02.375 ==================================================================================== 00:07:02.375 Total 96128/s 375 MiB/s 0 0' 00:07:02.375 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.375 01:49:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:02.375 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.375 01:49:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:02.375 01:49:36 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.375 01:49:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.375 01:49:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.375 01:49:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.375 01:49:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.375 01:49:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.375 01:49:36 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.375 01:49:36 -- accel/accel.sh@42 -- # jq -r . 00:07:02.375 [2024-11-18 01:49:36.596042] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:02.375 [2024-11-18 01:49:36.596122] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1094450 ] 00:07:02.375 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.375 [2024-11-18 01:49:36.657870] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.375 [2024-11-18 01:49:36.748091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.633 01:49:36 -- accel/accel.sh@21 -- # val= 00:07:02.633 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.633 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.633 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.633 01:49:36 -- accel/accel.sh@21 -- # val= 00:07:02.633 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.633 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.633 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.633 01:49:36 -- accel/accel.sh@21 -- # val=0x1 00:07:02.633 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.633 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val= 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val= 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val=dif_generate 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val= 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val=software 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@23 -- # accel_module=software 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val=32 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val=32 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val=1 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val=No 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val= 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:02.634 01:49:36 -- accel/accel.sh@21 -- # val= 00:07:02.634 01:49:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # IFS=: 00:07:02.634 01:49:36 -- accel/accel.sh@20 -- # read -r var val 00:07:04.008 01:49:37 -- accel/accel.sh@21 -- # val= 00:07:04.008 01:49:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.008 01:49:37 -- accel/accel.sh@20 -- # IFS=: 00:07:04.008 01:49:37 -- accel/accel.sh@20 -- # read -r var val 00:07:04.008 01:49:37 -- accel/accel.sh@21 -- # val= 00:07:04.008 01:49:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.008 01:49:37 -- accel/accel.sh@20 -- # IFS=: 00:07:04.008 01:49:37 -- accel/accel.sh@20 -- # read -r var val 00:07:04.008 01:49:37 -- accel/accel.sh@21 -- # val= 00:07:04.008 01:49:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.008 01:49:37 -- accel/accel.sh@20 -- # IFS=: 00:07:04.008 01:49:37 -- accel/accel.sh@20 -- # read -r var val 00:07:04.008 01:49:37 -- accel/accel.sh@21 -- # val= 00:07:04.008 01:49:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.008 01:49:37 -- accel/accel.sh@20 -- # IFS=: 00:07:04.008 01:49:37 -- accel/accel.sh@20 -- # read -r var val 00:07:04.008 01:49:37 -- accel/accel.sh@21 -- # val= 00:07:04.008 01:49:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.008 01:49:37 -- accel/accel.sh@20 -- # IFS=: 00:07:04.008 01:49:37 -- accel/accel.sh@20 -- # read -r var val 00:07:04.008 01:49:37 -- accel/accel.sh@21 -- # val= 00:07:04.008 01:49:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.008 01:49:37 -- accel/accel.sh@20 -- # IFS=: 00:07:04.008 01:49:37 -- accel/accel.sh@20 -- # read -r var val 00:07:04.008 01:49:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:04.008 01:49:37 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:04.008 01:49:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:04.008 00:07:04.008 real 0m2.817s 00:07:04.008 user 0m2.524s 00:07:04.008 sys 0m0.289s 00:07:04.008 01:49:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.008 01:49:37 -- common/autotest_common.sh@10 -- # set +x 00:07:04.008 ************************************ 00:07:04.008 END TEST accel_dif_generate 00:07:04.008 ************************************ 00:07:04.008 01:49:38 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:04.008 01:49:38 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:04.008 01:49:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.008 01:49:38 -- common/autotest_common.sh@10 -- # set +x 00:07:04.008 ************************************ 00:07:04.008 START TEST accel_dif_generate_copy 00:07:04.008 ************************************ 00:07:04.008 01:49:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:04.008 01:49:38 -- accel/accel.sh@16 -- # local accel_opc 00:07:04.008 01:49:38 -- accel/accel.sh@17 -- # local accel_module 00:07:04.008 01:49:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:04.008 01:49:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:04.008 01:49:38 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.008 01:49:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:04.008 01:49:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.008 01:49:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.008 01:49:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:04.008 01:49:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:04.008 01:49:38 -- accel/accel.sh@41 -- # local IFS=, 00:07:04.008 01:49:38 -- accel/accel.sh@42 -- # jq -r . 00:07:04.008 [2024-11-18 01:49:38.031292] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:04.008 [2024-11-18 01:49:38.031397] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1094603 ] 00:07:04.008 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.008 [2024-11-18 01:49:38.092944] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.008 [2024-11-18 01:49:38.183422] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.383 01:49:39 -- accel/accel.sh@18 -- # out=' 00:07:05.383 SPDK Configuration: 00:07:05.383 Core mask: 0x1 00:07:05.383 00:07:05.383 Accel Perf Configuration: 00:07:05.383 Workload Type: dif_generate_copy 00:07:05.383 Vector size: 4096 bytes 00:07:05.383 Transfer size: 4096 bytes 00:07:05.383 Vector count 1 00:07:05.383 Module: software 00:07:05.383 Queue depth: 32 00:07:05.383 Allocate depth: 32 00:07:05.383 # threads/core: 1 00:07:05.383 Run time: 1 seconds 00:07:05.383 Verify: No 00:07:05.383 00:07:05.383 Running for 1 seconds... 00:07:05.383 00:07:05.383 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:05.383 ------------------------------------------------------------------------------------ 00:07:05.383 0,0 76288/s 302 MiB/s 0 0 00:07:05.383 ==================================================================================== 00:07:05.383 Total 76288/s 298 MiB/s 0 0' 00:07:05.383 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.383 01:49:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:05.383 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.383 01:49:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:05.383 01:49:39 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.383 01:49:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.383 01:49:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.383 01:49:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.383 01:49:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.383 01:49:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.383 01:49:39 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.383 01:49:39 -- accel/accel.sh@42 -- # jq -r . 00:07:05.383 [2024-11-18 01:49:39.426623] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:05.383 [2024-11-18 01:49:39.426700] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1094864 ] 00:07:05.384 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.384 [2024-11-18 01:49:39.489401] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.384 [2024-11-18 01:49:39.581805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val= 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val= 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val=0x1 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val= 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val= 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val= 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val=software 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@23 -- # accel_module=software 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val=32 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val=32 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val=1 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val=No 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val= 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:05.384 01:49:39 -- accel/accel.sh@21 -- # val= 00:07:05.384 01:49:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # IFS=: 00:07:05.384 01:49:39 -- accel/accel.sh@20 -- # read -r var val 00:07:06.802 01:49:40 -- accel/accel.sh@21 -- # val= 00:07:06.802 01:49:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.802 01:49:40 -- accel/accel.sh@20 -- # IFS=: 00:07:06.802 01:49:40 -- accel/accel.sh@20 -- # read -r var val 00:07:06.802 01:49:40 -- accel/accel.sh@21 -- # val= 00:07:06.802 01:49:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.802 01:49:40 -- accel/accel.sh@20 -- # IFS=: 00:07:06.802 01:49:40 -- accel/accel.sh@20 -- # read -r var val 00:07:06.802 01:49:40 -- accel/accel.sh@21 -- # val= 00:07:06.802 01:49:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.802 01:49:40 -- accel/accel.sh@20 -- # IFS=: 00:07:06.802 01:49:40 -- accel/accel.sh@20 -- # read -r var val 00:07:06.802 01:49:40 -- accel/accel.sh@21 -- # val= 00:07:06.802 01:49:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.802 01:49:40 -- accel/accel.sh@20 -- # IFS=: 00:07:06.802 01:49:40 -- accel/accel.sh@20 -- # read -r var val 00:07:06.802 01:49:40 -- accel/accel.sh@21 -- # val= 00:07:06.802 01:49:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.802 01:49:40 -- accel/accel.sh@20 -- # IFS=: 00:07:06.802 01:49:40 -- accel/accel.sh@20 -- # read -r var val 00:07:06.802 01:49:40 -- accel/accel.sh@21 -- # val= 00:07:06.802 01:49:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.802 01:49:40 -- accel/accel.sh@20 -- # IFS=: 00:07:06.802 01:49:40 -- accel/accel.sh@20 -- # read -r var val 00:07:06.802 01:49:40 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:06.802 01:49:40 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:06.802 01:49:40 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:06.802 00:07:06.802 real 0m2.786s 00:07:06.802 user 0m2.481s 00:07:06.802 sys 0m0.296s 00:07:06.802 01:49:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:06.802 01:49:40 -- common/autotest_common.sh@10 -- # set +x 00:07:06.802 ************************************ 00:07:06.802 END TEST accel_dif_generate_copy 00:07:06.802 ************************************ 00:07:06.802 01:49:40 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:06.802 01:49:40 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:06.802 01:49:40 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:06.802 01:49:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:06.802 01:49:40 -- common/autotest_common.sh@10 -- # set +x 00:07:06.802 ************************************ 00:07:06.802 START TEST accel_comp 00:07:06.802 ************************************ 00:07:06.802 01:49:40 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:06.802 01:49:40 -- accel/accel.sh@16 -- # local accel_opc 00:07:06.802 01:49:40 -- accel/accel.sh@17 -- # local accel_module 00:07:06.802 01:49:40 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:06.802 01:49:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:06.802 01:49:40 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.802 01:49:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.802 01:49:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.802 01:49:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.802 01:49:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.802 01:49:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.802 01:49:40 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.802 01:49:40 -- accel/accel.sh@42 -- # jq -r . 00:07:06.802 [2024-11-18 01:49:40.843424] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:06.802 [2024-11-18 01:49:40.843497] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1095031 ] 00:07:06.802 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.802 [2024-11-18 01:49:40.907118] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.802 [2024-11-18 01:49:40.997723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.194 01:49:42 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:08.194 00:07:08.194 SPDK Configuration: 00:07:08.194 Core mask: 0x1 00:07:08.194 00:07:08.194 Accel Perf Configuration: 00:07:08.194 Workload Type: compress 00:07:08.194 Transfer size: 4096 bytes 00:07:08.194 Vector count 1 00:07:08.194 Module: software 00:07:08.194 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:08.194 Queue depth: 32 00:07:08.194 Allocate depth: 32 00:07:08.194 # threads/core: 1 00:07:08.194 Run time: 1 seconds 00:07:08.194 Verify: No 00:07:08.194 00:07:08.194 Running for 1 seconds... 00:07:08.194 00:07:08.194 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:08.194 ------------------------------------------------------------------------------------ 00:07:08.194 0,0 31584/s 131 MiB/s 0 0 00:07:08.194 ==================================================================================== 00:07:08.194 Total 31584/s 123 MiB/s 0 0' 00:07:08.194 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.194 01:49:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:08.194 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.194 01:49:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:08.194 01:49:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:08.194 01:49:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:08.194 01:49:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:08.194 01:49:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:08.194 01:49:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:08.194 01:49:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:08.194 01:49:42 -- accel/accel.sh@41 -- # local IFS=, 00:07:08.194 01:49:42 -- accel/accel.sh@42 -- # jq -r . 00:07:08.194 [2024-11-18 01:49:42.253107] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:08.194 [2024-11-18 01:49:42.253188] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1095175 ] 00:07:08.194 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.194 [2024-11-18 01:49:42.314706] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:08.194 [2024-11-18 01:49:42.405915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.194 01:49:42 -- accel/accel.sh@21 -- # val= 00:07:08.194 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.194 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.194 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.194 01:49:42 -- accel/accel.sh@21 -- # val= 00:07:08.194 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.194 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.194 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.194 01:49:42 -- accel/accel.sh@21 -- # val= 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val=0x1 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val= 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val= 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val=compress 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val= 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val=software 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@23 -- # accel_module=software 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val=32 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val=32 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val=1 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val=No 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val= 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:08.195 01:49:42 -- accel/accel.sh@21 -- # val= 00:07:08.195 01:49:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # IFS=: 00:07:08.195 01:49:42 -- accel/accel.sh@20 -- # read -r var val 00:07:09.568 01:49:43 -- accel/accel.sh@21 -- # val= 00:07:09.568 01:49:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.568 01:49:43 -- accel/accel.sh@20 -- # IFS=: 00:07:09.568 01:49:43 -- accel/accel.sh@20 -- # read -r var val 00:07:09.568 01:49:43 -- accel/accel.sh@21 -- # val= 00:07:09.568 01:49:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.568 01:49:43 -- accel/accel.sh@20 -- # IFS=: 00:07:09.568 01:49:43 -- accel/accel.sh@20 -- # read -r var val 00:07:09.568 01:49:43 -- accel/accel.sh@21 -- # val= 00:07:09.568 01:49:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.568 01:49:43 -- accel/accel.sh@20 -- # IFS=: 00:07:09.569 01:49:43 -- accel/accel.sh@20 -- # read -r var val 00:07:09.569 01:49:43 -- accel/accel.sh@21 -- # val= 00:07:09.569 01:49:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.569 01:49:43 -- accel/accel.sh@20 -- # IFS=: 00:07:09.569 01:49:43 -- accel/accel.sh@20 -- # read -r var val 00:07:09.569 01:49:43 -- accel/accel.sh@21 -- # val= 00:07:09.569 01:49:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.569 01:49:43 -- accel/accel.sh@20 -- # IFS=: 00:07:09.569 01:49:43 -- accel/accel.sh@20 -- # read -r var val 00:07:09.569 01:49:43 -- accel/accel.sh@21 -- # val= 00:07:09.569 01:49:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.569 01:49:43 -- accel/accel.sh@20 -- # IFS=: 00:07:09.569 01:49:43 -- accel/accel.sh@20 -- # read -r var val 00:07:09.569 01:49:43 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:09.569 01:49:43 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:09.569 01:49:43 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:09.569 00:07:09.569 real 0m2.822s 00:07:09.569 user 0m2.521s 00:07:09.569 sys 0m0.295s 00:07:09.569 01:49:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:09.569 01:49:43 -- common/autotest_common.sh@10 -- # set +x 00:07:09.569 ************************************ 00:07:09.569 END TEST accel_comp 00:07:09.569 ************************************ 00:07:09.569 01:49:43 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:09.569 01:49:43 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:09.569 01:49:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:09.569 01:49:43 -- common/autotest_common.sh@10 -- # set +x 00:07:09.569 ************************************ 00:07:09.569 START TEST accel_decomp 00:07:09.569 ************************************ 00:07:09.569 01:49:43 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:09.569 01:49:43 -- accel/accel.sh@16 -- # local accel_opc 00:07:09.569 01:49:43 -- accel/accel.sh@17 -- # local accel_module 00:07:09.569 01:49:43 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:09.569 01:49:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:09.569 01:49:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.569 01:49:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.569 01:49:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.569 01:49:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.569 01:49:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.569 01:49:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.569 01:49:43 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.569 01:49:43 -- accel/accel.sh@42 -- # jq -r . 00:07:09.569 [2024-11-18 01:49:43.691009] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:09.569 [2024-11-18 01:49:43.691088] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1095334 ] 00:07:09.569 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.569 [2024-11-18 01:49:43.752202] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.569 [2024-11-18 01:49:43.844798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.943 01:49:45 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:10.943 00:07:10.943 SPDK Configuration: 00:07:10.943 Core mask: 0x1 00:07:10.943 00:07:10.943 Accel Perf Configuration: 00:07:10.943 Workload Type: decompress 00:07:10.943 Transfer size: 4096 bytes 00:07:10.943 Vector count 1 00:07:10.943 Module: software 00:07:10.943 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:10.943 Queue depth: 32 00:07:10.943 Allocate depth: 32 00:07:10.943 # threads/core: 1 00:07:10.943 Run time: 1 seconds 00:07:10.943 Verify: Yes 00:07:10.943 00:07:10.943 Running for 1 seconds... 00:07:10.943 00:07:10.943 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:10.943 ------------------------------------------------------------------------------------ 00:07:10.943 0,0 55456/s 102 MiB/s 0 0 00:07:10.943 ==================================================================================== 00:07:10.943 Total 55456/s 216 MiB/s 0 0' 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.943 01:49:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.943 01:49:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:10.943 01:49:45 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.943 01:49:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.943 01:49:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.943 01:49:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.943 01:49:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.943 01:49:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.943 01:49:45 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.943 01:49:45 -- accel/accel.sh@42 -- # jq -r . 00:07:10.943 [2024-11-18 01:49:45.094539] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:10.943 [2024-11-18 01:49:45.094620] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1095593 ] 00:07:10.943 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.943 [2024-11-18 01:49:45.159724] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.943 [2024-11-18 01:49:45.249246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.943 01:49:45 -- accel/accel.sh@21 -- # val= 00:07:10.943 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.943 01:49:45 -- accel/accel.sh@21 -- # val= 00:07:10.943 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.943 01:49:45 -- accel/accel.sh@21 -- # val= 00:07:10.943 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.943 01:49:45 -- accel/accel.sh@21 -- # val=0x1 00:07:10.943 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.943 01:49:45 -- accel/accel.sh@21 -- # val= 00:07:10.943 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.943 01:49:45 -- accel/accel.sh@21 -- # val= 00:07:10.943 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.943 01:49:45 -- accel/accel.sh@21 -- # val=decompress 00:07:10.943 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.943 01:49:45 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.943 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.944 01:49:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:10.944 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.944 01:49:45 -- accel/accel.sh@21 -- # val= 00:07:10.944 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.944 01:49:45 -- accel/accel.sh@21 -- # val=software 00:07:10.944 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.944 01:49:45 -- accel/accel.sh@23 -- # accel_module=software 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.944 01:49:45 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:10.944 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.944 01:49:45 -- accel/accel.sh@21 -- # val=32 00:07:10.944 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.944 01:49:45 -- accel/accel.sh@21 -- # val=32 00:07:10.944 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.944 01:49:45 -- accel/accel.sh@21 -- # val=1 00:07:10.944 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.944 01:49:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:10.944 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.944 01:49:45 -- accel/accel.sh@21 -- # val=Yes 00:07:10.944 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.944 01:49:45 -- accel/accel.sh@21 -- # val= 00:07:10.944 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:10.944 01:49:45 -- accel/accel.sh@21 -- # val= 00:07:10.944 01:49:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # IFS=: 00:07:10.944 01:49:45 -- accel/accel.sh@20 -- # read -r var val 00:07:12.318 01:49:46 -- accel/accel.sh@21 -- # val= 00:07:12.318 01:49:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.318 01:49:46 -- accel/accel.sh@20 -- # IFS=: 00:07:12.318 01:49:46 -- accel/accel.sh@20 -- # read -r var val 00:07:12.318 01:49:46 -- accel/accel.sh@21 -- # val= 00:07:12.318 01:49:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.318 01:49:46 -- accel/accel.sh@20 -- # IFS=: 00:07:12.318 01:49:46 -- accel/accel.sh@20 -- # read -r var val 00:07:12.318 01:49:46 -- accel/accel.sh@21 -- # val= 00:07:12.318 01:49:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.318 01:49:46 -- accel/accel.sh@20 -- # IFS=: 00:07:12.318 01:49:46 -- accel/accel.sh@20 -- # read -r var val 00:07:12.318 01:49:46 -- accel/accel.sh@21 -- # val= 00:07:12.318 01:49:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.318 01:49:46 -- accel/accel.sh@20 -- # IFS=: 00:07:12.318 01:49:46 -- accel/accel.sh@20 -- # read -r var val 00:07:12.318 01:49:46 -- accel/accel.sh@21 -- # val= 00:07:12.318 01:49:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.318 01:49:46 -- accel/accel.sh@20 -- # IFS=: 00:07:12.318 01:49:46 -- accel/accel.sh@20 -- # read -r var val 00:07:12.318 01:49:46 -- accel/accel.sh@21 -- # val= 00:07:12.318 01:49:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.318 01:49:46 -- accel/accel.sh@20 -- # IFS=: 00:07:12.318 01:49:46 -- accel/accel.sh@20 -- # read -r var val 00:07:12.318 01:49:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:12.318 01:49:46 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:12.318 01:49:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:12.318 00:07:12.318 real 0m2.801s 00:07:12.318 user 0m2.516s 00:07:12.318 sys 0m0.277s 00:07:12.318 01:49:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:12.318 01:49:46 -- common/autotest_common.sh@10 -- # set +x 00:07:12.318 ************************************ 00:07:12.318 END TEST accel_decomp 00:07:12.318 ************************************ 00:07:12.318 01:49:46 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:12.318 01:49:46 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:12.318 01:49:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:12.318 01:49:46 -- common/autotest_common.sh@10 -- # set +x 00:07:12.318 ************************************ 00:07:12.318 START TEST accel_decmop_full 00:07:12.318 ************************************ 00:07:12.318 01:49:46 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:12.318 01:49:46 -- accel/accel.sh@16 -- # local accel_opc 00:07:12.318 01:49:46 -- accel/accel.sh@17 -- # local accel_module 00:07:12.318 01:49:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:12.318 01:49:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:12.318 01:49:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:12.318 01:49:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:12.318 01:49:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.318 01:49:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.318 01:49:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:12.318 01:49:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:12.318 01:49:46 -- accel/accel.sh@41 -- # local IFS=, 00:07:12.318 01:49:46 -- accel/accel.sh@42 -- # jq -r . 00:07:12.318 [2024-11-18 01:49:46.518860] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:12.318 [2024-11-18 01:49:46.518943] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1095755 ] 00:07:12.318 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.318 [2024-11-18 01:49:46.581235] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.318 [2024-11-18 01:49:46.671079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:13.691 01:49:47 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:13.691 00:07:13.691 SPDK Configuration: 00:07:13.691 Core mask: 0x1 00:07:13.691 00:07:13.691 Accel Perf Configuration: 00:07:13.691 Workload Type: decompress 00:07:13.691 Transfer size: 111250 bytes 00:07:13.691 Vector count 1 00:07:13.691 Module: software 00:07:13.691 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:13.691 Queue depth: 32 00:07:13.691 Allocate depth: 32 00:07:13.691 # threads/core: 1 00:07:13.691 Run time: 1 seconds 00:07:13.691 Verify: Yes 00:07:13.691 00:07:13.691 Running for 1 seconds... 00:07:13.691 00:07:13.691 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:13.691 ------------------------------------------------------------------------------------ 00:07:13.691 0,0 3808/s 157 MiB/s 0 0 00:07:13.691 ==================================================================================== 00:07:13.691 Total 3808/s 404 MiB/s 0 0' 00:07:13.691 01:49:47 -- accel/accel.sh@20 -- # IFS=: 00:07:13.691 01:49:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:13.691 01:49:47 -- accel/accel.sh@20 -- # read -r var val 00:07:13.691 01:49:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:13.691 01:49:47 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.691 01:49:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.691 01:49:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.691 01:49:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.691 01:49:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.691 01:49:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.691 01:49:47 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.691 01:49:47 -- accel/accel.sh@42 -- # jq -r . 00:07:13.691 [2024-11-18 01:49:47.945382] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:13.691 [2024-11-18 01:49:47.945460] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1095902 ] 00:07:13.691 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.691 [2024-11-18 01:49:48.007197] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.949 [2024-11-18 01:49:48.098640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:13.949 01:49:48 -- accel/accel.sh@21 -- # val= 00:07:13.949 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val= 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val= 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val=0x1 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val= 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val= 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val=decompress 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val= 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val=software 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@23 -- # accel_module=software 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val=32 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val=32 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val=1 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val=Yes 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val= 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:13.950 01:49:48 -- accel/accel.sh@21 -- # val= 00:07:13.950 01:49:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # IFS=: 00:07:13.950 01:49:48 -- accel/accel.sh@20 -- # read -r var val 00:07:15.322 01:49:49 -- accel/accel.sh@21 -- # val= 00:07:15.322 01:49:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.322 01:49:49 -- accel/accel.sh@20 -- # IFS=: 00:07:15.322 01:49:49 -- accel/accel.sh@20 -- # read -r var val 00:07:15.322 01:49:49 -- accel/accel.sh@21 -- # val= 00:07:15.322 01:49:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.322 01:49:49 -- accel/accel.sh@20 -- # IFS=: 00:07:15.322 01:49:49 -- accel/accel.sh@20 -- # read -r var val 00:07:15.322 01:49:49 -- accel/accel.sh@21 -- # val= 00:07:15.322 01:49:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.322 01:49:49 -- accel/accel.sh@20 -- # IFS=: 00:07:15.322 01:49:49 -- accel/accel.sh@20 -- # read -r var val 00:07:15.322 01:49:49 -- accel/accel.sh@21 -- # val= 00:07:15.322 01:49:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.322 01:49:49 -- accel/accel.sh@20 -- # IFS=: 00:07:15.322 01:49:49 -- accel/accel.sh@20 -- # read -r var val 00:07:15.322 01:49:49 -- accel/accel.sh@21 -- # val= 00:07:15.322 01:49:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.322 01:49:49 -- accel/accel.sh@20 -- # IFS=: 00:07:15.322 01:49:49 -- accel/accel.sh@20 -- # read -r var val 00:07:15.322 01:49:49 -- accel/accel.sh@21 -- # val= 00:07:15.322 01:49:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.322 01:49:49 -- accel/accel.sh@20 -- # IFS=: 00:07:15.322 01:49:49 -- accel/accel.sh@20 -- # read -r var val 00:07:15.322 01:49:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:15.322 01:49:49 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:15.322 01:49:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:15.322 00:07:15.322 real 0m2.849s 00:07:15.322 user 0m2.539s 00:07:15.322 sys 0m0.303s 00:07:15.322 01:49:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:15.322 01:49:49 -- common/autotest_common.sh@10 -- # set +x 00:07:15.322 ************************************ 00:07:15.322 END TEST accel_decmop_full 00:07:15.322 ************************************ 00:07:15.322 01:49:49 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:15.322 01:49:49 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:15.323 01:49:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.323 01:49:49 -- common/autotest_common.sh@10 -- # set +x 00:07:15.323 ************************************ 00:07:15.323 START TEST accel_decomp_mcore 00:07:15.323 ************************************ 00:07:15.323 01:49:49 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:15.323 01:49:49 -- accel/accel.sh@16 -- # local accel_opc 00:07:15.323 01:49:49 -- accel/accel.sh@17 -- # local accel_module 00:07:15.323 01:49:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:15.323 01:49:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:15.323 01:49:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:15.323 01:49:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:15.323 01:49:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:15.323 01:49:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:15.323 01:49:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:15.323 01:49:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:15.323 01:49:49 -- accel/accel.sh@41 -- # local IFS=, 00:07:15.323 01:49:49 -- accel/accel.sh@42 -- # jq -r . 00:07:15.323 [2024-11-18 01:49:49.397849] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:15.323 [2024-11-18 01:49:49.397940] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1096055 ] 00:07:15.323 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.323 [2024-11-18 01:49:49.461111] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:15.323 [2024-11-18 01:49:49.554348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:15.323 [2024-11-18 01:49:49.554439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:15.323 [2024-11-18 01:49:49.554442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.323 [2024-11-18 01:49:49.554407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:16.697 01:49:50 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:16.697 00:07:16.697 SPDK Configuration: 00:07:16.697 Core mask: 0xf 00:07:16.697 00:07:16.697 Accel Perf Configuration: 00:07:16.697 Workload Type: decompress 00:07:16.697 Transfer size: 4096 bytes 00:07:16.697 Vector count 1 00:07:16.697 Module: software 00:07:16.697 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:16.697 Queue depth: 32 00:07:16.697 Allocate depth: 32 00:07:16.697 # threads/core: 1 00:07:16.697 Run time: 1 seconds 00:07:16.697 Verify: Yes 00:07:16.697 00:07:16.697 Running for 1 seconds... 00:07:16.697 00:07:16.697 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:16.697 ------------------------------------------------------------------------------------ 00:07:16.697 0,0 55488/s 102 MiB/s 0 0 00:07:16.697 3,0 56128/s 103 MiB/s 0 0 00:07:16.697 2,0 55968/s 103 MiB/s 0 0 00:07:16.697 1,0 55936/s 103 MiB/s 0 0 00:07:16.697 ==================================================================================== 00:07:16.697 Total 223520/s 873 MiB/s 0 0' 00:07:16.697 01:49:50 -- accel/accel.sh@20 -- # IFS=: 00:07:16.697 01:49:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:16.697 01:49:50 -- accel/accel.sh@20 -- # read -r var val 00:07:16.697 01:49:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:16.697 01:49:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.697 01:49:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.697 01:49:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.698 01:49:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.698 01:49:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.698 01:49:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.698 01:49:50 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.698 01:49:50 -- accel/accel.sh@42 -- # jq -r . 00:07:16.698 [2024-11-18 01:49:50.809240] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:16.698 [2024-11-18 01:49:50.809326] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1096323 ] 00:07:16.698 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.698 [2024-11-18 01:49:50.871361] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:16.698 [2024-11-18 01:49:50.963204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:16.698 [2024-11-18 01:49:50.963270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:16.698 [2024-11-18 01:49:50.963374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:16.698 [2024-11-18 01:49:50.963377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val= 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val= 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val= 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val=0xf 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val= 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val= 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val=decompress 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val= 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val=software 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@23 -- # accel_module=software 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val=32 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val=32 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val=1 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val=Yes 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val= 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:16.698 01:49:51 -- accel/accel.sh@21 -- # val= 00:07:16.698 01:49:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # IFS=: 00:07:16.698 01:49:51 -- accel/accel.sh@20 -- # read -r var val 00:07:18.073 01:49:52 -- accel/accel.sh@21 -- # val= 00:07:18.073 01:49:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # IFS=: 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # read -r var val 00:07:18.073 01:49:52 -- accel/accel.sh@21 -- # val= 00:07:18.073 01:49:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # IFS=: 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # read -r var val 00:07:18.073 01:49:52 -- accel/accel.sh@21 -- # val= 00:07:18.073 01:49:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # IFS=: 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # read -r var val 00:07:18.073 01:49:52 -- accel/accel.sh@21 -- # val= 00:07:18.073 01:49:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # IFS=: 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # read -r var val 00:07:18.073 01:49:52 -- accel/accel.sh@21 -- # val= 00:07:18.073 01:49:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # IFS=: 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # read -r var val 00:07:18.073 01:49:52 -- accel/accel.sh@21 -- # val= 00:07:18.073 01:49:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # IFS=: 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # read -r var val 00:07:18.073 01:49:52 -- accel/accel.sh@21 -- # val= 00:07:18.073 01:49:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # IFS=: 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # read -r var val 00:07:18.073 01:49:52 -- accel/accel.sh@21 -- # val= 00:07:18.073 01:49:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # IFS=: 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # read -r var val 00:07:18.073 01:49:52 -- accel/accel.sh@21 -- # val= 00:07:18.073 01:49:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # IFS=: 00:07:18.073 01:49:52 -- accel/accel.sh@20 -- # read -r var val 00:07:18.073 01:49:52 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:18.073 01:49:52 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:18.073 01:49:52 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:18.073 00:07:18.073 real 0m2.816s 00:07:18.073 user 0m9.368s 00:07:18.073 sys 0m0.306s 00:07:18.073 01:49:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:18.073 01:49:52 -- common/autotest_common.sh@10 -- # set +x 00:07:18.073 ************************************ 00:07:18.073 END TEST accel_decomp_mcore 00:07:18.073 ************************************ 00:07:18.073 01:49:52 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:18.073 01:49:52 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:18.073 01:49:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:18.073 01:49:52 -- common/autotest_common.sh@10 -- # set +x 00:07:18.073 ************************************ 00:07:18.073 START TEST accel_decomp_full_mcore 00:07:18.073 ************************************ 00:07:18.073 01:49:52 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:18.073 01:49:52 -- accel/accel.sh@16 -- # local accel_opc 00:07:18.073 01:49:52 -- accel/accel.sh@17 -- # local accel_module 00:07:18.073 01:49:52 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:18.073 01:49:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:18.073 01:49:52 -- accel/accel.sh@12 -- # build_accel_config 00:07:18.073 01:49:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:18.073 01:49:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:18.073 01:49:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:18.073 01:49:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:18.073 01:49:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:18.073 01:49:52 -- accel/accel.sh@41 -- # local IFS=, 00:07:18.073 01:49:52 -- accel/accel.sh@42 -- # jq -r . 00:07:18.073 [2024-11-18 01:49:52.238155] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:18.073 [2024-11-18 01:49:52.238233] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1096488 ] 00:07:18.073 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.073 [2024-11-18 01:49:52.300496] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:18.073 [2024-11-18 01:49:52.394771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:18.073 [2024-11-18 01:49:52.394829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:18.073 [2024-11-18 01:49:52.394927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:18.073 [2024-11-18 01:49:52.394929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.447 01:49:53 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:19.447 00:07:19.447 SPDK Configuration: 00:07:19.447 Core mask: 0xf 00:07:19.447 00:07:19.447 Accel Perf Configuration: 00:07:19.447 Workload Type: decompress 00:07:19.447 Transfer size: 111250 bytes 00:07:19.447 Vector count 1 00:07:19.447 Module: software 00:07:19.447 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:19.447 Queue depth: 32 00:07:19.447 Allocate depth: 32 00:07:19.447 # threads/core: 1 00:07:19.447 Run time: 1 seconds 00:07:19.447 Verify: Yes 00:07:19.447 00:07:19.447 Running for 1 seconds... 00:07:19.447 00:07:19.447 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:19.447 ------------------------------------------------------------------------------------ 00:07:19.447 0,0 4288/s 177 MiB/s 0 0 00:07:19.447 3,0 4288/s 177 MiB/s 0 0 00:07:19.447 2,0 4288/s 177 MiB/s 0 0 00:07:19.447 1,0 4288/s 177 MiB/s 0 0 00:07:19.447 ==================================================================================== 00:07:19.447 Total 17152/s 1819 MiB/s 0 0' 00:07:19.447 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.447 01:49:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:19.447 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.447 01:49:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:19.447 01:49:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.447 01:49:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.447 01:49:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.447 01:49:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.447 01:49:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.447 01:49:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.447 01:49:53 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.447 01:49:53 -- accel/accel.sh@42 -- # jq -r . 00:07:19.447 [2024-11-18 01:49:53.667224] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:19.447 [2024-11-18 01:49:53.667305] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1096632 ] 00:07:19.447 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.447 [2024-11-18 01:49:53.729189] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:19.447 [2024-11-18 01:49:53.825084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:19.447 [2024-11-18 01:49:53.825136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:19.447 [2024-11-18 01:49:53.825253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:19.447 [2024-11-18 01:49:53.825255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.705 01:49:53 -- accel/accel.sh@21 -- # val= 00:07:19.705 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val= 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val= 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val=0xf 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val= 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val= 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val=decompress 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val= 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val=software 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@23 -- # accel_module=software 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val=32 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val=32 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val=1 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val=Yes 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val= 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:19.706 01:49:53 -- accel/accel.sh@21 -- # val= 00:07:19.706 01:49:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # IFS=: 00:07:19.706 01:49:53 -- accel/accel.sh@20 -- # read -r var val 00:07:21.080 01:49:55 -- accel/accel.sh@21 -- # val= 00:07:21.080 01:49:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # IFS=: 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # read -r var val 00:07:21.080 01:49:55 -- accel/accel.sh@21 -- # val= 00:07:21.080 01:49:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # IFS=: 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # read -r var val 00:07:21.080 01:49:55 -- accel/accel.sh@21 -- # val= 00:07:21.080 01:49:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # IFS=: 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # read -r var val 00:07:21.080 01:49:55 -- accel/accel.sh@21 -- # val= 00:07:21.080 01:49:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # IFS=: 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # read -r var val 00:07:21.080 01:49:55 -- accel/accel.sh@21 -- # val= 00:07:21.080 01:49:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # IFS=: 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # read -r var val 00:07:21.080 01:49:55 -- accel/accel.sh@21 -- # val= 00:07:21.080 01:49:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # IFS=: 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # read -r var val 00:07:21.080 01:49:55 -- accel/accel.sh@21 -- # val= 00:07:21.080 01:49:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # IFS=: 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # read -r var val 00:07:21.080 01:49:55 -- accel/accel.sh@21 -- # val= 00:07:21.080 01:49:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # IFS=: 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # read -r var val 00:07:21.080 01:49:55 -- accel/accel.sh@21 -- # val= 00:07:21.080 01:49:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # IFS=: 00:07:21.080 01:49:55 -- accel/accel.sh@20 -- # read -r var val 00:07:21.080 01:49:55 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:21.080 01:49:55 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:21.080 01:49:55 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:21.080 00:07:21.080 real 0m2.861s 00:07:21.080 user 0m9.513s 00:07:21.080 sys 0m0.324s 00:07:21.080 01:49:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:21.080 01:49:55 -- common/autotest_common.sh@10 -- # set +x 00:07:21.080 ************************************ 00:07:21.080 END TEST accel_decomp_full_mcore 00:07:21.080 ************************************ 00:07:21.081 01:49:55 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:21.081 01:49:55 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:21.081 01:49:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.081 01:49:55 -- common/autotest_common.sh@10 -- # set +x 00:07:21.081 ************************************ 00:07:21.081 START TEST accel_decomp_mthread 00:07:21.081 ************************************ 00:07:21.081 01:49:55 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:21.081 01:49:55 -- accel/accel.sh@16 -- # local accel_opc 00:07:21.081 01:49:55 -- accel/accel.sh@17 -- # local accel_module 00:07:21.081 01:49:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:21.081 01:49:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:21.081 01:49:55 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.081 01:49:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:21.081 01:49:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.081 01:49:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.081 01:49:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:21.081 01:49:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:21.081 01:49:55 -- accel/accel.sh@41 -- # local IFS=, 00:07:21.081 01:49:55 -- accel/accel.sh@42 -- # jq -r . 00:07:21.081 [2024-11-18 01:49:55.123272] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:21.081 [2024-11-18 01:49:55.123378] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1096794 ] 00:07:21.081 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.081 [2024-11-18 01:49:55.187581] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.081 [2024-11-18 01:49:55.277684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.452 01:49:56 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:22.452 00:07:22.452 SPDK Configuration: 00:07:22.452 Core mask: 0x1 00:07:22.452 00:07:22.452 Accel Perf Configuration: 00:07:22.452 Workload Type: decompress 00:07:22.452 Transfer size: 4096 bytes 00:07:22.452 Vector count 1 00:07:22.452 Module: software 00:07:22.452 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:22.452 Queue depth: 32 00:07:22.452 Allocate depth: 32 00:07:22.452 # threads/core: 2 00:07:22.452 Run time: 1 seconds 00:07:22.452 Verify: Yes 00:07:22.452 00:07:22.452 Running for 1 seconds... 00:07:22.452 00:07:22.452 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:22.452 ------------------------------------------------------------------------------------ 00:07:22.452 0,1 28064/s 51 MiB/s 0 0 00:07:22.452 0,0 27936/s 51 MiB/s 0 0 00:07:22.452 ==================================================================================== 00:07:22.452 Total 56000/s 218 MiB/s 0 0' 00:07:22.452 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:22.453 01:49:56 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.453 01:49:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.453 01:49:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.453 01:49:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.453 01:49:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.453 01:49:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.453 01:49:56 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.453 01:49:56 -- accel/accel.sh@42 -- # jq -r . 00:07:22.453 [2024-11-18 01:49:56.536454] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:22.453 [2024-11-18 01:49:56.536533] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1097053 ] 00:07:22.453 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.453 [2024-11-18 01:49:56.598328] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.453 [2024-11-18 01:49:56.688324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val= 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val= 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val= 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val=0x1 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val= 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val= 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val=decompress 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val= 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val=software 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@23 -- # accel_module=software 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val=32 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val=32 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val=2 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.453 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.453 01:49:56 -- accel/accel.sh@21 -- # val=Yes 00:07:22.453 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.454 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.454 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.454 01:49:56 -- accel/accel.sh@21 -- # val= 00:07:22.454 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.454 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.454 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:22.454 01:49:56 -- accel/accel.sh@21 -- # val= 00:07:22.454 01:49:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.454 01:49:56 -- accel/accel.sh@20 -- # IFS=: 00:07:22.454 01:49:56 -- accel/accel.sh@20 -- # read -r var val 00:07:23.828 01:49:57 -- accel/accel.sh@21 -- # val= 00:07:23.828 01:49:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # IFS=: 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # read -r var val 00:07:23.828 01:49:57 -- accel/accel.sh@21 -- # val= 00:07:23.828 01:49:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # IFS=: 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # read -r var val 00:07:23.828 01:49:57 -- accel/accel.sh@21 -- # val= 00:07:23.828 01:49:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # IFS=: 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # read -r var val 00:07:23.828 01:49:57 -- accel/accel.sh@21 -- # val= 00:07:23.828 01:49:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # IFS=: 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # read -r var val 00:07:23.828 01:49:57 -- accel/accel.sh@21 -- # val= 00:07:23.828 01:49:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # IFS=: 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # read -r var val 00:07:23.828 01:49:57 -- accel/accel.sh@21 -- # val= 00:07:23.828 01:49:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # IFS=: 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # read -r var val 00:07:23.828 01:49:57 -- accel/accel.sh@21 -- # val= 00:07:23.828 01:49:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # IFS=: 00:07:23.828 01:49:57 -- accel/accel.sh@20 -- # read -r var val 00:07:23.828 01:49:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:23.828 01:49:57 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:23.828 01:49:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:23.828 00:07:23.828 real 0m2.816s 00:07:23.828 user 0m2.509s 00:07:23.828 sys 0m0.299s 00:07:23.828 01:49:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:23.828 01:49:57 -- common/autotest_common.sh@10 -- # set +x 00:07:23.828 ************************************ 00:07:23.828 END TEST accel_decomp_mthread 00:07:23.828 ************************************ 00:07:23.828 01:49:57 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:23.828 01:49:57 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:23.828 01:49:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:23.828 01:49:57 -- common/autotest_common.sh@10 -- # set +x 00:07:23.828 ************************************ 00:07:23.828 START TEST accel_deomp_full_mthread 00:07:23.828 ************************************ 00:07:23.828 01:49:57 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:23.828 01:49:57 -- accel/accel.sh@16 -- # local accel_opc 00:07:23.828 01:49:57 -- accel/accel.sh@17 -- # local accel_module 00:07:23.828 01:49:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:23.828 01:49:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:23.828 01:49:57 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.828 01:49:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.828 01:49:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.828 01:49:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.828 01:49:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.828 01:49:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.828 01:49:57 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.828 01:49:57 -- accel/accel.sh@42 -- # jq -r . 00:07:23.828 [2024-11-18 01:49:57.965195] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:23.828 [2024-11-18 01:49:57.965261] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1097221 ] 00:07:23.828 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.828 [2024-11-18 01:49:58.025593] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.828 [2024-11-18 01:49:58.115967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.203 01:49:59 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:25.203 00:07:25.203 SPDK Configuration: 00:07:25.203 Core mask: 0x1 00:07:25.203 00:07:25.203 Accel Perf Configuration: 00:07:25.203 Workload Type: decompress 00:07:25.203 Transfer size: 111250 bytes 00:07:25.203 Vector count 1 00:07:25.203 Module: software 00:07:25.203 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.203 Queue depth: 32 00:07:25.203 Allocate depth: 32 00:07:25.203 # threads/core: 2 00:07:25.203 Run time: 1 seconds 00:07:25.203 Verify: Yes 00:07:25.203 00:07:25.203 Running for 1 seconds... 00:07:25.203 00:07:25.203 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:25.203 ------------------------------------------------------------------------------------ 00:07:25.203 0,1 1952/s 80 MiB/s 0 0 00:07:25.203 0,0 1920/s 79 MiB/s 0 0 00:07:25.203 ==================================================================================== 00:07:25.203 Total 3872/s 410 MiB/s 0 0' 00:07:25.203 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.203 01:49:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:25.203 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.203 01:49:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:25.203 01:49:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.203 01:49:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:25.203 01:49:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.203 01:49:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.203 01:49:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:25.203 01:49:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:25.203 01:49:59 -- accel/accel.sh@41 -- # local IFS=, 00:07:25.203 01:49:59 -- accel/accel.sh@42 -- # jq -r . 00:07:25.203 [2024-11-18 01:49:59.400166] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:25.203 [2024-11-18 01:49:59.400246] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1097362 ] 00:07:25.203 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.203 [2024-11-18 01:49:59.461517] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:25.203 [2024-11-18 01:49:59.551528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val= 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val= 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val= 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val=0x1 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val= 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val= 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val=decompress 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val= 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val=software 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@23 -- # accel_module=software 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val=32 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val=32 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val=2 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val=Yes 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val= 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:25.461 01:49:59 -- accel/accel.sh@21 -- # val= 00:07:25.461 01:49:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # IFS=: 00:07:25.461 01:49:59 -- accel/accel.sh@20 -- # read -r var val 00:07:26.836 01:50:00 -- accel/accel.sh@21 -- # val= 00:07:26.836 01:50:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # IFS=: 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # read -r var val 00:07:26.836 01:50:00 -- accel/accel.sh@21 -- # val= 00:07:26.836 01:50:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # IFS=: 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # read -r var val 00:07:26.836 01:50:00 -- accel/accel.sh@21 -- # val= 00:07:26.836 01:50:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # IFS=: 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # read -r var val 00:07:26.836 01:50:00 -- accel/accel.sh@21 -- # val= 00:07:26.836 01:50:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # IFS=: 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # read -r var val 00:07:26.836 01:50:00 -- accel/accel.sh@21 -- # val= 00:07:26.836 01:50:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # IFS=: 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # read -r var val 00:07:26.836 01:50:00 -- accel/accel.sh@21 -- # val= 00:07:26.836 01:50:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # IFS=: 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # read -r var val 00:07:26.836 01:50:00 -- accel/accel.sh@21 -- # val= 00:07:26.836 01:50:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # IFS=: 00:07:26.836 01:50:00 -- accel/accel.sh@20 -- # read -r var val 00:07:26.836 01:50:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:26.836 01:50:00 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:26.836 01:50:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:26.836 00:07:26.836 real 0m2.879s 00:07:26.836 user 0m2.582s 00:07:26.836 sys 0m0.289s 00:07:26.836 01:50:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:26.836 01:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:26.836 ************************************ 00:07:26.836 END TEST accel_deomp_full_mthread 00:07:26.836 ************************************ 00:07:26.836 01:50:00 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:26.836 01:50:00 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:26.836 01:50:00 -- accel/accel.sh@129 -- # build_accel_config 00:07:26.836 01:50:00 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:26.836 01:50:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:26.836 01:50:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:26.836 01:50:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.836 01:50:00 -- common/autotest_common.sh@10 -- # set +x 00:07:26.836 01:50:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.836 01:50:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:26.836 01:50:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:26.836 01:50:00 -- accel/accel.sh@41 -- # local IFS=, 00:07:26.836 01:50:00 -- accel/accel.sh@42 -- # jq -r . 00:07:26.836 ************************************ 00:07:26.836 START TEST accel_dif_functional_tests 00:07:26.836 ************************************ 00:07:26.836 01:50:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:26.836 [2024-11-18 01:50:00.890393] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:26.836 [2024-11-18 01:50:00.890469] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1097554 ] 00:07:26.836 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.836 [2024-11-18 01:50:00.952487] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:26.836 [2024-11-18 01:50:01.045834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:26.836 [2024-11-18 01:50:01.045902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:26.836 [2024-11-18 01:50:01.045905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.836 00:07:26.836 00:07:26.836 CUnit - A unit testing framework for C - Version 2.1-3 00:07:26.836 http://cunit.sourceforge.net/ 00:07:26.836 00:07:26.836 00:07:26.837 Suite: accel_dif 00:07:26.837 Test: verify: DIF generated, GUARD check ...passed 00:07:26.837 Test: verify: DIF generated, APPTAG check ...passed 00:07:26.837 Test: verify: DIF generated, REFTAG check ...passed 00:07:26.837 Test: verify: DIF not generated, GUARD check ...[2024-11-18 01:50:01.136095] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:26.837 [2024-11-18 01:50:01.136153] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:26.837 passed 00:07:26.837 Test: verify: DIF not generated, APPTAG check ...[2024-11-18 01:50:01.136189] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:26.837 [2024-11-18 01:50:01.136214] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:26.837 passed 00:07:26.837 Test: verify: DIF not generated, REFTAG check ...[2024-11-18 01:50:01.136242] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:26.837 [2024-11-18 01:50:01.136265] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:26.837 passed 00:07:26.837 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:26.837 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-18 01:50:01.136345] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:26.837 passed 00:07:26.837 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:26.837 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:26.837 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:26.837 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-18 01:50:01.136488] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:26.837 passed 00:07:26.837 Test: generate copy: DIF generated, GUARD check ...passed 00:07:26.837 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:26.837 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:26.837 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:26.837 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:26.837 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:26.837 Test: generate copy: iovecs-len validate ...[2024-11-18 01:50:01.136716] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:26.837 passed 00:07:26.837 Test: generate copy: buffer alignment validate ...passed 00:07:26.837 00:07:26.837 Run Summary: Type Total Ran Passed Failed Inactive 00:07:26.837 suites 1 1 n/a 0 0 00:07:26.837 tests 20 20 20 0 0 00:07:26.837 asserts 204 204 204 0 n/a 00:07:26.837 00:07:26.837 Elapsed time = 0.002 seconds 00:07:27.094 00:07:27.094 real 0m0.491s 00:07:27.094 user 0m0.751s 00:07:27.094 sys 0m0.178s 00:07:27.094 01:50:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.094 01:50:01 -- common/autotest_common.sh@10 -- # set +x 00:07:27.094 ************************************ 00:07:27.094 END TEST accel_dif_functional_tests 00:07:27.094 ************************************ 00:07:27.094 00:07:27.095 real 0m59.983s 00:07:27.095 user 1m7.653s 00:07:27.095 sys 0m7.336s 00:07:27.095 01:50:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.095 01:50:01 -- common/autotest_common.sh@10 -- # set +x 00:07:27.095 ************************************ 00:07:27.095 END TEST accel 00:07:27.095 ************************************ 00:07:27.095 01:50:01 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:27.095 01:50:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:27.095 01:50:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.095 01:50:01 -- common/autotest_common.sh@10 -- # set +x 00:07:27.095 ************************************ 00:07:27.095 START TEST accel_rpc 00:07:27.095 ************************************ 00:07:27.095 01:50:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:27.095 * Looking for test storage... 00:07:27.095 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:27.095 01:50:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:27.095 01:50:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:27.095 01:50:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:27.353 01:50:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:27.353 01:50:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:27.353 01:50:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:27.353 01:50:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:27.353 01:50:01 -- scripts/common.sh@335 -- # IFS=.-: 00:07:27.353 01:50:01 -- scripts/common.sh@335 -- # read -ra ver1 00:07:27.353 01:50:01 -- scripts/common.sh@336 -- # IFS=.-: 00:07:27.353 01:50:01 -- scripts/common.sh@336 -- # read -ra ver2 00:07:27.353 01:50:01 -- scripts/common.sh@337 -- # local 'op=<' 00:07:27.353 01:50:01 -- scripts/common.sh@339 -- # ver1_l=2 00:07:27.353 01:50:01 -- scripts/common.sh@340 -- # ver2_l=1 00:07:27.353 01:50:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:27.353 01:50:01 -- scripts/common.sh@343 -- # case "$op" in 00:07:27.353 01:50:01 -- scripts/common.sh@344 -- # : 1 00:07:27.353 01:50:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:27.353 01:50:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:27.353 01:50:01 -- scripts/common.sh@364 -- # decimal 1 00:07:27.353 01:50:01 -- scripts/common.sh@352 -- # local d=1 00:07:27.353 01:50:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:27.353 01:50:01 -- scripts/common.sh@354 -- # echo 1 00:07:27.353 01:50:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:27.353 01:50:01 -- scripts/common.sh@365 -- # decimal 2 00:07:27.353 01:50:01 -- scripts/common.sh@352 -- # local d=2 00:07:27.353 01:50:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:27.353 01:50:01 -- scripts/common.sh@354 -- # echo 2 00:07:27.353 01:50:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:27.353 01:50:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:27.353 01:50:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:27.353 01:50:01 -- scripts/common.sh@367 -- # return 0 00:07:27.353 01:50:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:27.353 01:50:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:27.353 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.353 --rc genhtml_branch_coverage=1 00:07:27.353 --rc genhtml_function_coverage=1 00:07:27.353 --rc genhtml_legend=1 00:07:27.353 --rc geninfo_all_blocks=1 00:07:27.353 --rc geninfo_unexecuted_blocks=1 00:07:27.353 00:07:27.353 ' 00:07:27.353 01:50:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:27.353 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.353 --rc genhtml_branch_coverage=1 00:07:27.353 --rc genhtml_function_coverage=1 00:07:27.353 --rc genhtml_legend=1 00:07:27.353 --rc geninfo_all_blocks=1 00:07:27.353 --rc geninfo_unexecuted_blocks=1 00:07:27.353 00:07:27.353 ' 00:07:27.353 01:50:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:27.353 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.353 --rc genhtml_branch_coverage=1 00:07:27.353 --rc genhtml_function_coverage=1 00:07:27.353 --rc genhtml_legend=1 00:07:27.353 --rc geninfo_all_blocks=1 00:07:27.353 --rc geninfo_unexecuted_blocks=1 00:07:27.353 00:07:27.353 ' 00:07:27.353 01:50:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:27.353 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.353 --rc genhtml_branch_coverage=1 00:07:27.353 --rc genhtml_function_coverage=1 00:07:27.353 --rc genhtml_legend=1 00:07:27.353 --rc geninfo_all_blocks=1 00:07:27.353 --rc geninfo_unexecuted_blocks=1 00:07:27.353 00:07:27.353 ' 00:07:27.353 01:50:01 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:27.353 01:50:01 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1097717 00:07:27.353 01:50:01 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:27.353 01:50:01 -- accel/accel_rpc.sh@15 -- # waitforlisten 1097717 00:07:27.353 01:50:01 -- common/autotest_common.sh@829 -- # '[' -z 1097717 ']' 00:07:27.353 01:50:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:27.353 01:50:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:27.353 01:50:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:27.353 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:27.353 01:50:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:27.353 01:50:01 -- common/autotest_common.sh@10 -- # set +x 00:07:27.353 [2024-11-18 01:50:01.558006] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:27.353 [2024-11-18 01:50:01.558105] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1097717 ] 00:07:27.353 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.353 [2024-11-18 01:50:01.615096] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.353 [2024-11-18 01:50:01.700357] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:27.354 [2024-11-18 01:50:01.700544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.611 01:50:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:27.611 01:50:01 -- common/autotest_common.sh@862 -- # return 0 00:07:27.611 01:50:01 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:27.611 01:50:01 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:27.611 01:50:01 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:27.611 01:50:01 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:27.611 01:50:01 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:27.611 01:50:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:27.611 01:50:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.611 01:50:01 -- common/autotest_common.sh@10 -- # set +x 00:07:27.611 ************************************ 00:07:27.611 START TEST accel_assign_opcode 00:07:27.611 ************************************ 00:07:27.611 01:50:01 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:27.611 01:50:01 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:27.611 01:50:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.611 01:50:01 -- common/autotest_common.sh@10 -- # set +x 00:07:27.611 [2024-11-18 01:50:01.773145] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:27.611 01:50:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.611 01:50:01 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:27.611 01:50:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.611 01:50:01 -- common/autotest_common.sh@10 -- # set +x 00:07:27.611 [2024-11-18 01:50:01.781159] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:27.611 01:50:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.611 01:50:01 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:27.611 01:50:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.611 01:50:01 -- common/autotest_common.sh@10 -- # set +x 00:07:27.867 01:50:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.867 01:50:02 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:27.868 01:50:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.868 01:50:02 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:27.868 01:50:02 -- common/autotest_common.sh@10 -- # set +x 00:07:27.868 01:50:02 -- accel/accel_rpc.sh@42 -- # grep software 00:07:27.868 01:50:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.868 software 00:07:27.868 00:07:27.868 real 0m0.299s 00:07:27.868 user 0m0.043s 00:07:27.868 sys 0m0.008s 00:07:27.868 01:50:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.868 01:50:02 -- common/autotest_common.sh@10 -- # set +x 00:07:27.868 ************************************ 00:07:27.868 END TEST accel_assign_opcode 00:07:27.868 ************************************ 00:07:27.868 01:50:02 -- accel/accel_rpc.sh@55 -- # killprocess 1097717 00:07:27.868 01:50:02 -- common/autotest_common.sh@936 -- # '[' -z 1097717 ']' 00:07:27.868 01:50:02 -- common/autotest_common.sh@940 -- # kill -0 1097717 00:07:27.868 01:50:02 -- common/autotest_common.sh@941 -- # uname 00:07:27.868 01:50:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:27.868 01:50:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1097717 00:07:27.868 01:50:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:27.868 01:50:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:27.868 01:50:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1097717' 00:07:27.868 killing process with pid 1097717 00:07:27.868 01:50:02 -- common/autotest_common.sh@955 -- # kill 1097717 00:07:27.868 01:50:02 -- common/autotest_common.sh@960 -- # wait 1097717 00:07:28.433 00:07:28.433 real 0m1.151s 00:07:28.433 user 0m1.078s 00:07:28.433 sys 0m0.427s 00:07:28.433 01:50:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:28.433 01:50:02 -- common/autotest_common.sh@10 -- # set +x 00:07:28.433 ************************************ 00:07:28.433 END TEST accel_rpc 00:07:28.433 ************************************ 00:07:28.433 01:50:02 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:28.433 01:50:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:28.433 01:50:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.433 01:50:02 -- common/autotest_common.sh@10 -- # set +x 00:07:28.433 ************************************ 00:07:28.433 START TEST app_cmdline 00:07:28.433 ************************************ 00:07:28.433 01:50:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:28.433 * Looking for test storage... 00:07:28.433 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:28.433 01:50:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:28.433 01:50:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:28.433 01:50:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:28.433 01:50:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:28.433 01:50:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:28.433 01:50:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:28.433 01:50:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:28.433 01:50:02 -- scripts/common.sh@335 -- # IFS=.-: 00:07:28.433 01:50:02 -- scripts/common.sh@335 -- # read -ra ver1 00:07:28.433 01:50:02 -- scripts/common.sh@336 -- # IFS=.-: 00:07:28.433 01:50:02 -- scripts/common.sh@336 -- # read -ra ver2 00:07:28.434 01:50:02 -- scripts/common.sh@337 -- # local 'op=<' 00:07:28.434 01:50:02 -- scripts/common.sh@339 -- # ver1_l=2 00:07:28.434 01:50:02 -- scripts/common.sh@340 -- # ver2_l=1 00:07:28.434 01:50:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:28.434 01:50:02 -- scripts/common.sh@343 -- # case "$op" in 00:07:28.434 01:50:02 -- scripts/common.sh@344 -- # : 1 00:07:28.434 01:50:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:28.434 01:50:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:28.434 01:50:02 -- scripts/common.sh@364 -- # decimal 1 00:07:28.434 01:50:02 -- scripts/common.sh@352 -- # local d=1 00:07:28.434 01:50:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:28.434 01:50:02 -- scripts/common.sh@354 -- # echo 1 00:07:28.434 01:50:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:28.434 01:50:02 -- scripts/common.sh@365 -- # decimal 2 00:07:28.434 01:50:02 -- scripts/common.sh@352 -- # local d=2 00:07:28.434 01:50:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:28.434 01:50:02 -- scripts/common.sh@354 -- # echo 2 00:07:28.434 01:50:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:28.434 01:50:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:28.434 01:50:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:28.434 01:50:02 -- scripts/common.sh@367 -- # return 0 00:07:28.434 01:50:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:28.434 01:50:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:28.434 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.434 --rc genhtml_branch_coverage=1 00:07:28.434 --rc genhtml_function_coverage=1 00:07:28.434 --rc genhtml_legend=1 00:07:28.434 --rc geninfo_all_blocks=1 00:07:28.434 --rc geninfo_unexecuted_blocks=1 00:07:28.434 00:07:28.434 ' 00:07:28.434 01:50:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:28.434 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.434 --rc genhtml_branch_coverage=1 00:07:28.434 --rc genhtml_function_coverage=1 00:07:28.434 --rc genhtml_legend=1 00:07:28.434 --rc geninfo_all_blocks=1 00:07:28.434 --rc geninfo_unexecuted_blocks=1 00:07:28.434 00:07:28.434 ' 00:07:28.434 01:50:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:28.434 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.434 --rc genhtml_branch_coverage=1 00:07:28.434 --rc genhtml_function_coverage=1 00:07:28.434 --rc genhtml_legend=1 00:07:28.434 --rc geninfo_all_blocks=1 00:07:28.434 --rc geninfo_unexecuted_blocks=1 00:07:28.434 00:07:28.434 ' 00:07:28.434 01:50:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:28.434 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.434 --rc genhtml_branch_coverage=1 00:07:28.434 --rc genhtml_function_coverage=1 00:07:28.434 --rc genhtml_legend=1 00:07:28.434 --rc geninfo_all_blocks=1 00:07:28.434 --rc geninfo_unexecuted_blocks=1 00:07:28.434 00:07:28.434 ' 00:07:28.434 01:50:02 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:28.434 01:50:02 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1097930 00:07:28.434 01:50:02 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:28.434 01:50:02 -- app/cmdline.sh@18 -- # waitforlisten 1097930 00:07:28.434 01:50:02 -- common/autotest_common.sh@829 -- # '[' -z 1097930 ']' 00:07:28.434 01:50:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:28.434 01:50:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:28.434 01:50:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:28.434 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:28.434 01:50:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:28.434 01:50:02 -- common/autotest_common.sh@10 -- # set +x 00:07:28.434 [2024-11-18 01:50:02.731054] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:28.434 [2024-11-18 01:50:02.731156] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1097930 ] 00:07:28.434 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.434 [2024-11-18 01:50:02.791055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.692 [2024-11-18 01:50:02.875456] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:28.692 [2024-11-18 01:50:02.875643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.625 01:50:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:29.625 01:50:03 -- common/autotest_common.sh@862 -- # return 0 00:07:29.625 01:50:03 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:29.625 { 00:07:29.625 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:29.625 "fields": { 00:07:29.625 "major": 24, 00:07:29.625 "minor": 1, 00:07:29.625 "patch": 1, 00:07:29.625 "suffix": "-pre", 00:07:29.625 "commit": "c13c99a5e" 00:07:29.625 } 00:07:29.625 } 00:07:29.625 01:50:03 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:29.625 01:50:03 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:29.625 01:50:03 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:29.625 01:50:03 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:29.625 01:50:03 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:29.625 01:50:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.625 01:50:03 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:29.625 01:50:03 -- common/autotest_common.sh@10 -- # set +x 00:07:29.625 01:50:03 -- app/cmdline.sh@26 -- # sort 00:07:29.625 01:50:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.625 01:50:03 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:29.625 01:50:03 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:29.625 01:50:03 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:29.625 01:50:03 -- common/autotest_common.sh@650 -- # local es=0 00:07:29.625 01:50:03 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:29.625 01:50:03 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:29.625 01:50:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:29.625 01:50:03 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:29.625 01:50:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:29.625 01:50:03 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:29.625 01:50:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:29.625 01:50:03 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:29.625 01:50:03 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:29.625 01:50:03 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:29.884 request: 00:07:29.884 { 00:07:29.884 "method": "env_dpdk_get_mem_stats", 00:07:29.884 "req_id": 1 00:07:29.884 } 00:07:29.884 Got JSON-RPC error response 00:07:29.884 response: 00:07:29.884 { 00:07:29.884 "code": -32601, 00:07:29.884 "message": "Method not found" 00:07:29.884 } 00:07:29.884 01:50:04 -- common/autotest_common.sh@653 -- # es=1 00:07:29.884 01:50:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:29.884 01:50:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:29.884 01:50:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:29.884 01:50:04 -- app/cmdline.sh@1 -- # killprocess 1097930 00:07:29.884 01:50:04 -- common/autotest_common.sh@936 -- # '[' -z 1097930 ']' 00:07:29.884 01:50:04 -- common/autotest_common.sh@940 -- # kill -0 1097930 00:07:29.884 01:50:04 -- common/autotest_common.sh@941 -- # uname 00:07:29.884 01:50:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:29.884 01:50:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1097930 00:07:29.884 01:50:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:29.884 01:50:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:29.884 01:50:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1097930' 00:07:29.884 killing process with pid 1097930 00:07:29.884 01:50:04 -- common/autotest_common.sh@955 -- # kill 1097930 00:07:29.884 01:50:04 -- common/autotest_common.sh@960 -- # wait 1097930 00:07:30.449 00:07:30.449 real 0m2.098s 00:07:30.449 user 0m2.624s 00:07:30.449 sys 0m0.505s 00:07:30.449 01:50:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.449 01:50:04 -- common/autotest_common.sh@10 -- # set +x 00:07:30.449 ************************************ 00:07:30.449 END TEST app_cmdline 00:07:30.449 ************************************ 00:07:30.449 01:50:04 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:30.449 01:50:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:30.449 01:50:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.449 01:50:04 -- common/autotest_common.sh@10 -- # set +x 00:07:30.449 ************************************ 00:07:30.449 START TEST version 00:07:30.449 ************************************ 00:07:30.449 01:50:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:30.449 * Looking for test storage... 00:07:30.449 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:30.449 01:50:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:30.449 01:50:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:30.449 01:50:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:30.449 01:50:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:30.449 01:50:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:30.449 01:50:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:30.449 01:50:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:30.449 01:50:04 -- scripts/common.sh@335 -- # IFS=.-: 00:07:30.449 01:50:04 -- scripts/common.sh@335 -- # read -ra ver1 00:07:30.449 01:50:04 -- scripts/common.sh@336 -- # IFS=.-: 00:07:30.449 01:50:04 -- scripts/common.sh@336 -- # read -ra ver2 00:07:30.449 01:50:04 -- scripts/common.sh@337 -- # local 'op=<' 00:07:30.449 01:50:04 -- scripts/common.sh@339 -- # ver1_l=2 00:07:30.449 01:50:04 -- scripts/common.sh@340 -- # ver2_l=1 00:07:30.449 01:50:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:30.449 01:50:04 -- scripts/common.sh@343 -- # case "$op" in 00:07:30.449 01:50:04 -- scripts/common.sh@344 -- # : 1 00:07:30.449 01:50:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:30.449 01:50:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:30.449 01:50:04 -- scripts/common.sh@364 -- # decimal 1 00:07:30.449 01:50:04 -- scripts/common.sh@352 -- # local d=1 00:07:30.449 01:50:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:30.449 01:50:04 -- scripts/common.sh@354 -- # echo 1 00:07:30.449 01:50:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:30.449 01:50:04 -- scripts/common.sh@365 -- # decimal 2 00:07:30.449 01:50:04 -- scripts/common.sh@352 -- # local d=2 00:07:30.449 01:50:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:30.449 01:50:04 -- scripts/common.sh@354 -- # echo 2 00:07:30.449 01:50:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:30.449 01:50:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:30.449 01:50:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:30.449 01:50:04 -- scripts/common.sh@367 -- # return 0 00:07:30.449 01:50:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:30.449 01:50:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:30.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.449 --rc genhtml_branch_coverage=1 00:07:30.449 --rc genhtml_function_coverage=1 00:07:30.449 --rc genhtml_legend=1 00:07:30.449 --rc geninfo_all_blocks=1 00:07:30.449 --rc geninfo_unexecuted_blocks=1 00:07:30.449 00:07:30.449 ' 00:07:30.449 01:50:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:30.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.449 --rc genhtml_branch_coverage=1 00:07:30.449 --rc genhtml_function_coverage=1 00:07:30.449 --rc genhtml_legend=1 00:07:30.449 --rc geninfo_all_blocks=1 00:07:30.449 --rc geninfo_unexecuted_blocks=1 00:07:30.449 00:07:30.449 ' 00:07:30.449 01:50:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:30.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.449 --rc genhtml_branch_coverage=1 00:07:30.449 --rc genhtml_function_coverage=1 00:07:30.449 --rc genhtml_legend=1 00:07:30.449 --rc geninfo_all_blocks=1 00:07:30.449 --rc geninfo_unexecuted_blocks=1 00:07:30.449 00:07:30.449 ' 00:07:30.449 01:50:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:30.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.449 --rc genhtml_branch_coverage=1 00:07:30.449 --rc genhtml_function_coverage=1 00:07:30.449 --rc genhtml_legend=1 00:07:30.449 --rc geninfo_all_blocks=1 00:07:30.449 --rc geninfo_unexecuted_blocks=1 00:07:30.449 00:07:30.449 ' 00:07:30.449 01:50:04 -- app/version.sh@17 -- # get_header_version major 00:07:30.449 01:50:04 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:30.449 01:50:04 -- app/version.sh@14 -- # cut -f2 00:07:30.449 01:50:04 -- app/version.sh@14 -- # tr -d '"' 00:07:30.449 01:50:04 -- app/version.sh@17 -- # major=24 00:07:30.449 01:50:04 -- app/version.sh@18 -- # get_header_version minor 00:07:30.449 01:50:04 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:30.449 01:50:04 -- app/version.sh@14 -- # cut -f2 00:07:30.449 01:50:04 -- app/version.sh@14 -- # tr -d '"' 00:07:30.449 01:50:04 -- app/version.sh@18 -- # minor=1 00:07:30.449 01:50:04 -- app/version.sh@19 -- # get_header_version patch 00:07:30.449 01:50:04 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:30.449 01:50:04 -- app/version.sh@14 -- # cut -f2 00:07:30.449 01:50:04 -- app/version.sh@14 -- # tr -d '"' 00:07:30.449 01:50:04 -- app/version.sh@19 -- # patch=1 00:07:30.449 01:50:04 -- app/version.sh@20 -- # get_header_version suffix 00:07:30.449 01:50:04 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:30.449 01:50:04 -- app/version.sh@14 -- # cut -f2 00:07:30.449 01:50:04 -- app/version.sh@14 -- # tr -d '"' 00:07:30.449 01:50:04 -- app/version.sh@20 -- # suffix=-pre 00:07:30.449 01:50:04 -- app/version.sh@22 -- # version=24.1 00:07:30.449 01:50:04 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:30.449 01:50:04 -- app/version.sh@25 -- # version=24.1.1 00:07:30.449 01:50:04 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:30.449 01:50:04 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:30.449 01:50:04 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:30.708 01:50:04 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:30.708 01:50:04 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:30.708 00:07:30.708 real 0m0.192s 00:07:30.708 user 0m0.123s 00:07:30.708 sys 0m0.093s 00:07:30.708 01:50:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.708 01:50:04 -- common/autotest_common.sh@10 -- # set +x 00:07:30.708 ************************************ 00:07:30.708 END TEST version 00:07:30.708 ************************************ 00:07:30.708 01:50:04 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:07:30.708 01:50:04 -- spdk/autotest.sh@191 -- # uname -s 00:07:30.708 01:50:04 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:07:30.708 01:50:04 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:30.708 01:50:04 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:30.708 01:50:04 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:07:30.708 01:50:04 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:07:30.708 01:50:04 -- spdk/autotest.sh@255 -- # timing_exit lib 00:07:30.708 01:50:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:30.708 01:50:04 -- common/autotest_common.sh@10 -- # set +x 00:07:30.708 01:50:04 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:07:30.708 01:50:04 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:07:30.708 01:50:04 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:07:30.708 01:50:04 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:07:30.708 01:50:04 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:07:30.708 01:50:04 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:07:30.708 01:50:04 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:30.708 01:50:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:30.708 01:50:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.708 01:50:04 -- common/autotest_common.sh@10 -- # set +x 00:07:30.708 ************************************ 00:07:30.708 START TEST nvmf_tcp 00:07:30.708 ************************************ 00:07:30.708 01:50:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:30.708 * Looking for test storage... 00:07:30.708 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:30.708 01:50:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:30.708 01:50:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:30.708 01:50:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:30.708 01:50:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:30.708 01:50:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:30.708 01:50:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:30.708 01:50:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:30.708 01:50:05 -- scripts/common.sh@335 -- # IFS=.-: 00:07:30.708 01:50:05 -- scripts/common.sh@335 -- # read -ra ver1 00:07:30.708 01:50:05 -- scripts/common.sh@336 -- # IFS=.-: 00:07:30.708 01:50:05 -- scripts/common.sh@336 -- # read -ra ver2 00:07:30.708 01:50:05 -- scripts/common.sh@337 -- # local 'op=<' 00:07:30.708 01:50:05 -- scripts/common.sh@339 -- # ver1_l=2 00:07:30.708 01:50:05 -- scripts/common.sh@340 -- # ver2_l=1 00:07:30.708 01:50:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:30.708 01:50:05 -- scripts/common.sh@343 -- # case "$op" in 00:07:30.708 01:50:05 -- scripts/common.sh@344 -- # : 1 00:07:30.708 01:50:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:30.708 01:50:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:30.708 01:50:05 -- scripts/common.sh@364 -- # decimal 1 00:07:30.708 01:50:05 -- scripts/common.sh@352 -- # local d=1 00:07:30.708 01:50:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:30.708 01:50:05 -- scripts/common.sh@354 -- # echo 1 00:07:30.708 01:50:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:30.708 01:50:05 -- scripts/common.sh@365 -- # decimal 2 00:07:30.708 01:50:05 -- scripts/common.sh@352 -- # local d=2 00:07:30.708 01:50:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:30.708 01:50:05 -- scripts/common.sh@354 -- # echo 2 00:07:30.708 01:50:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:30.708 01:50:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:30.708 01:50:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:30.708 01:50:05 -- scripts/common.sh@367 -- # return 0 00:07:30.708 01:50:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:30.708 01:50:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:30.708 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.708 --rc genhtml_branch_coverage=1 00:07:30.708 --rc genhtml_function_coverage=1 00:07:30.708 --rc genhtml_legend=1 00:07:30.708 --rc geninfo_all_blocks=1 00:07:30.708 --rc geninfo_unexecuted_blocks=1 00:07:30.708 00:07:30.708 ' 00:07:30.709 01:50:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:30.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.709 --rc genhtml_branch_coverage=1 00:07:30.709 --rc genhtml_function_coverage=1 00:07:30.709 --rc genhtml_legend=1 00:07:30.709 --rc geninfo_all_blocks=1 00:07:30.709 --rc geninfo_unexecuted_blocks=1 00:07:30.709 00:07:30.709 ' 00:07:30.709 01:50:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:30.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.709 --rc genhtml_branch_coverage=1 00:07:30.709 --rc genhtml_function_coverage=1 00:07:30.709 --rc genhtml_legend=1 00:07:30.709 --rc geninfo_all_blocks=1 00:07:30.709 --rc geninfo_unexecuted_blocks=1 00:07:30.709 00:07:30.709 ' 00:07:30.709 01:50:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:30.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.709 --rc genhtml_branch_coverage=1 00:07:30.709 --rc genhtml_function_coverage=1 00:07:30.709 --rc genhtml_legend=1 00:07:30.709 --rc geninfo_all_blocks=1 00:07:30.709 --rc geninfo_unexecuted_blocks=1 00:07:30.709 00:07:30.709 ' 00:07:30.709 01:50:05 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:30.709 01:50:05 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:30.709 01:50:05 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:30.709 01:50:05 -- nvmf/common.sh@7 -- # uname -s 00:07:30.709 01:50:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:30.709 01:50:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:30.709 01:50:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:30.709 01:50:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:30.709 01:50:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:30.709 01:50:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:30.709 01:50:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:30.709 01:50:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:30.709 01:50:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:30.709 01:50:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:30.709 01:50:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:30.709 01:50:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:30.709 01:50:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:30.709 01:50:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:30.709 01:50:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:30.709 01:50:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:30.709 01:50:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:30.709 01:50:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:30.709 01:50:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:30.709 01:50:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.709 01:50:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.709 01:50:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.709 01:50:05 -- paths/export.sh@5 -- # export PATH 00:07:30.709 01:50:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.709 01:50:05 -- nvmf/common.sh@46 -- # : 0 00:07:30.709 01:50:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:30.709 01:50:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:30.709 01:50:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:30.709 01:50:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:30.709 01:50:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:30.709 01:50:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:30.709 01:50:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:30.709 01:50:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:30.709 01:50:05 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:30.709 01:50:05 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:30.709 01:50:05 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:30.709 01:50:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:30.709 01:50:05 -- common/autotest_common.sh@10 -- # set +x 00:07:30.709 01:50:05 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:30.709 01:50:05 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:30.709 01:50:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:30.709 01:50:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.709 01:50:05 -- common/autotest_common.sh@10 -- # set +x 00:07:30.709 ************************************ 00:07:30.709 START TEST nvmf_example 00:07:30.709 ************************************ 00:07:30.709 01:50:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:30.709 * Looking for test storage... 00:07:30.969 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:30.969 01:50:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:30.969 01:50:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:30.969 01:50:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:30.969 01:50:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:30.969 01:50:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:30.969 01:50:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:30.969 01:50:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:30.969 01:50:05 -- scripts/common.sh@335 -- # IFS=.-: 00:07:30.969 01:50:05 -- scripts/common.sh@335 -- # read -ra ver1 00:07:30.969 01:50:05 -- scripts/common.sh@336 -- # IFS=.-: 00:07:30.969 01:50:05 -- scripts/common.sh@336 -- # read -ra ver2 00:07:30.969 01:50:05 -- scripts/common.sh@337 -- # local 'op=<' 00:07:30.969 01:50:05 -- scripts/common.sh@339 -- # ver1_l=2 00:07:30.969 01:50:05 -- scripts/common.sh@340 -- # ver2_l=1 00:07:30.969 01:50:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:30.969 01:50:05 -- scripts/common.sh@343 -- # case "$op" in 00:07:30.969 01:50:05 -- scripts/common.sh@344 -- # : 1 00:07:30.969 01:50:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:30.969 01:50:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:30.969 01:50:05 -- scripts/common.sh@364 -- # decimal 1 00:07:30.969 01:50:05 -- scripts/common.sh@352 -- # local d=1 00:07:30.969 01:50:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:30.969 01:50:05 -- scripts/common.sh@354 -- # echo 1 00:07:30.969 01:50:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:30.969 01:50:05 -- scripts/common.sh@365 -- # decimal 2 00:07:30.969 01:50:05 -- scripts/common.sh@352 -- # local d=2 00:07:30.969 01:50:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:30.969 01:50:05 -- scripts/common.sh@354 -- # echo 2 00:07:30.969 01:50:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:30.969 01:50:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:30.969 01:50:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:30.969 01:50:05 -- scripts/common.sh@367 -- # return 0 00:07:30.969 01:50:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:30.969 01:50:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:30.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.969 --rc genhtml_branch_coverage=1 00:07:30.969 --rc genhtml_function_coverage=1 00:07:30.969 --rc genhtml_legend=1 00:07:30.969 --rc geninfo_all_blocks=1 00:07:30.969 --rc geninfo_unexecuted_blocks=1 00:07:30.969 00:07:30.969 ' 00:07:30.969 01:50:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:30.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.969 --rc genhtml_branch_coverage=1 00:07:30.969 --rc genhtml_function_coverage=1 00:07:30.969 --rc genhtml_legend=1 00:07:30.969 --rc geninfo_all_blocks=1 00:07:30.969 --rc geninfo_unexecuted_blocks=1 00:07:30.969 00:07:30.969 ' 00:07:30.969 01:50:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:30.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.969 --rc genhtml_branch_coverage=1 00:07:30.969 --rc genhtml_function_coverage=1 00:07:30.969 --rc genhtml_legend=1 00:07:30.969 --rc geninfo_all_blocks=1 00:07:30.969 --rc geninfo_unexecuted_blocks=1 00:07:30.969 00:07:30.969 ' 00:07:30.969 01:50:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:30.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.969 --rc genhtml_branch_coverage=1 00:07:30.969 --rc genhtml_function_coverage=1 00:07:30.969 --rc genhtml_legend=1 00:07:30.969 --rc geninfo_all_blocks=1 00:07:30.969 --rc geninfo_unexecuted_blocks=1 00:07:30.969 00:07:30.969 ' 00:07:30.969 01:50:05 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:30.969 01:50:05 -- nvmf/common.sh@7 -- # uname -s 00:07:30.969 01:50:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:30.969 01:50:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:30.969 01:50:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:30.969 01:50:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:30.969 01:50:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:30.969 01:50:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:30.969 01:50:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:30.969 01:50:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:30.969 01:50:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:30.969 01:50:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:30.969 01:50:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:30.969 01:50:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:30.969 01:50:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:30.969 01:50:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:30.969 01:50:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:30.969 01:50:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:30.969 01:50:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:30.969 01:50:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:30.969 01:50:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:30.969 01:50:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.969 01:50:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.969 01:50:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.969 01:50:05 -- paths/export.sh@5 -- # export PATH 00:07:30.969 01:50:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.969 01:50:05 -- nvmf/common.sh@46 -- # : 0 00:07:30.969 01:50:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:30.969 01:50:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:30.969 01:50:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:30.969 01:50:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:30.969 01:50:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:30.969 01:50:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:30.969 01:50:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:30.969 01:50:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:30.969 01:50:05 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:30.969 01:50:05 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:30.969 01:50:05 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:30.969 01:50:05 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:30.969 01:50:05 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:30.969 01:50:05 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:30.969 01:50:05 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:30.969 01:50:05 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:30.969 01:50:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:30.969 01:50:05 -- common/autotest_common.sh@10 -- # set +x 00:07:30.970 01:50:05 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:30.970 01:50:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:30.970 01:50:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:30.970 01:50:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:30.970 01:50:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:30.970 01:50:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:30.970 01:50:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:30.970 01:50:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:30.970 01:50:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:30.970 01:50:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:30.970 01:50:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:30.970 01:50:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:30.970 01:50:05 -- common/autotest_common.sh@10 -- # set +x 00:07:33.506 01:50:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:33.506 01:50:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:33.506 01:50:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:33.506 01:50:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:33.506 01:50:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:33.506 01:50:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:33.506 01:50:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:33.506 01:50:07 -- nvmf/common.sh@294 -- # net_devs=() 00:07:33.506 01:50:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:33.506 01:50:07 -- nvmf/common.sh@295 -- # e810=() 00:07:33.506 01:50:07 -- nvmf/common.sh@295 -- # local -ga e810 00:07:33.506 01:50:07 -- nvmf/common.sh@296 -- # x722=() 00:07:33.506 01:50:07 -- nvmf/common.sh@296 -- # local -ga x722 00:07:33.506 01:50:07 -- nvmf/common.sh@297 -- # mlx=() 00:07:33.506 01:50:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:33.506 01:50:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:33.506 01:50:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:33.506 01:50:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:33.506 01:50:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:33.506 01:50:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:33.506 01:50:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:33.506 01:50:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:33.506 01:50:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:33.506 01:50:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:33.506 01:50:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:33.506 01:50:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:33.506 01:50:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:33.506 01:50:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:33.506 01:50:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:33.506 01:50:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:33.506 01:50:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:33.506 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:33.506 01:50:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:33.506 01:50:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:33.506 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:33.506 01:50:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:33.506 01:50:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:33.506 01:50:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:33.507 01:50:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:33.507 01:50:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:33.507 01:50:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:33.507 01:50:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:33.507 01:50:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:33.507 01:50:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:33.507 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:33.507 01:50:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:33.507 01:50:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:33.507 01:50:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:33.507 01:50:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:33.507 01:50:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:33.507 01:50:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:33.507 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:33.507 01:50:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:33.507 01:50:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:33.507 01:50:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:33.507 01:50:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:33.507 01:50:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:33.507 01:50:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:33.507 01:50:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:33.507 01:50:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:33.507 01:50:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:33.507 01:50:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:33.507 01:50:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:33.507 01:50:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:33.507 01:50:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:33.507 01:50:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:33.507 01:50:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:33.507 01:50:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:33.507 01:50:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:33.507 01:50:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:33.507 01:50:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:33.507 01:50:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:33.507 01:50:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:33.507 01:50:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:33.507 01:50:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:33.507 01:50:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:33.507 01:50:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:33.507 01:50:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:33.507 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:33.507 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:07:33.507 00:07:33.507 --- 10.0.0.2 ping statistics --- 00:07:33.507 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:33.507 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:07:33.507 01:50:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:33.507 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:33.507 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:07:33.507 00:07:33.507 --- 10.0.0.1 ping statistics --- 00:07:33.507 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:33.507 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:07:33.507 01:50:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:33.507 01:50:07 -- nvmf/common.sh@410 -- # return 0 00:07:33.507 01:50:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:33.507 01:50:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:33.507 01:50:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:33.507 01:50:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:33.507 01:50:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:33.507 01:50:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:33.507 01:50:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:33.507 01:50:07 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:33.507 01:50:07 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:33.507 01:50:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:33.507 01:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:33.507 01:50:07 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:33.507 01:50:07 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:33.507 01:50:07 -- target/nvmf_example.sh@34 -- # nvmfpid=1099993 00:07:33.507 01:50:07 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:33.507 01:50:07 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:33.507 01:50:07 -- target/nvmf_example.sh@36 -- # waitforlisten 1099993 00:07:33.507 01:50:07 -- common/autotest_common.sh@829 -- # '[' -z 1099993 ']' 00:07:33.507 01:50:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:33.507 01:50:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:33.507 01:50:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:33.507 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:33.507 01:50:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:33.507 01:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:33.507 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.507 01:50:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:33.507 01:50:07 -- common/autotest_common.sh@862 -- # return 0 00:07:33.507 01:50:07 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:33.507 01:50:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:33.507 01:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:33.507 01:50:07 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:33.507 01:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.507 01:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:33.507 01:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.507 01:50:07 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:33.507 01:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.507 01:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:33.507 01:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.507 01:50:07 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:33.507 01:50:07 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:33.507 01:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.507 01:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:33.507 01:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.507 01:50:07 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:33.507 01:50:07 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:33.507 01:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.507 01:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:33.507 01:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.507 01:50:07 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:33.507 01:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.507 01:50:07 -- common/autotest_common.sh@10 -- # set +x 00:07:33.507 01:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.507 01:50:07 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:33.507 01:50:07 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:33.507 EAL: No free 2048 kB hugepages reported on node 1 00:07:45.779 Initializing NVMe Controllers 00:07:45.779 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:07:45.779 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:07:45.779 Initialization complete. Launching workers. 00:07:45.779 ======================================================== 00:07:45.779 Latency(us) 00:07:45.779 Device Information : IOPS MiB/s Average min max 00:07:45.779 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15531.37 60.67 4121.29 876.36 17085.26 00:07:45.779 ======================================================== 00:07:45.779 Total : 15531.37 60.67 4121.29 876.36 17085.26 00:07:45.779 00:07:45.779 01:50:17 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:07:45.779 01:50:17 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:07:45.779 01:50:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:45.779 01:50:17 -- nvmf/common.sh@116 -- # sync 00:07:45.779 01:50:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:45.779 01:50:17 -- nvmf/common.sh@119 -- # set +e 00:07:45.779 01:50:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:45.779 01:50:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:45.779 rmmod nvme_tcp 00:07:45.779 rmmod nvme_fabrics 00:07:45.779 rmmod nvme_keyring 00:07:45.779 01:50:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:45.779 01:50:18 -- nvmf/common.sh@123 -- # set -e 00:07:45.779 01:50:18 -- nvmf/common.sh@124 -- # return 0 00:07:45.779 01:50:18 -- nvmf/common.sh@477 -- # '[' -n 1099993 ']' 00:07:45.779 01:50:18 -- nvmf/common.sh@478 -- # killprocess 1099993 00:07:45.779 01:50:18 -- common/autotest_common.sh@936 -- # '[' -z 1099993 ']' 00:07:45.779 01:50:18 -- common/autotest_common.sh@940 -- # kill -0 1099993 00:07:45.779 01:50:18 -- common/autotest_common.sh@941 -- # uname 00:07:45.779 01:50:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:45.779 01:50:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1099993 00:07:45.779 01:50:18 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:07:45.779 01:50:18 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:07:45.779 01:50:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1099993' 00:07:45.779 killing process with pid 1099993 00:07:45.779 01:50:18 -- common/autotest_common.sh@955 -- # kill 1099993 00:07:45.779 01:50:18 -- common/autotest_common.sh@960 -- # wait 1099993 00:07:45.779 nvmf threads initialize successfully 00:07:45.779 bdev subsystem init successfully 00:07:45.779 created a nvmf target service 00:07:45.779 create targets's poll groups done 00:07:45.779 all subsystems of target started 00:07:45.779 nvmf target is running 00:07:45.779 all subsystems of target stopped 00:07:45.779 destroy targets's poll groups done 00:07:45.779 destroyed the nvmf target service 00:07:45.779 bdev subsystem finish successfully 00:07:45.779 nvmf threads destroy successfully 00:07:45.779 01:50:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:45.779 01:50:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:45.779 01:50:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:45.779 01:50:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:45.779 01:50:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:45.779 01:50:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:45.779 01:50:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:45.779 01:50:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:46.039 01:50:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:46.039 01:50:20 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:07:46.039 01:50:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:46.039 01:50:20 -- common/autotest_common.sh@10 -- # set +x 00:07:46.039 00:07:46.039 real 0m15.305s 00:07:46.039 user 0m42.134s 00:07:46.039 sys 0m3.231s 00:07:46.039 01:50:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:46.039 01:50:20 -- common/autotest_common.sh@10 -- # set +x 00:07:46.039 ************************************ 00:07:46.039 END TEST nvmf_example 00:07:46.039 ************************************ 00:07:46.039 01:50:20 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:46.039 01:50:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:46.039 01:50:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:46.039 01:50:20 -- common/autotest_common.sh@10 -- # set +x 00:07:46.039 ************************************ 00:07:46.039 START TEST nvmf_filesystem 00:07:46.039 ************************************ 00:07:46.039 01:50:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:46.301 * Looking for test storage... 00:07:46.301 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:46.301 01:50:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:46.301 01:50:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:46.301 01:50:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:46.301 01:50:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:46.301 01:50:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:46.301 01:50:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:46.301 01:50:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:46.301 01:50:20 -- scripts/common.sh@335 -- # IFS=.-: 00:07:46.301 01:50:20 -- scripts/common.sh@335 -- # read -ra ver1 00:07:46.301 01:50:20 -- scripts/common.sh@336 -- # IFS=.-: 00:07:46.301 01:50:20 -- scripts/common.sh@336 -- # read -ra ver2 00:07:46.301 01:50:20 -- scripts/common.sh@337 -- # local 'op=<' 00:07:46.301 01:50:20 -- scripts/common.sh@339 -- # ver1_l=2 00:07:46.301 01:50:20 -- scripts/common.sh@340 -- # ver2_l=1 00:07:46.301 01:50:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:46.301 01:50:20 -- scripts/common.sh@343 -- # case "$op" in 00:07:46.301 01:50:20 -- scripts/common.sh@344 -- # : 1 00:07:46.301 01:50:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:46.301 01:50:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:46.301 01:50:20 -- scripts/common.sh@364 -- # decimal 1 00:07:46.301 01:50:20 -- scripts/common.sh@352 -- # local d=1 00:07:46.301 01:50:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:46.301 01:50:20 -- scripts/common.sh@354 -- # echo 1 00:07:46.301 01:50:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:46.301 01:50:20 -- scripts/common.sh@365 -- # decimal 2 00:07:46.301 01:50:20 -- scripts/common.sh@352 -- # local d=2 00:07:46.301 01:50:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:46.301 01:50:20 -- scripts/common.sh@354 -- # echo 2 00:07:46.301 01:50:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:46.301 01:50:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:46.301 01:50:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:46.301 01:50:20 -- scripts/common.sh@367 -- # return 0 00:07:46.301 01:50:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:46.301 01:50:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:46.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.301 --rc genhtml_branch_coverage=1 00:07:46.301 --rc genhtml_function_coverage=1 00:07:46.301 --rc genhtml_legend=1 00:07:46.301 --rc geninfo_all_blocks=1 00:07:46.301 --rc geninfo_unexecuted_blocks=1 00:07:46.301 00:07:46.301 ' 00:07:46.301 01:50:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:46.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.301 --rc genhtml_branch_coverage=1 00:07:46.301 --rc genhtml_function_coverage=1 00:07:46.301 --rc genhtml_legend=1 00:07:46.301 --rc geninfo_all_blocks=1 00:07:46.301 --rc geninfo_unexecuted_blocks=1 00:07:46.301 00:07:46.301 ' 00:07:46.301 01:50:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:46.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.301 --rc genhtml_branch_coverage=1 00:07:46.301 --rc genhtml_function_coverage=1 00:07:46.301 --rc genhtml_legend=1 00:07:46.301 --rc geninfo_all_blocks=1 00:07:46.301 --rc geninfo_unexecuted_blocks=1 00:07:46.301 00:07:46.301 ' 00:07:46.301 01:50:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:46.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.301 --rc genhtml_branch_coverage=1 00:07:46.301 --rc genhtml_function_coverage=1 00:07:46.301 --rc genhtml_legend=1 00:07:46.301 --rc geninfo_all_blocks=1 00:07:46.301 --rc geninfo_unexecuted_blocks=1 00:07:46.301 00:07:46.301 ' 00:07:46.301 01:50:20 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:07:46.301 01:50:20 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:07:46.301 01:50:20 -- common/autotest_common.sh@34 -- # set -e 00:07:46.301 01:50:20 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:07:46.301 01:50:20 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:07:46.301 01:50:20 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:07:46.301 01:50:20 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:07:46.301 01:50:20 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:07:46.301 01:50:20 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:07:46.301 01:50:20 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:07:46.301 01:50:20 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:07:46.301 01:50:20 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:07:46.301 01:50:20 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:07:46.301 01:50:20 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:07:46.301 01:50:20 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:07:46.301 01:50:20 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:07:46.301 01:50:20 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:07:46.301 01:50:20 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:07:46.301 01:50:20 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:07:46.301 01:50:20 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:07:46.301 01:50:20 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:07:46.301 01:50:20 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:07:46.301 01:50:20 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:07:46.301 01:50:20 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:07:46.301 01:50:20 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:07:46.301 01:50:20 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:46.301 01:50:20 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:07:46.301 01:50:20 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:07:46.301 01:50:20 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:07:46.301 01:50:20 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:07:46.302 01:50:20 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:07:46.302 01:50:20 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:07:46.302 01:50:20 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:07:46.302 01:50:20 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:07:46.302 01:50:20 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:07:46.302 01:50:20 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:07:46.302 01:50:20 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:07:46.302 01:50:20 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:07:46.302 01:50:20 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:07:46.302 01:50:20 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:07:46.302 01:50:20 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:07:46.302 01:50:20 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:07:46.302 01:50:20 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:46.302 01:50:20 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:07:46.302 01:50:20 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:07:46.302 01:50:20 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:07:46.302 01:50:20 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:07:46.302 01:50:20 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:46.302 01:50:20 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:07:46.302 01:50:20 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:07:46.302 01:50:20 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:07:46.302 01:50:20 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:07:46.302 01:50:20 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:07:46.302 01:50:20 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:07:46.302 01:50:20 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:07:46.302 01:50:20 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:07:46.302 01:50:20 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:07:46.302 01:50:20 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:07:46.302 01:50:20 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:07:46.302 01:50:20 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:07:46.302 01:50:20 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:07:46.302 01:50:20 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:07:46.302 01:50:20 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:07:46.302 01:50:20 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:07:46.302 01:50:20 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:07:46.302 01:50:20 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:07:46.302 01:50:20 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:07:46.302 01:50:20 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:46.302 01:50:20 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:07:46.302 01:50:20 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:07:46.302 01:50:20 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:07:46.302 01:50:20 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:07:46.302 01:50:20 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:07:46.302 01:50:20 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:07:46.302 01:50:20 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:07:46.302 01:50:20 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:07:46.302 01:50:20 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:07:46.302 01:50:20 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:07:46.302 01:50:20 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:07:46.302 01:50:20 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:07:46.302 01:50:20 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:07:46.302 01:50:20 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:07:46.302 01:50:20 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:07:46.302 01:50:20 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:07:46.302 01:50:20 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:07:46.302 01:50:20 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:07:46.302 01:50:20 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:46.302 01:50:20 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:46.302 01:50:20 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:46.302 01:50:20 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:46.302 01:50:20 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:46.302 01:50:20 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:46.302 01:50:20 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:46.302 01:50:20 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:46.302 01:50:20 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:07:46.302 01:50:20 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:07:46.302 01:50:20 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:07:46.302 01:50:20 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:07:46.302 01:50:20 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:07:46.302 01:50:20 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:07:46.302 01:50:20 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:07:46.302 01:50:20 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:07:46.302 #define SPDK_CONFIG_H 00:07:46.302 #define SPDK_CONFIG_APPS 1 00:07:46.302 #define SPDK_CONFIG_ARCH native 00:07:46.302 #undef SPDK_CONFIG_ASAN 00:07:46.302 #undef SPDK_CONFIG_AVAHI 00:07:46.302 #undef SPDK_CONFIG_CET 00:07:46.302 #define SPDK_CONFIG_COVERAGE 1 00:07:46.302 #define SPDK_CONFIG_CROSS_PREFIX 00:07:46.302 #undef SPDK_CONFIG_CRYPTO 00:07:46.302 #undef SPDK_CONFIG_CRYPTO_MLX5 00:07:46.302 #undef SPDK_CONFIG_CUSTOMOCF 00:07:46.302 #undef SPDK_CONFIG_DAOS 00:07:46.302 #define SPDK_CONFIG_DAOS_DIR 00:07:46.302 #define SPDK_CONFIG_DEBUG 1 00:07:46.302 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:07:46.302 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:46.302 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:46.302 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:46.302 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:07:46.302 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:46.302 #define SPDK_CONFIG_EXAMPLES 1 00:07:46.302 #undef SPDK_CONFIG_FC 00:07:46.302 #define SPDK_CONFIG_FC_PATH 00:07:46.302 #define SPDK_CONFIG_FIO_PLUGIN 1 00:07:46.302 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:07:46.302 #undef SPDK_CONFIG_FUSE 00:07:46.302 #undef SPDK_CONFIG_FUZZER 00:07:46.302 #define SPDK_CONFIG_FUZZER_LIB 00:07:46.302 #undef SPDK_CONFIG_GOLANG 00:07:46.302 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:07:46.302 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:07:46.302 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:07:46.302 #undef SPDK_CONFIG_HAVE_LIBBSD 00:07:46.302 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:07:46.302 #define SPDK_CONFIG_IDXD 1 00:07:46.302 #define SPDK_CONFIG_IDXD_KERNEL 1 00:07:46.302 #undef SPDK_CONFIG_IPSEC_MB 00:07:46.302 #define SPDK_CONFIG_IPSEC_MB_DIR 00:07:46.302 #define SPDK_CONFIG_ISAL 1 00:07:46.302 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:07:46.302 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:07:46.302 #define SPDK_CONFIG_LIBDIR 00:07:46.302 #undef SPDK_CONFIG_LTO 00:07:46.302 #define SPDK_CONFIG_MAX_LCORES 00:07:46.302 #define SPDK_CONFIG_NVME_CUSE 1 00:07:46.302 #undef SPDK_CONFIG_OCF 00:07:46.302 #define SPDK_CONFIG_OCF_PATH 00:07:46.302 #define SPDK_CONFIG_OPENSSL_PATH 00:07:46.302 #undef SPDK_CONFIG_PGO_CAPTURE 00:07:46.302 #undef SPDK_CONFIG_PGO_USE 00:07:46.302 #define SPDK_CONFIG_PREFIX /usr/local 00:07:46.302 #undef SPDK_CONFIG_RAID5F 00:07:46.302 #undef SPDK_CONFIG_RBD 00:07:46.302 #define SPDK_CONFIG_RDMA 1 00:07:46.302 #define SPDK_CONFIG_RDMA_PROV verbs 00:07:46.302 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:07:46.302 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:07:46.302 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:07:46.302 #define SPDK_CONFIG_SHARED 1 00:07:46.302 #undef SPDK_CONFIG_SMA 00:07:46.302 #define SPDK_CONFIG_TESTS 1 00:07:46.302 #undef SPDK_CONFIG_TSAN 00:07:46.302 #define SPDK_CONFIG_UBLK 1 00:07:46.302 #define SPDK_CONFIG_UBSAN 1 00:07:46.302 #undef SPDK_CONFIG_UNIT_TESTS 00:07:46.302 #undef SPDK_CONFIG_URING 00:07:46.302 #define SPDK_CONFIG_URING_PATH 00:07:46.302 #undef SPDK_CONFIG_URING_ZNS 00:07:46.302 #undef SPDK_CONFIG_USDT 00:07:46.302 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:07:46.302 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:07:46.302 #define SPDK_CONFIG_VFIO_USER 1 00:07:46.302 #define SPDK_CONFIG_VFIO_USER_DIR 00:07:46.302 #define SPDK_CONFIG_VHOST 1 00:07:46.302 #define SPDK_CONFIG_VIRTIO 1 00:07:46.302 #undef SPDK_CONFIG_VTUNE 00:07:46.302 #define SPDK_CONFIG_VTUNE_DIR 00:07:46.302 #define SPDK_CONFIG_WERROR 1 00:07:46.302 #define SPDK_CONFIG_WPDK_DIR 00:07:46.302 #undef SPDK_CONFIG_XNVME 00:07:46.302 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:07:46.302 01:50:20 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:07:46.302 01:50:20 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:46.302 01:50:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:46.302 01:50:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:46.302 01:50:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:46.302 01:50:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:46.303 01:50:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:46.303 01:50:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:46.303 01:50:20 -- paths/export.sh@5 -- # export PATH 00:07:46.303 01:50:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:46.303 01:50:20 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:46.303 01:50:20 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:46.303 01:50:20 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:46.303 01:50:20 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:46.303 01:50:20 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:07:46.303 01:50:20 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:46.303 01:50:20 -- pm/common@16 -- # TEST_TAG=N/A 00:07:46.303 01:50:20 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:07:46.303 01:50:20 -- common/autotest_common.sh@52 -- # : 1 00:07:46.303 01:50:20 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:07:46.303 01:50:20 -- common/autotest_common.sh@56 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:07:46.303 01:50:20 -- common/autotest_common.sh@58 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:07:46.303 01:50:20 -- common/autotest_common.sh@60 -- # : 1 00:07:46.303 01:50:20 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:07:46.303 01:50:20 -- common/autotest_common.sh@62 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:07:46.303 01:50:20 -- common/autotest_common.sh@64 -- # : 00:07:46.303 01:50:20 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:07:46.303 01:50:20 -- common/autotest_common.sh@66 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:07:46.303 01:50:20 -- common/autotest_common.sh@68 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:07:46.303 01:50:20 -- common/autotest_common.sh@70 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:07:46.303 01:50:20 -- common/autotest_common.sh@72 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:07:46.303 01:50:20 -- common/autotest_common.sh@74 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:07:46.303 01:50:20 -- common/autotest_common.sh@76 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:07:46.303 01:50:20 -- common/autotest_common.sh@78 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:07:46.303 01:50:20 -- common/autotest_common.sh@80 -- # : 1 00:07:46.303 01:50:20 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:07:46.303 01:50:20 -- common/autotest_common.sh@82 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:07:46.303 01:50:20 -- common/autotest_common.sh@84 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:07:46.303 01:50:20 -- common/autotest_common.sh@86 -- # : 1 00:07:46.303 01:50:20 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:07:46.303 01:50:20 -- common/autotest_common.sh@88 -- # : 1 00:07:46.303 01:50:20 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:07:46.303 01:50:20 -- common/autotest_common.sh@90 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:07:46.303 01:50:20 -- common/autotest_common.sh@92 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:07:46.303 01:50:20 -- common/autotest_common.sh@94 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:07:46.303 01:50:20 -- common/autotest_common.sh@96 -- # : tcp 00:07:46.303 01:50:20 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:07:46.303 01:50:20 -- common/autotest_common.sh@98 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:07:46.303 01:50:20 -- common/autotest_common.sh@100 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:07:46.303 01:50:20 -- common/autotest_common.sh@102 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:07:46.303 01:50:20 -- common/autotest_common.sh@104 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:07:46.303 01:50:20 -- common/autotest_common.sh@106 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:07:46.303 01:50:20 -- common/autotest_common.sh@108 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:07:46.303 01:50:20 -- common/autotest_common.sh@110 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:07:46.303 01:50:20 -- common/autotest_common.sh@112 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:07:46.303 01:50:20 -- common/autotest_common.sh@114 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:07:46.303 01:50:20 -- common/autotest_common.sh@116 -- # : 1 00:07:46.303 01:50:20 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:07:46.303 01:50:20 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:46.303 01:50:20 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:07:46.303 01:50:20 -- common/autotest_common.sh@120 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:07:46.303 01:50:20 -- common/autotest_common.sh@122 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:07:46.303 01:50:20 -- common/autotest_common.sh@124 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:07:46.303 01:50:20 -- common/autotest_common.sh@126 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:07:46.303 01:50:20 -- common/autotest_common.sh@128 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:07:46.303 01:50:20 -- common/autotest_common.sh@130 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:07:46.303 01:50:20 -- common/autotest_common.sh@132 -- # : v22.11.4 00:07:46.303 01:50:20 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:07:46.303 01:50:20 -- common/autotest_common.sh@134 -- # : true 00:07:46.303 01:50:20 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:07:46.303 01:50:20 -- common/autotest_common.sh@136 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:07:46.303 01:50:20 -- common/autotest_common.sh@138 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:07:46.303 01:50:20 -- common/autotest_common.sh@140 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:07:46.303 01:50:20 -- common/autotest_common.sh@142 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:07:46.303 01:50:20 -- common/autotest_common.sh@144 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:07:46.303 01:50:20 -- common/autotest_common.sh@146 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:07:46.303 01:50:20 -- common/autotest_common.sh@148 -- # : e810 00:07:46.303 01:50:20 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:07:46.303 01:50:20 -- common/autotest_common.sh@150 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:07:46.303 01:50:20 -- common/autotest_common.sh@152 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:07:46.303 01:50:20 -- common/autotest_common.sh@154 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:07:46.303 01:50:20 -- common/autotest_common.sh@156 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:07:46.303 01:50:20 -- common/autotest_common.sh@158 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:07:46.303 01:50:20 -- common/autotest_common.sh@160 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:07:46.303 01:50:20 -- common/autotest_common.sh@163 -- # : 00:07:46.303 01:50:20 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:07:46.303 01:50:20 -- common/autotest_common.sh@165 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:07:46.303 01:50:20 -- common/autotest_common.sh@167 -- # : 0 00:07:46.303 01:50:20 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:07:46.303 01:50:20 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:46.303 01:50:20 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:46.303 01:50:20 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:46.303 01:50:20 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:46.303 01:50:20 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:46.303 01:50:20 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:46.304 01:50:20 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:46.304 01:50:20 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:46.304 01:50:20 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:07:46.304 01:50:20 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:07:46.304 01:50:20 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:46.304 01:50:20 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:46.304 01:50:20 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:07:46.304 01:50:20 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:07:46.304 01:50:20 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:46.304 01:50:20 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:46.304 01:50:20 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:46.304 01:50:20 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:46.304 01:50:20 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:07:46.304 01:50:20 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:07:46.304 01:50:20 -- common/autotest_common.sh@196 -- # cat 00:07:46.304 01:50:20 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:07:46.304 01:50:20 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:46.304 01:50:20 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:46.304 01:50:20 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:46.304 01:50:20 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:46.304 01:50:20 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:07:46.304 01:50:20 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:07:46.304 01:50:20 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:46.304 01:50:20 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:46.304 01:50:20 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:46.304 01:50:20 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:46.304 01:50:20 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:46.304 01:50:20 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:46.304 01:50:20 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:46.304 01:50:20 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:46.304 01:50:20 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:46.304 01:50:20 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:46.304 01:50:20 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:46.304 01:50:20 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:46.304 01:50:20 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:07:46.304 01:50:20 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:07:46.304 01:50:20 -- common/autotest_common.sh@249 -- # _LCOV= 00:07:46.304 01:50:20 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:07:46.304 01:50:20 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:07:46.304 01:50:20 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:07:46.304 01:50:20 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:07:46.304 01:50:20 -- common/autotest_common.sh@255 -- # lcov_opt= 00:07:46.304 01:50:20 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:07:46.304 01:50:20 -- common/autotest_common.sh@259 -- # export valgrind= 00:07:46.304 01:50:20 -- common/autotest_common.sh@259 -- # valgrind= 00:07:46.304 01:50:20 -- common/autotest_common.sh@265 -- # uname -s 00:07:46.304 01:50:20 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:07:46.304 01:50:20 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:07:46.304 01:50:20 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:07:46.304 01:50:20 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:07:46.304 01:50:20 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:07:46.304 01:50:20 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:07:46.304 01:50:20 -- common/autotest_common.sh@275 -- # MAKE=make 00:07:46.304 01:50:20 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:07:46.304 01:50:20 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:07:46.304 01:50:20 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:07:46.304 01:50:20 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:07:46.304 01:50:20 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:07:46.304 01:50:20 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:07:46.304 01:50:20 -- common/autotest_common.sh@301 -- # for i in "$@" 00:07:46.304 01:50:20 -- common/autotest_common.sh@302 -- # case "$i" in 00:07:46.304 01:50:20 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:07:46.304 01:50:20 -- common/autotest_common.sh@319 -- # [[ -z 1101735 ]] 00:07:46.304 01:50:20 -- common/autotest_common.sh@319 -- # kill -0 1101735 00:07:46.304 01:50:20 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:07:46.304 01:50:20 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:07:46.304 01:50:20 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:07:46.304 01:50:20 -- common/autotest_common.sh@332 -- # local mount target_dir 00:07:46.304 01:50:20 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:07:46.304 01:50:20 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:07:46.304 01:50:20 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:07:46.304 01:50:20 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:07:46.304 01:50:20 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.cfB0Hb 00:07:46.304 01:50:20 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:07:46.304 01:50:20 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:07:46.304 01:50:20 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:07:46.304 01:50:20 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.cfB0Hb/tests/target /tmp/spdk.cfB0Hb 00:07:46.304 01:50:20 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:07:46.304 01:50:20 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:46.304 01:50:20 -- common/autotest_common.sh@328 -- # df -T 00:07:46.304 01:50:20 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:07:46.304 01:50:20 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:07:46.304 01:50:20 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:07:46.304 01:50:20 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:07:46.304 01:50:20 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:07:46.304 01:50:20 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:07:46.304 01:50:20 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:46.304 01:50:20 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:07:46.304 01:50:20 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:07:46.304 01:50:20 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:07:46.304 01:50:20 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:07:46.304 01:50:20 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:07:46.304 01:50:20 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:46.304 01:50:20 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:07:46.304 01:50:20 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:07:46.304 01:50:20 -- common/autotest_common.sh@363 -- # avails["$mount"]=53998473216 00:07:46.304 01:50:20 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988511744 00:07:46.304 01:50:20 -- common/autotest_common.sh@364 -- # uses["$mount"]=7990038528 00:07:46.304 01:50:20 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:46.304 01:50:20 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:46.304 01:50:20 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:46.304 01:50:20 -- common/autotest_common.sh@363 -- # avails["$mount"]=30992998400 00:07:46.304 01:50:20 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994255872 00:07:46.304 01:50:20 -- common/autotest_common.sh@364 -- # uses["$mount"]=1257472 00:07:46.304 01:50:20 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:46.304 01:50:20 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:46.304 01:50:20 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:46.304 01:50:20 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:07:46.304 01:50:20 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:07:46.304 01:50:20 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:07:46.305 01:50:20 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:46.305 01:50:20 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:46.305 01:50:20 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:46.305 01:50:20 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993776640 00:07:46.305 01:50:20 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994255872 00:07:46.305 01:50:20 -- common/autotest_common.sh@364 -- # uses["$mount"]=479232 00:07:46.305 01:50:20 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:46.305 01:50:20 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:46.305 01:50:20 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:46.305 01:50:20 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:07:46.305 01:50:20 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:07:46.305 01:50:20 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:07:46.305 01:50:20 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:46.305 01:50:20 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:07:46.305 * Looking for test storage... 00:07:46.305 01:50:20 -- common/autotest_common.sh@369 -- # local target_space new_size 00:07:46.305 01:50:20 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:07:46.305 01:50:20 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:46.305 01:50:20 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:07:46.305 01:50:20 -- common/autotest_common.sh@373 -- # mount=/ 00:07:46.305 01:50:20 -- common/autotest_common.sh@375 -- # target_space=53998473216 00:07:46.305 01:50:20 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:07:46.305 01:50:20 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:07:46.305 01:50:20 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:07:46.305 01:50:20 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:07:46.305 01:50:20 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:07:46.305 01:50:20 -- common/autotest_common.sh@382 -- # new_size=10204631040 00:07:46.305 01:50:20 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:07:46.305 01:50:20 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:46.305 01:50:20 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:46.305 01:50:20 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:46.305 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:46.305 01:50:20 -- common/autotest_common.sh@390 -- # return 0 00:07:46.305 01:50:20 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:07:46.305 01:50:20 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:07:46.305 01:50:20 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:07:46.305 01:50:20 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:07:46.305 01:50:20 -- common/autotest_common.sh@1682 -- # true 00:07:46.305 01:50:20 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:07:46.305 01:50:20 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:07:46.305 01:50:20 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:07:46.305 01:50:20 -- common/autotest_common.sh@27 -- # exec 00:07:46.305 01:50:20 -- common/autotest_common.sh@29 -- # exec 00:07:46.305 01:50:20 -- common/autotest_common.sh@31 -- # xtrace_restore 00:07:46.305 01:50:20 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:07:46.305 01:50:20 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:07:46.305 01:50:20 -- common/autotest_common.sh@18 -- # set -x 00:07:46.305 01:50:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:46.305 01:50:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:46.305 01:50:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:46.566 01:50:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:46.566 01:50:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:46.566 01:50:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:46.566 01:50:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:46.566 01:50:20 -- scripts/common.sh@335 -- # IFS=.-: 00:07:46.566 01:50:20 -- scripts/common.sh@335 -- # read -ra ver1 00:07:46.566 01:50:20 -- scripts/common.sh@336 -- # IFS=.-: 00:07:46.566 01:50:20 -- scripts/common.sh@336 -- # read -ra ver2 00:07:46.566 01:50:20 -- scripts/common.sh@337 -- # local 'op=<' 00:07:46.566 01:50:20 -- scripts/common.sh@339 -- # ver1_l=2 00:07:46.566 01:50:20 -- scripts/common.sh@340 -- # ver2_l=1 00:07:46.566 01:50:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:46.566 01:50:20 -- scripts/common.sh@343 -- # case "$op" in 00:07:46.566 01:50:20 -- scripts/common.sh@344 -- # : 1 00:07:46.566 01:50:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:46.566 01:50:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:46.566 01:50:20 -- scripts/common.sh@364 -- # decimal 1 00:07:46.566 01:50:20 -- scripts/common.sh@352 -- # local d=1 00:07:46.566 01:50:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:46.566 01:50:20 -- scripts/common.sh@354 -- # echo 1 00:07:46.566 01:50:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:46.566 01:50:20 -- scripts/common.sh@365 -- # decimal 2 00:07:46.566 01:50:20 -- scripts/common.sh@352 -- # local d=2 00:07:46.566 01:50:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:46.566 01:50:20 -- scripts/common.sh@354 -- # echo 2 00:07:46.566 01:50:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:46.566 01:50:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:46.566 01:50:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:46.566 01:50:20 -- scripts/common.sh@367 -- # return 0 00:07:46.566 01:50:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:46.566 01:50:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:46.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.566 --rc genhtml_branch_coverage=1 00:07:46.566 --rc genhtml_function_coverage=1 00:07:46.566 --rc genhtml_legend=1 00:07:46.566 --rc geninfo_all_blocks=1 00:07:46.566 --rc geninfo_unexecuted_blocks=1 00:07:46.566 00:07:46.566 ' 00:07:46.566 01:50:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:46.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.566 --rc genhtml_branch_coverage=1 00:07:46.566 --rc genhtml_function_coverage=1 00:07:46.566 --rc genhtml_legend=1 00:07:46.566 --rc geninfo_all_blocks=1 00:07:46.566 --rc geninfo_unexecuted_blocks=1 00:07:46.566 00:07:46.566 ' 00:07:46.566 01:50:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:46.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.566 --rc genhtml_branch_coverage=1 00:07:46.566 --rc genhtml_function_coverage=1 00:07:46.566 --rc genhtml_legend=1 00:07:46.566 --rc geninfo_all_blocks=1 00:07:46.566 --rc geninfo_unexecuted_blocks=1 00:07:46.566 00:07:46.566 ' 00:07:46.566 01:50:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:46.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.566 --rc genhtml_branch_coverage=1 00:07:46.566 --rc genhtml_function_coverage=1 00:07:46.566 --rc genhtml_legend=1 00:07:46.566 --rc geninfo_all_blocks=1 00:07:46.566 --rc geninfo_unexecuted_blocks=1 00:07:46.566 00:07:46.566 ' 00:07:46.566 01:50:20 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:46.566 01:50:20 -- nvmf/common.sh@7 -- # uname -s 00:07:46.566 01:50:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:46.566 01:50:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:46.566 01:50:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:46.566 01:50:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:46.566 01:50:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:46.566 01:50:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:46.566 01:50:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:46.566 01:50:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:46.566 01:50:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:46.566 01:50:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:46.566 01:50:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:46.566 01:50:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:46.566 01:50:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:46.566 01:50:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:46.566 01:50:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:46.566 01:50:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:46.567 01:50:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:46.567 01:50:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:46.567 01:50:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:46.567 01:50:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:46.567 01:50:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:46.567 01:50:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:46.567 01:50:20 -- paths/export.sh@5 -- # export PATH 00:07:46.567 01:50:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:46.567 01:50:20 -- nvmf/common.sh@46 -- # : 0 00:07:46.567 01:50:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:46.567 01:50:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:46.567 01:50:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:46.567 01:50:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:46.567 01:50:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:46.567 01:50:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:46.567 01:50:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:46.567 01:50:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:46.567 01:50:20 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:07:46.567 01:50:20 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:07:46.567 01:50:20 -- target/filesystem.sh@15 -- # nvmftestinit 00:07:46.567 01:50:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:46.567 01:50:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:46.567 01:50:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:46.567 01:50:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:46.567 01:50:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:46.567 01:50:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:46.567 01:50:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:46.567 01:50:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:46.567 01:50:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:46.567 01:50:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:46.567 01:50:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:46.567 01:50:20 -- common/autotest_common.sh@10 -- # set +x 00:07:48.475 01:50:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:48.475 01:50:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:48.475 01:50:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:48.475 01:50:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:48.475 01:50:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:48.475 01:50:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:48.475 01:50:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:48.475 01:50:22 -- nvmf/common.sh@294 -- # net_devs=() 00:07:48.475 01:50:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:48.475 01:50:22 -- nvmf/common.sh@295 -- # e810=() 00:07:48.475 01:50:22 -- nvmf/common.sh@295 -- # local -ga e810 00:07:48.475 01:50:22 -- nvmf/common.sh@296 -- # x722=() 00:07:48.475 01:50:22 -- nvmf/common.sh@296 -- # local -ga x722 00:07:48.475 01:50:22 -- nvmf/common.sh@297 -- # mlx=() 00:07:48.475 01:50:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:48.475 01:50:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:48.475 01:50:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:48.475 01:50:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:48.475 01:50:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:48.475 01:50:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:48.475 01:50:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:48.475 01:50:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:48.475 01:50:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:48.475 01:50:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:48.475 01:50:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:48.475 01:50:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:48.475 01:50:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:48.475 01:50:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:48.475 01:50:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:48.475 01:50:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:48.475 01:50:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:48.475 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:48.475 01:50:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:48.475 01:50:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:48.475 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:48.475 01:50:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:48.475 01:50:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:48.475 01:50:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:48.475 01:50:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:48.475 01:50:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:48.475 01:50:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:48.475 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:48.475 01:50:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:48.475 01:50:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:48.475 01:50:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:48.475 01:50:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:48.475 01:50:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:48.475 01:50:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:48.475 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:48.475 01:50:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:48.475 01:50:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:48.475 01:50:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:48.475 01:50:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:48.475 01:50:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:48.475 01:50:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:48.475 01:50:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:48.475 01:50:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:48.475 01:50:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:48.475 01:50:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:48.475 01:50:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:48.475 01:50:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:48.475 01:50:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:48.475 01:50:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:48.475 01:50:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:48.475 01:50:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:48.475 01:50:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:48.475 01:50:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:48.735 01:50:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:48.735 01:50:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:48.735 01:50:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:48.735 01:50:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:48.735 01:50:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:48.735 01:50:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:48.735 01:50:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:48.735 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:48.735 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.148 ms 00:07:48.735 00:07:48.735 --- 10.0.0.2 ping statistics --- 00:07:48.735 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:48.735 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:07:48.735 01:50:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:48.735 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:48.735 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:07:48.735 00:07:48.735 --- 10.0.0.1 ping statistics --- 00:07:48.735 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:48.735 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:07:48.735 01:50:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:48.735 01:50:22 -- nvmf/common.sh@410 -- # return 0 00:07:48.735 01:50:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:48.735 01:50:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:48.735 01:50:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:48.735 01:50:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:48.735 01:50:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:48.735 01:50:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:48.735 01:50:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:48.735 01:50:22 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:48.735 01:50:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:48.735 01:50:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:48.735 01:50:22 -- common/autotest_common.sh@10 -- # set +x 00:07:48.735 ************************************ 00:07:48.735 START TEST nvmf_filesystem_no_in_capsule 00:07:48.735 ************************************ 00:07:48.735 01:50:22 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:07:48.735 01:50:22 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:48.735 01:50:22 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:48.735 01:50:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:48.735 01:50:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:48.735 01:50:22 -- common/autotest_common.sh@10 -- # set +x 00:07:48.735 01:50:22 -- nvmf/common.sh@469 -- # nvmfpid=1103380 00:07:48.735 01:50:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:48.735 01:50:22 -- nvmf/common.sh@470 -- # waitforlisten 1103380 00:07:48.735 01:50:22 -- common/autotest_common.sh@829 -- # '[' -z 1103380 ']' 00:07:48.735 01:50:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:48.735 01:50:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:48.735 01:50:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:48.735 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:48.735 01:50:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:48.735 01:50:22 -- common/autotest_common.sh@10 -- # set +x 00:07:48.735 [2024-11-18 01:50:23.021344] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:48.735 [2024-11-18 01:50:23.021419] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:48.735 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.735 [2024-11-18 01:50:23.085251] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:48.995 [2024-11-18 01:50:23.176663] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:48.995 [2024-11-18 01:50:23.176820] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:48.995 [2024-11-18 01:50:23.176838] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:48.995 [2024-11-18 01:50:23.176849] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:48.995 [2024-11-18 01:50:23.176913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:48.995 [2024-11-18 01:50:23.176970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:48.995 [2024-11-18 01:50:23.177035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:48.995 [2024-11-18 01:50:23.177037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.931 01:50:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:49.931 01:50:23 -- common/autotest_common.sh@862 -- # return 0 00:07:49.931 01:50:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:49.931 01:50:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:49.931 01:50:23 -- common/autotest_common.sh@10 -- # set +x 00:07:49.931 01:50:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:49.931 01:50:24 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:49.931 01:50:24 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:49.931 01:50:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.931 01:50:24 -- common/autotest_common.sh@10 -- # set +x 00:07:49.931 [2024-11-18 01:50:24.023946] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:49.931 01:50:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.931 01:50:24 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:49.931 01:50:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.931 01:50:24 -- common/autotest_common.sh@10 -- # set +x 00:07:49.931 Malloc1 00:07:49.931 01:50:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.931 01:50:24 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:49.931 01:50:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.931 01:50:24 -- common/autotest_common.sh@10 -- # set +x 00:07:49.932 01:50:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.932 01:50:24 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:49.932 01:50:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.932 01:50:24 -- common/autotest_common.sh@10 -- # set +x 00:07:49.932 01:50:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.932 01:50:24 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:49.932 01:50:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.932 01:50:24 -- common/autotest_common.sh@10 -- # set +x 00:07:49.932 [2024-11-18 01:50:24.210389] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:49.932 01:50:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.932 01:50:24 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:49.932 01:50:24 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:49.932 01:50:24 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:49.932 01:50:24 -- common/autotest_common.sh@1369 -- # local bs 00:07:49.932 01:50:24 -- common/autotest_common.sh@1370 -- # local nb 00:07:49.932 01:50:24 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:49.932 01:50:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.932 01:50:24 -- common/autotest_common.sh@10 -- # set +x 00:07:49.932 01:50:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.932 01:50:24 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:49.932 { 00:07:49.932 "name": "Malloc1", 00:07:49.932 "aliases": [ 00:07:49.932 "487e08bb-93c0-4bed-8afb-f0b9ca609039" 00:07:49.932 ], 00:07:49.932 "product_name": "Malloc disk", 00:07:49.932 "block_size": 512, 00:07:49.932 "num_blocks": 1048576, 00:07:49.932 "uuid": "487e08bb-93c0-4bed-8afb-f0b9ca609039", 00:07:49.932 "assigned_rate_limits": { 00:07:49.932 "rw_ios_per_sec": 0, 00:07:49.932 "rw_mbytes_per_sec": 0, 00:07:49.932 "r_mbytes_per_sec": 0, 00:07:49.932 "w_mbytes_per_sec": 0 00:07:49.932 }, 00:07:49.932 "claimed": true, 00:07:49.932 "claim_type": "exclusive_write", 00:07:49.932 "zoned": false, 00:07:49.932 "supported_io_types": { 00:07:49.932 "read": true, 00:07:49.932 "write": true, 00:07:49.932 "unmap": true, 00:07:49.932 "write_zeroes": true, 00:07:49.932 "flush": true, 00:07:49.932 "reset": true, 00:07:49.932 "compare": false, 00:07:49.932 "compare_and_write": false, 00:07:49.932 "abort": true, 00:07:49.932 "nvme_admin": false, 00:07:49.932 "nvme_io": false 00:07:49.932 }, 00:07:49.932 "memory_domains": [ 00:07:49.932 { 00:07:49.932 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:49.932 "dma_device_type": 2 00:07:49.932 } 00:07:49.932 ], 00:07:49.932 "driver_specific": {} 00:07:49.932 } 00:07:49.932 ]' 00:07:49.932 01:50:24 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:49.932 01:50:24 -- common/autotest_common.sh@1372 -- # bs=512 00:07:49.932 01:50:24 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:49.932 01:50:24 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:49.932 01:50:24 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:49.932 01:50:24 -- common/autotest_common.sh@1377 -- # echo 512 00:07:49.932 01:50:24 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:49.932 01:50:24 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:50.872 01:50:24 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:50.872 01:50:24 -- common/autotest_common.sh@1187 -- # local i=0 00:07:50.872 01:50:24 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:50.872 01:50:24 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:50.872 01:50:24 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:52.780 01:50:26 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:52.780 01:50:26 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:52.780 01:50:26 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:52.780 01:50:26 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:52.780 01:50:26 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:52.780 01:50:26 -- common/autotest_common.sh@1197 -- # return 0 00:07:52.780 01:50:26 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:52.780 01:50:26 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:52.780 01:50:26 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:52.780 01:50:26 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:52.780 01:50:26 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:52.780 01:50:26 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:52.780 01:50:26 -- setup/common.sh@80 -- # echo 536870912 00:07:52.780 01:50:26 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:52.780 01:50:26 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:52.780 01:50:26 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:52.780 01:50:26 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:52.780 01:50:26 -- target/filesystem.sh@69 -- # partprobe 00:07:53.349 01:50:27 -- target/filesystem.sh@70 -- # sleep 1 00:07:54.289 01:50:28 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:54.289 01:50:28 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:54.289 01:50:28 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:54.289 01:50:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:54.289 01:50:28 -- common/autotest_common.sh@10 -- # set +x 00:07:54.289 ************************************ 00:07:54.289 START TEST filesystem_ext4 00:07:54.289 ************************************ 00:07:54.289 01:50:28 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:54.289 01:50:28 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:54.289 01:50:28 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:54.289 01:50:28 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:54.289 01:50:28 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:54.289 01:50:28 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:54.289 01:50:28 -- common/autotest_common.sh@914 -- # local i=0 00:07:54.289 01:50:28 -- common/autotest_common.sh@915 -- # local force 00:07:54.289 01:50:28 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:54.289 01:50:28 -- common/autotest_common.sh@918 -- # force=-F 00:07:54.289 01:50:28 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:54.289 mke2fs 1.47.0 (5-Feb-2023) 00:07:54.550 Discarding device blocks: 0/522240 done 00:07:54.550 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:54.550 Filesystem UUID: 10b52cc4-4567-49c8-b1dc-c36975e2dc4f 00:07:54.550 Superblock backups stored on blocks: 00:07:54.550 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:54.550 00:07:54.550 Allocating group tables: 0/64 done 00:07:54.550 Writing inode tables: 0/64 done 00:07:54.810 Creating journal (8192 blocks): done 00:07:55.071 Writing superblocks and filesystem accounting information: 0/64 done 00:07:55.071 00:07:55.071 01:50:29 -- common/autotest_common.sh@931 -- # return 0 00:07:55.071 01:50:29 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:01.646 01:50:35 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:01.646 01:50:35 -- target/filesystem.sh@25 -- # sync 00:08:01.646 01:50:35 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:01.646 01:50:35 -- target/filesystem.sh@27 -- # sync 00:08:01.646 01:50:35 -- target/filesystem.sh@29 -- # i=0 00:08:01.646 01:50:35 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:01.646 01:50:35 -- target/filesystem.sh@37 -- # kill -0 1103380 00:08:01.646 01:50:35 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:01.646 01:50:35 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:01.646 01:50:35 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:01.646 01:50:35 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:01.646 00:08:01.646 real 0m6.749s 00:08:01.646 user 0m0.025s 00:08:01.646 sys 0m0.060s 00:08:01.646 01:50:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:01.646 01:50:35 -- common/autotest_common.sh@10 -- # set +x 00:08:01.646 ************************************ 00:08:01.646 END TEST filesystem_ext4 00:08:01.646 ************************************ 00:08:01.646 01:50:35 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:01.646 01:50:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:01.646 01:50:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:01.646 01:50:35 -- common/autotest_common.sh@10 -- # set +x 00:08:01.646 ************************************ 00:08:01.646 START TEST filesystem_btrfs 00:08:01.646 ************************************ 00:08:01.646 01:50:35 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:01.646 01:50:35 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:01.646 01:50:35 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:01.646 01:50:35 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:01.646 01:50:35 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:01.646 01:50:35 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:01.646 01:50:35 -- common/autotest_common.sh@914 -- # local i=0 00:08:01.646 01:50:35 -- common/autotest_common.sh@915 -- # local force 00:08:01.646 01:50:35 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:01.646 01:50:35 -- common/autotest_common.sh@920 -- # force=-f 00:08:01.646 01:50:35 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:01.646 btrfs-progs v6.8.1 00:08:01.646 See https://btrfs.readthedocs.io for more information. 00:08:01.646 00:08:01.646 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:01.646 NOTE: several default settings have changed in version 5.15, please make sure 00:08:01.646 this does not affect your deployments: 00:08:01.646 - DUP for metadata (-m dup) 00:08:01.646 - enabled no-holes (-O no-holes) 00:08:01.646 - enabled free-space-tree (-R free-space-tree) 00:08:01.646 00:08:01.646 Label: (null) 00:08:01.646 UUID: 82e83662-8170-4726-939f-159db1f23d2b 00:08:01.646 Node size: 16384 00:08:01.646 Sector size: 4096 (CPU page size: 4096) 00:08:01.646 Filesystem size: 510.00MiB 00:08:01.646 Block group profiles: 00:08:01.646 Data: single 8.00MiB 00:08:01.646 Metadata: DUP 32.00MiB 00:08:01.646 System: DUP 8.00MiB 00:08:01.646 SSD detected: yes 00:08:01.646 Zoned device: no 00:08:01.646 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:01.646 Checksum: crc32c 00:08:01.646 Number of devices: 1 00:08:01.646 Devices: 00:08:01.646 ID SIZE PATH 00:08:01.646 1 510.00MiB /dev/nvme0n1p1 00:08:01.646 00:08:01.646 01:50:35 -- common/autotest_common.sh@931 -- # return 0 00:08:01.646 01:50:35 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:01.646 01:50:35 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:01.646 01:50:35 -- target/filesystem.sh@25 -- # sync 00:08:01.646 01:50:35 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:01.646 01:50:35 -- target/filesystem.sh@27 -- # sync 00:08:01.646 01:50:35 -- target/filesystem.sh@29 -- # i=0 00:08:01.646 01:50:35 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:01.646 01:50:35 -- target/filesystem.sh@37 -- # kill -0 1103380 00:08:01.646 01:50:35 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:01.646 01:50:35 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:01.646 01:50:35 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:01.646 01:50:35 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:01.646 00:08:01.646 real 0m0.474s 00:08:01.646 user 0m0.014s 00:08:01.646 sys 0m0.097s 00:08:01.646 01:50:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:01.646 01:50:35 -- common/autotest_common.sh@10 -- # set +x 00:08:01.646 ************************************ 00:08:01.646 END TEST filesystem_btrfs 00:08:01.646 ************************************ 00:08:01.646 01:50:35 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:01.646 01:50:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:01.646 01:50:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:01.646 01:50:35 -- common/autotest_common.sh@10 -- # set +x 00:08:01.646 ************************************ 00:08:01.646 START TEST filesystem_xfs 00:08:01.647 ************************************ 00:08:01.647 01:50:35 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:01.647 01:50:35 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:01.647 01:50:35 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:01.647 01:50:35 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:01.647 01:50:35 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:01.647 01:50:35 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:01.647 01:50:35 -- common/autotest_common.sh@914 -- # local i=0 00:08:01.647 01:50:35 -- common/autotest_common.sh@915 -- # local force 00:08:01.647 01:50:35 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:01.647 01:50:35 -- common/autotest_common.sh@920 -- # force=-f 00:08:01.647 01:50:35 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:01.906 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:01.906 = sectsz=512 attr=2, projid32bit=1 00:08:01.906 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:01.906 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:01.906 data = bsize=4096 blocks=130560, imaxpct=25 00:08:01.906 = sunit=0 swidth=0 blks 00:08:01.906 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:01.906 log =internal log bsize=4096 blocks=16384, version=2 00:08:01.906 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:01.906 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:02.849 Discarding blocks...Done. 00:08:02.849 01:50:37 -- common/autotest_common.sh@931 -- # return 0 00:08:02.849 01:50:37 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:04.759 01:50:39 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:04.759 01:50:39 -- target/filesystem.sh@25 -- # sync 00:08:04.759 01:50:39 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:04.759 01:50:39 -- target/filesystem.sh@27 -- # sync 00:08:04.759 01:50:39 -- target/filesystem.sh@29 -- # i=0 00:08:04.759 01:50:39 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:04.759 01:50:39 -- target/filesystem.sh@37 -- # kill -0 1103380 00:08:04.759 01:50:39 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:04.759 01:50:39 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:04.759 01:50:39 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:04.759 01:50:39 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:04.759 00:08:04.759 real 0m3.172s 00:08:04.759 user 0m0.010s 00:08:04.759 sys 0m0.066s 00:08:04.759 01:50:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:04.759 01:50:39 -- common/autotest_common.sh@10 -- # set +x 00:08:04.759 ************************************ 00:08:04.759 END TEST filesystem_xfs 00:08:04.759 ************************************ 00:08:04.759 01:50:39 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:05.017 01:50:39 -- target/filesystem.sh@93 -- # sync 00:08:05.017 01:50:39 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:05.017 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:05.017 01:50:39 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:05.017 01:50:39 -- common/autotest_common.sh@1208 -- # local i=0 00:08:05.017 01:50:39 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:05.017 01:50:39 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:05.017 01:50:39 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:05.017 01:50:39 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:05.017 01:50:39 -- common/autotest_common.sh@1220 -- # return 0 00:08:05.017 01:50:39 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:05.017 01:50:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.017 01:50:39 -- common/autotest_common.sh@10 -- # set +x 00:08:05.017 01:50:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.017 01:50:39 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:05.017 01:50:39 -- target/filesystem.sh@101 -- # killprocess 1103380 00:08:05.017 01:50:39 -- common/autotest_common.sh@936 -- # '[' -z 1103380 ']' 00:08:05.017 01:50:39 -- common/autotest_common.sh@940 -- # kill -0 1103380 00:08:05.017 01:50:39 -- common/autotest_common.sh@941 -- # uname 00:08:05.017 01:50:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:05.017 01:50:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1103380 00:08:05.275 01:50:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:05.275 01:50:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:05.275 01:50:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1103380' 00:08:05.275 killing process with pid 1103380 00:08:05.275 01:50:39 -- common/autotest_common.sh@955 -- # kill 1103380 00:08:05.275 01:50:39 -- common/autotest_common.sh@960 -- # wait 1103380 00:08:05.533 01:50:39 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:05.533 00:08:05.533 real 0m16.894s 00:08:05.533 user 1m5.477s 00:08:05.533 sys 0m2.117s 00:08:05.533 01:50:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:05.533 01:50:39 -- common/autotest_common.sh@10 -- # set +x 00:08:05.533 ************************************ 00:08:05.533 END TEST nvmf_filesystem_no_in_capsule 00:08:05.533 ************************************ 00:08:05.533 01:50:39 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:05.533 01:50:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:05.533 01:50:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:05.533 01:50:39 -- common/autotest_common.sh@10 -- # set +x 00:08:05.533 ************************************ 00:08:05.533 START TEST nvmf_filesystem_in_capsule 00:08:05.533 ************************************ 00:08:05.533 01:50:39 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:05.533 01:50:39 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:05.533 01:50:39 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:05.533 01:50:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:05.533 01:50:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:05.533 01:50:39 -- common/autotest_common.sh@10 -- # set +x 00:08:05.533 01:50:39 -- nvmf/common.sh@469 -- # nvmfpid=1105661 00:08:05.533 01:50:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:05.533 01:50:39 -- nvmf/common.sh@470 -- # waitforlisten 1105661 00:08:05.533 01:50:39 -- common/autotest_common.sh@829 -- # '[' -z 1105661 ']' 00:08:05.533 01:50:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:05.533 01:50:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:05.533 01:50:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:05.533 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:05.533 01:50:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:05.533 01:50:39 -- common/autotest_common.sh@10 -- # set +x 00:08:05.792 [2024-11-18 01:50:39.946237] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:05.792 [2024-11-18 01:50:39.946348] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:05.792 EAL: No free 2048 kB hugepages reported on node 1 00:08:05.792 [2024-11-18 01:50:40.013460] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:05.792 [2024-11-18 01:50:40.115575] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:05.792 [2024-11-18 01:50:40.115747] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:05.792 [2024-11-18 01:50:40.115764] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:05.792 [2024-11-18 01:50:40.115777] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:05.792 [2024-11-18 01:50:40.115830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:05.792 [2024-11-18 01:50:40.115857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:05.792 [2024-11-18 01:50:40.115878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:05.792 [2024-11-18 01:50:40.115881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:06.732 01:50:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:06.732 01:50:40 -- common/autotest_common.sh@862 -- # return 0 00:08:06.732 01:50:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:06.732 01:50:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:06.732 01:50:40 -- common/autotest_common.sh@10 -- # set +x 00:08:06.732 01:50:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:06.732 01:50:40 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:06.732 01:50:40 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:06.732 01:50:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:06.732 01:50:40 -- common/autotest_common.sh@10 -- # set +x 00:08:06.732 [2024-11-18 01:50:40.997142] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:06.732 01:50:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:06.732 01:50:41 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:06.732 01:50:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:06.732 01:50:41 -- common/autotest_common.sh@10 -- # set +x 00:08:06.993 Malloc1 00:08:06.993 01:50:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:06.993 01:50:41 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:06.993 01:50:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:06.993 01:50:41 -- common/autotest_common.sh@10 -- # set +x 00:08:06.993 01:50:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:06.993 01:50:41 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:06.993 01:50:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:06.993 01:50:41 -- common/autotest_common.sh@10 -- # set +x 00:08:06.993 01:50:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:06.993 01:50:41 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:06.993 01:50:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:06.993 01:50:41 -- common/autotest_common.sh@10 -- # set +x 00:08:06.993 [2024-11-18 01:50:41.184868] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:06.993 01:50:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:06.993 01:50:41 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:06.993 01:50:41 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:06.993 01:50:41 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:06.993 01:50:41 -- common/autotest_common.sh@1369 -- # local bs 00:08:06.993 01:50:41 -- common/autotest_common.sh@1370 -- # local nb 00:08:06.993 01:50:41 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:06.993 01:50:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:06.993 01:50:41 -- common/autotest_common.sh@10 -- # set +x 00:08:06.993 01:50:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:06.993 01:50:41 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:06.993 { 00:08:06.993 "name": "Malloc1", 00:08:06.993 "aliases": [ 00:08:06.993 "54f4d60d-1282-4d2b-aaa2-d74a13b1237e" 00:08:06.993 ], 00:08:06.993 "product_name": "Malloc disk", 00:08:06.993 "block_size": 512, 00:08:06.993 "num_blocks": 1048576, 00:08:06.993 "uuid": "54f4d60d-1282-4d2b-aaa2-d74a13b1237e", 00:08:06.993 "assigned_rate_limits": { 00:08:06.993 "rw_ios_per_sec": 0, 00:08:06.993 "rw_mbytes_per_sec": 0, 00:08:06.993 "r_mbytes_per_sec": 0, 00:08:06.993 "w_mbytes_per_sec": 0 00:08:06.993 }, 00:08:06.993 "claimed": true, 00:08:06.993 "claim_type": "exclusive_write", 00:08:06.993 "zoned": false, 00:08:06.993 "supported_io_types": { 00:08:06.993 "read": true, 00:08:06.993 "write": true, 00:08:06.993 "unmap": true, 00:08:06.993 "write_zeroes": true, 00:08:06.993 "flush": true, 00:08:06.993 "reset": true, 00:08:06.993 "compare": false, 00:08:06.993 "compare_and_write": false, 00:08:06.993 "abort": true, 00:08:06.993 "nvme_admin": false, 00:08:06.993 "nvme_io": false 00:08:06.993 }, 00:08:06.993 "memory_domains": [ 00:08:06.993 { 00:08:06.993 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:06.993 "dma_device_type": 2 00:08:06.993 } 00:08:06.993 ], 00:08:06.993 "driver_specific": {} 00:08:06.993 } 00:08:06.993 ]' 00:08:06.993 01:50:41 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:06.993 01:50:41 -- common/autotest_common.sh@1372 -- # bs=512 00:08:06.993 01:50:41 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:06.993 01:50:41 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:06.993 01:50:41 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:06.993 01:50:41 -- common/autotest_common.sh@1377 -- # echo 512 00:08:06.993 01:50:41 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:06.993 01:50:41 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:07.562 01:50:41 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:07.562 01:50:41 -- common/autotest_common.sh@1187 -- # local i=0 00:08:07.562 01:50:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:07.562 01:50:41 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:07.563 01:50:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:10.104 01:50:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:10.104 01:50:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:10.104 01:50:43 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:10.104 01:50:43 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:10.104 01:50:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:10.104 01:50:43 -- common/autotest_common.sh@1197 -- # return 0 00:08:10.104 01:50:43 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:10.104 01:50:43 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:10.104 01:50:43 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:10.105 01:50:43 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:10.105 01:50:43 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:10.105 01:50:43 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:10.105 01:50:43 -- setup/common.sh@80 -- # echo 536870912 00:08:10.105 01:50:43 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:10.105 01:50:43 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:10.105 01:50:43 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:10.105 01:50:43 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:10.105 01:50:44 -- target/filesystem.sh@69 -- # partprobe 00:08:10.364 01:50:44 -- target/filesystem.sh@70 -- # sleep 1 00:08:11.305 01:50:45 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:11.306 01:50:45 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:11.306 01:50:45 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:11.306 01:50:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:11.306 01:50:45 -- common/autotest_common.sh@10 -- # set +x 00:08:11.306 ************************************ 00:08:11.306 START TEST filesystem_in_capsule_ext4 00:08:11.306 ************************************ 00:08:11.306 01:50:45 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:11.306 01:50:45 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:11.306 01:50:45 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:11.306 01:50:45 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:11.306 01:50:45 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:11.306 01:50:45 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:11.306 01:50:45 -- common/autotest_common.sh@914 -- # local i=0 00:08:11.306 01:50:45 -- common/autotest_common.sh@915 -- # local force 00:08:11.306 01:50:45 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:11.306 01:50:45 -- common/autotest_common.sh@918 -- # force=-F 00:08:11.306 01:50:45 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:11.306 mke2fs 1.47.0 (5-Feb-2023) 00:08:11.566 Discarding device blocks: 0/522240 done 00:08:11.566 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:11.566 Filesystem UUID: d74734f6-5f0f-4d53-86cf-52e611c2cedf 00:08:11.566 Superblock backups stored on blocks: 00:08:11.566 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:11.566 00:08:11.566 Allocating group tables: 0/64 done 00:08:11.566 Writing inode tables: 0/64 done 00:08:12.502 Creating journal (8192 blocks): done 00:08:12.502 Writing superblocks and filesystem accounting information: 0/64 done 00:08:12.502 00:08:12.502 01:50:46 -- common/autotest_common.sh@931 -- # return 0 00:08:12.502 01:50:46 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:17.843 01:50:52 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:17.843 01:50:52 -- target/filesystem.sh@25 -- # sync 00:08:17.843 01:50:52 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:17.843 01:50:52 -- target/filesystem.sh@27 -- # sync 00:08:17.843 01:50:52 -- target/filesystem.sh@29 -- # i=0 00:08:17.843 01:50:52 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:17.843 01:50:52 -- target/filesystem.sh@37 -- # kill -0 1105661 00:08:17.843 01:50:52 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:17.843 01:50:52 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:17.843 01:50:52 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:17.843 01:50:52 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:17.843 00:08:17.843 real 0m6.622s 00:08:17.843 user 0m0.027s 00:08:17.843 sys 0m0.060s 00:08:17.843 01:50:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:17.843 01:50:52 -- common/autotest_common.sh@10 -- # set +x 00:08:17.843 ************************************ 00:08:17.843 END TEST filesystem_in_capsule_ext4 00:08:17.843 ************************************ 00:08:18.102 01:50:52 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:18.102 01:50:52 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:18.102 01:50:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:18.102 01:50:52 -- common/autotest_common.sh@10 -- # set +x 00:08:18.102 ************************************ 00:08:18.102 START TEST filesystem_in_capsule_btrfs 00:08:18.102 ************************************ 00:08:18.102 01:50:52 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:18.102 01:50:52 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:18.102 01:50:52 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:18.102 01:50:52 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:18.102 01:50:52 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:18.102 01:50:52 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:18.102 01:50:52 -- common/autotest_common.sh@914 -- # local i=0 00:08:18.102 01:50:52 -- common/autotest_common.sh@915 -- # local force 00:08:18.102 01:50:52 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:18.102 01:50:52 -- common/autotest_common.sh@920 -- # force=-f 00:08:18.102 01:50:52 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:18.102 btrfs-progs v6.8.1 00:08:18.102 See https://btrfs.readthedocs.io for more information. 00:08:18.102 00:08:18.102 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:18.102 NOTE: several default settings have changed in version 5.15, please make sure 00:08:18.102 this does not affect your deployments: 00:08:18.102 - DUP for metadata (-m dup) 00:08:18.102 - enabled no-holes (-O no-holes) 00:08:18.102 - enabled free-space-tree (-R free-space-tree) 00:08:18.102 00:08:18.102 Label: (null) 00:08:18.102 UUID: da062a20-7625-4c62-9d01-b62de4b7aec1 00:08:18.102 Node size: 16384 00:08:18.102 Sector size: 4096 (CPU page size: 4096) 00:08:18.102 Filesystem size: 510.00MiB 00:08:18.102 Block group profiles: 00:08:18.102 Data: single 8.00MiB 00:08:18.102 Metadata: DUP 32.00MiB 00:08:18.102 System: DUP 8.00MiB 00:08:18.102 SSD detected: yes 00:08:18.102 Zoned device: no 00:08:18.102 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:18.102 Checksum: crc32c 00:08:18.102 Number of devices: 1 00:08:18.102 Devices: 00:08:18.102 ID SIZE PATH 00:08:18.102 1 510.00MiB /dev/nvme0n1p1 00:08:18.102 00:08:18.102 01:50:52 -- common/autotest_common.sh@931 -- # return 0 00:08:18.102 01:50:52 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:18.667 01:50:53 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:18.667 01:50:53 -- target/filesystem.sh@25 -- # sync 00:08:18.667 01:50:53 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:18.667 01:50:53 -- target/filesystem.sh@27 -- # sync 00:08:18.925 01:50:53 -- target/filesystem.sh@29 -- # i=0 00:08:18.925 01:50:53 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:18.925 01:50:53 -- target/filesystem.sh@37 -- # kill -0 1105661 00:08:18.925 01:50:53 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:18.925 01:50:53 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:18.925 01:50:53 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:18.925 01:50:53 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:18.925 00:08:18.925 real 0m0.860s 00:08:18.925 user 0m0.017s 00:08:18.925 sys 0m0.107s 00:08:18.925 01:50:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:18.925 01:50:53 -- common/autotest_common.sh@10 -- # set +x 00:08:18.925 ************************************ 00:08:18.925 END TEST filesystem_in_capsule_btrfs 00:08:18.925 ************************************ 00:08:18.925 01:50:53 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:18.925 01:50:53 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:18.925 01:50:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:18.925 01:50:53 -- common/autotest_common.sh@10 -- # set +x 00:08:18.925 ************************************ 00:08:18.925 START TEST filesystem_in_capsule_xfs 00:08:18.925 ************************************ 00:08:18.925 01:50:53 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:18.925 01:50:53 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:18.925 01:50:53 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:18.925 01:50:53 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:18.925 01:50:53 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:18.925 01:50:53 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:18.925 01:50:53 -- common/autotest_common.sh@914 -- # local i=0 00:08:18.925 01:50:53 -- common/autotest_common.sh@915 -- # local force 00:08:18.925 01:50:53 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:18.926 01:50:53 -- common/autotest_common.sh@920 -- # force=-f 00:08:18.926 01:50:53 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:18.926 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:18.926 = sectsz=512 attr=2, projid32bit=1 00:08:18.926 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:18.926 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:18.926 data = bsize=4096 blocks=130560, imaxpct=25 00:08:18.926 = sunit=0 swidth=0 blks 00:08:18.926 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:18.926 log =internal log bsize=4096 blocks=16384, version=2 00:08:18.926 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:18.926 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:19.859 Discarding blocks...Done. 00:08:19.859 01:50:54 -- common/autotest_common.sh@931 -- # return 0 00:08:19.859 01:50:54 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:22.386 01:50:56 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:22.386 01:50:56 -- target/filesystem.sh@25 -- # sync 00:08:22.386 01:50:56 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:22.386 01:50:56 -- target/filesystem.sh@27 -- # sync 00:08:22.386 01:50:56 -- target/filesystem.sh@29 -- # i=0 00:08:22.386 01:50:56 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:22.645 01:50:56 -- target/filesystem.sh@37 -- # kill -0 1105661 00:08:22.645 01:50:56 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:22.645 01:50:56 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:22.645 01:50:56 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:22.645 01:50:56 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:22.645 00:08:22.645 real 0m3.655s 00:08:22.645 user 0m0.013s 00:08:22.645 sys 0m0.067s 00:08:22.645 01:50:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:22.645 01:50:56 -- common/autotest_common.sh@10 -- # set +x 00:08:22.645 ************************************ 00:08:22.645 END TEST filesystem_in_capsule_xfs 00:08:22.645 ************************************ 00:08:22.645 01:50:56 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:22.645 01:50:56 -- target/filesystem.sh@93 -- # sync 00:08:22.645 01:50:56 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:22.645 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.645 01:50:56 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:22.645 01:50:56 -- common/autotest_common.sh@1208 -- # local i=0 00:08:22.645 01:50:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:22.645 01:50:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:22.645 01:50:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:22.645 01:50:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:22.645 01:50:57 -- common/autotest_common.sh@1220 -- # return 0 00:08:22.645 01:50:57 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:22.645 01:50:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.645 01:50:57 -- common/autotest_common.sh@10 -- # set +x 00:08:22.645 01:50:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.645 01:50:57 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:22.645 01:50:57 -- target/filesystem.sh@101 -- # killprocess 1105661 00:08:22.645 01:50:57 -- common/autotest_common.sh@936 -- # '[' -z 1105661 ']' 00:08:22.645 01:50:57 -- common/autotest_common.sh@940 -- # kill -0 1105661 00:08:22.645 01:50:57 -- common/autotest_common.sh@941 -- # uname 00:08:22.645 01:50:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:22.645 01:50:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1105661 00:08:22.903 01:50:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:22.903 01:50:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:22.903 01:50:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1105661' 00:08:22.903 killing process with pid 1105661 00:08:22.903 01:50:57 -- common/autotest_common.sh@955 -- # kill 1105661 00:08:22.903 01:50:57 -- common/autotest_common.sh@960 -- # wait 1105661 00:08:23.161 01:50:57 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:23.161 00:08:23.161 real 0m17.580s 00:08:23.161 user 1m8.084s 00:08:23.161 sys 0m2.257s 00:08:23.161 01:50:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:23.161 01:50:57 -- common/autotest_common.sh@10 -- # set +x 00:08:23.161 ************************************ 00:08:23.161 END TEST nvmf_filesystem_in_capsule 00:08:23.161 ************************************ 00:08:23.161 01:50:57 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:23.161 01:50:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:23.161 01:50:57 -- nvmf/common.sh@116 -- # sync 00:08:23.161 01:50:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:23.161 01:50:57 -- nvmf/common.sh@119 -- # set +e 00:08:23.161 01:50:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:23.161 01:50:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:23.161 rmmod nvme_tcp 00:08:23.161 rmmod nvme_fabrics 00:08:23.161 rmmod nvme_keyring 00:08:23.161 01:50:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:23.161 01:50:57 -- nvmf/common.sh@123 -- # set -e 00:08:23.161 01:50:57 -- nvmf/common.sh@124 -- # return 0 00:08:23.161 01:50:57 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:23.161 01:50:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:23.161 01:50:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:23.161 01:50:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:23.161 01:50:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:23.161 01:50:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:23.161 01:50:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:23.161 01:50:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:23.161 01:50:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:25.697 01:50:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:25.697 00:08:25.697 real 0m39.199s 00:08:25.697 user 2m14.573s 00:08:25.697 sys 0m6.012s 00:08:25.697 01:50:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:25.697 01:50:59 -- common/autotest_common.sh@10 -- # set +x 00:08:25.697 ************************************ 00:08:25.697 END TEST nvmf_filesystem 00:08:25.697 ************************************ 00:08:25.697 01:50:59 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:25.697 01:50:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:25.697 01:50:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:25.697 01:50:59 -- common/autotest_common.sh@10 -- # set +x 00:08:25.697 ************************************ 00:08:25.697 START TEST nvmf_discovery 00:08:25.697 ************************************ 00:08:25.697 01:50:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:25.697 * Looking for test storage... 00:08:25.697 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:25.697 01:50:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:25.697 01:50:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:25.697 01:50:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:25.697 01:50:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:25.697 01:50:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:25.697 01:50:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:25.697 01:50:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:25.697 01:50:59 -- scripts/common.sh@335 -- # IFS=.-: 00:08:25.697 01:50:59 -- scripts/common.sh@335 -- # read -ra ver1 00:08:25.697 01:50:59 -- scripts/common.sh@336 -- # IFS=.-: 00:08:25.697 01:50:59 -- scripts/common.sh@336 -- # read -ra ver2 00:08:25.697 01:50:59 -- scripts/common.sh@337 -- # local 'op=<' 00:08:25.697 01:50:59 -- scripts/common.sh@339 -- # ver1_l=2 00:08:25.697 01:50:59 -- scripts/common.sh@340 -- # ver2_l=1 00:08:25.697 01:50:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:25.697 01:50:59 -- scripts/common.sh@343 -- # case "$op" in 00:08:25.697 01:50:59 -- scripts/common.sh@344 -- # : 1 00:08:25.697 01:50:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:25.697 01:50:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:25.697 01:50:59 -- scripts/common.sh@364 -- # decimal 1 00:08:25.697 01:50:59 -- scripts/common.sh@352 -- # local d=1 00:08:25.697 01:50:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:25.697 01:50:59 -- scripts/common.sh@354 -- # echo 1 00:08:25.697 01:50:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:25.697 01:50:59 -- scripts/common.sh@365 -- # decimal 2 00:08:25.697 01:50:59 -- scripts/common.sh@352 -- # local d=2 00:08:25.697 01:50:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:25.697 01:50:59 -- scripts/common.sh@354 -- # echo 2 00:08:25.697 01:50:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:25.697 01:50:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:25.697 01:50:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:25.697 01:50:59 -- scripts/common.sh@367 -- # return 0 00:08:25.697 01:50:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:25.697 01:50:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:25.697 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:25.697 --rc genhtml_branch_coverage=1 00:08:25.697 --rc genhtml_function_coverage=1 00:08:25.697 --rc genhtml_legend=1 00:08:25.697 --rc geninfo_all_blocks=1 00:08:25.698 --rc geninfo_unexecuted_blocks=1 00:08:25.698 00:08:25.698 ' 00:08:25.698 01:50:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:25.698 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:25.698 --rc genhtml_branch_coverage=1 00:08:25.698 --rc genhtml_function_coverage=1 00:08:25.698 --rc genhtml_legend=1 00:08:25.698 --rc geninfo_all_blocks=1 00:08:25.698 --rc geninfo_unexecuted_blocks=1 00:08:25.698 00:08:25.698 ' 00:08:25.698 01:50:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:25.698 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:25.698 --rc genhtml_branch_coverage=1 00:08:25.698 --rc genhtml_function_coverage=1 00:08:25.698 --rc genhtml_legend=1 00:08:25.698 --rc geninfo_all_blocks=1 00:08:25.698 --rc geninfo_unexecuted_blocks=1 00:08:25.698 00:08:25.698 ' 00:08:25.698 01:50:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:25.698 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:25.698 --rc genhtml_branch_coverage=1 00:08:25.698 --rc genhtml_function_coverage=1 00:08:25.698 --rc genhtml_legend=1 00:08:25.698 --rc geninfo_all_blocks=1 00:08:25.698 --rc geninfo_unexecuted_blocks=1 00:08:25.698 00:08:25.698 ' 00:08:25.698 01:50:59 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:25.698 01:50:59 -- nvmf/common.sh@7 -- # uname -s 00:08:25.698 01:50:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:25.698 01:50:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:25.698 01:50:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:25.698 01:50:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:25.698 01:50:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:25.698 01:50:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:25.698 01:50:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:25.698 01:50:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:25.698 01:50:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:25.698 01:50:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:25.698 01:50:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:25.698 01:50:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:25.698 01:50:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:25.698 01:50:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:25.698 01:50:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:25.698 01:50:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:25.698 01:50:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:25.698 01:50:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:25.698 01:50:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:25.698 01:50:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:25.698 01:50:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:25.698 01:50:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:25.698 01:50:59 -- paths/export.sh@5 -- # export PATH 00:08:25.698 01:50:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:25.698 01:50:59 -- nvmf/common.sh@46 -- # : 0 00:08:25.698 01:50:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:25.698 01:50:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:25.698 01:50:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:25.698 01:50:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:25.698 01:50:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:25.698 01:50:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:25.698 01:50:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:25.698 01:50:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:25.698 01:50:59 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:25.698 01:50:59 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:25.698 01:50:59 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:25.698 01:50:59 -- target/discovery.sh@15 -- # hash nvme 00:08:25.698 01:50:59 -- target/discovery.sh@20 -- # nvmftestinit 00:08:25.698 01:50:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:25.698 01:50:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:25.698 01:50:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:25.698 01:50:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:25.698 01:50:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:25.698 01:50:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:25.698 01:50:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:25.698 01:50:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:25.698 01:50:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:25.698 01:50:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:25.698 01:50:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:25.698 01:50:59 -- common/autotest_common.sh@10 -- # set +x 00:08:27.602 01:51:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:27.602 01:51:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:27.602 01:51:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:27.602 01:51:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:27.602 01:51:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:27.602 01:51:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:27.602 01:51:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:27.602 01:51:01 -- nvmf/common.sh@294 -- # net_devs=() 00:08:27.602 01:51:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:27.602 01:51:01 -- nvmf/common.sh@295 -- # e810=() 00:08:27.602 01:51:01 -- nvmf/common.sh@295 -- # local -ga e810 00:08:27.602 01:51:01 -- nvmf/common.sh@296 -- # x722=() 00:08:27.602 01:51:01 -- nvmf/common.sh@296 -- # local -ga x722 00:08:27.602 01:51:01 -- nvmf/common.sh@297 -- # mlx=() 00:08:27.602 01:51:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:27.602 01:51:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:27.602 01:51:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:27.602 01:51:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:27.602 01:51:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:27.602 01:51:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:27.602 01:51:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:27.602 01:51:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:27.602 01:51:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:27.602 01:51:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:27.602 01:51:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:27.602 01:51:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:27.602 01:51:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:27.602 01:51:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:27.602 01:51:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:27.602 01:51:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:27.602 01:51:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:27.602 01:51:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:27.602 01:51:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:27.602 01:51:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:27.602 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:27.602 01:51:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:27.603 01:51:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:27.603 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:27.603 01:51:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:27.603 01:51:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:27.603 01:51:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:27.603 01:51:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:27.603 01:51:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:27.603 01:51:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:27.603 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:27.603 01:51:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:27.603 01:51:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:27.603 01:51:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:27.603 01:51:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:27.603 01:51:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:27.603 01:51:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:27.603 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:27.603 01:51:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:27.603 01:51:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:27.603 01:51:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:27.603 01:51:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:27.603 01:51:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:27.603 01:51:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:27.603 01:51:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:27.603 01:51:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:27.603 01:51:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:27.603 01:51:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:27.603 01:51:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:27.603 01:51:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:27.603 01:51:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:27.603 01:51:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:27.603 01:51:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:27.603 01:51:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:27.603 01:51:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:27.603 01:51:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:27.603 01:51:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:27.603 01:51:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:27.603 01:51:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:27.603 01:51:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:27.603 01:51:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:27.603 01:51:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:27.603 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:27.603 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:08:27.603 00:08:27.603 --- 10.0.0.2 ping statistics --- 00:08:27.603 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:27.603 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:08:27.603 01:51:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:27.603 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:27.603 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:08:27.603 00:08:27.603 --- 10.0.0.1 ping statistics --- 00:08:27.603 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:27.603 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:08:27.603 01:51:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:27.603 01:51:01 -- nvmf/common.sh@410 -- # return 0 00:08:27.603 01:51:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:27.603 01:51:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:27.603 01:51:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:27.603 01:51:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:27.603 01:51:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:27.603 01:51:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:27.603 01:51:01 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:27.603 01:51:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:27.603 01:51:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:27.603 01:51:01 -- common/autotest_common.sh@10 -- # set +x 00:08:27.603 01:51:01 -- nvmf/common.sh@469 -- # nvmfpid=1110015 00:08:27.603 01:51:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:27.603 01:51:01 -- nvmf/common.sh@470 -- # waitforlisten 1110015 00:08:27.603 01:51:01 -- common/autotest_common.sh@829 -- # '[' -z 1110015 ']' 00:08:27.603 01:51:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:27.603 01:51:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:27.603 01:51:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:27.603 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:27.603 01:51:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:27.603 01:51:01 -- common/autotest_common.sh@10 -- # set +x 00:08:27.861 [2024-11-18 01:51:02.033288] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:27.861 [2024-11-18 01:51:02.033401] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:27.861 EAL: No free 2048 kB hugepages reported on node 1 00:08:27.861 [2024-11-18 01:51:02.103445] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:27.861 [2024-11-18 01:51:02.193156] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:27.861 [2024-11-18 01:51:02.193337] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:27.861 [2024-11-18 01:51:02.193362] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:27.861 [2024-11-18 01:51:02.193377] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:27.861 [2024-11-18 01:51:02.193437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:27.861 [2024-11-18 01:51:02.193507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:27.861 [2024-11-18 01:51:02.193605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:27.861 [2024-11-18 01:51:02.193608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:28.795 01:51:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:28.795 01:51:03 -- common/autotest_common.sh@862 -- # return 0 00:08:28.795 01:51:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:28.795 01:51:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 01:51:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:28.795 01:51:03 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 [2024-11-18 01:51:03.050065] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@26 -- # seq 1 4 00:08:28.795 01:51:03 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:28.795 01:51:03 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 Null1 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 [2024-11-18 01:51:03.090372] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:28.795 01:51:03 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 Null2 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:28.795 01:51:03 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 Null3 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:28.795 01:51:03 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 Null4 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:28.795 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.795 01:51:03 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:28.795 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.795 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.053 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.053 01:51:03 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:29.053 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.053 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.053 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.054 01:51:03 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:29.054 00:08:29.054 Discovery Log Number of Records 6, Generation counter 6 00:08:29.054 =====Discovery Log Entry 0====== 00:08:29.054 trtype: tcp 00:08:29.054 adrfam: ipv4 00:08:29.054 subtype: current discovery subsystem 00:08:29.054 treq: not required 00:08:29.054 portid: 0 00:08:29.054 trsvcid: 4420 00:08:29.054 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:29.054 traddr: 10.0.0.2 00:08:29.054 eflags: explicit discovery connections, duplicate discovery information 00:08:29.054 sectype: none 00:08:29.054 =====Discovery Log Entry 1====== 00:08:29.054 trtype: tcp 00:08:29.054 adrfam: ipv4 00:08:29.054 subtype: nvme subsystem 00:08:29.054 treq: not required 00:08:29.054 portid: 0 00:08:29.054 trsvcid: 4420 00:08:29.054 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:29.054 traddr: 10.0.0.2 00:08:29.054 eflags: none 00:08:29.054 sectype: none 00:08:29.054 =====Discovery Log Entry 2====== 00:08:29.054 trtype: tcp 00:08:29.054 adrfam: ipv4 00:08:29.054 subtype: nvme subsystem 00:08:29.054 treq: not required 00:08:29.054 portid: 0 00:08:29.054 trsvcid: 4420 00:08:29.054 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:29.054 traddr: 10.0.0.2 00:08:29.054 eflags: none 00:08:29.054 sectype: none 00:08:29.054 =====Discovery Log Entry 3====== 00:08:29.054 trtype: tcp 00:08:29.054 adrfam: ipv4 00:08:29.054 subtype: nvme subsystem 00:08:29.054 treq: not required 00:08:29.054 portid: 0 00:08:29.054 trsvcid: 4420 00:08:29.054 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:29.054 traddr: 10.0.0.2 00:08:29.054 eflags: none 00:08:29.054 sectype: none 00:08:29.054 =====Discovery Log Entry 4====== 00:08:29.054 trtype: tcp 00:08:29.054 adrfam: ipv4 00:08:29.054 subtype: nvme subsystem 00:08:29.054 treq: not required 00:08:29.054 portid: 0 00:08:29.054 trsvcid: 4420 00:08:29.054 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:29.054 traddr: 10.0.0.2 00:08:29.054 eflags: none 00:08:29.054 sectype: none 00:08:29.054 =====Discovery Log Entry 5====== 00:08:29.054 trtype: tcp 00:08:29.054 adrfam: ipv4 00:08:29.054 subtype: discovery subsystem referral 00:08:29.054 treq: not required 00:08:29.054 portid: 0 00:08:29.054 trsvcid: 4430 00:08:29.054 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:29.054 traddr: 10.0.0.2 00:08:29.054 eflags: none 00:08:29.054 sectype: none 00:08:29.054 01:51:03 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:29.054 Perform nvmf subsystem discovery via RPC 00:08:29.054 01:51:03 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:29.054 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.054 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.054 [2024-11-18 01:51:03.423281] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:29.054 [ 00:08:29.054 { 00:08:29.054 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:29.054 "subtype": "Discovery", 00:08:29.054 "listen_addresses": [ 00:08:29.054 { 00:08:29.054 "transport": "TCP", 00:08:29.054 "trtype": "TCP", 00:08:29.054 "adrfam": "IPv4", 00:08:29.054 "traddr": "10.0.0.2", 00:08:29.054 "trsvcid": "4420" 00:08:29.054 } 00:08:29.054 ], 00:08:29.054 "allow_any_host": true, 00:08:29.054 "hosts": [] 00:08:29.054 }, 00:08:29.054 { 00:08:29.054 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:29.054 "subtype": "NVMe", 00:08:29.054 "listen_addresses": [ 00:08:29.054 { 00:08:29.054 "transport": "TCP", 00:08:29.054 "trtype": "TCP", 00:08:29.054 "adrfam": "IPv4", 00:08:29.054 "traddr": "10.0.0.2", 00:08:29.054 "trsvcid": "4420" 00:08:29.054 } 00:08:29.054 ], 00:08:29.054 "allow_any_host": true, 00:08:29.054 "hosts": [], 00:08:29.054 "serial_number": "SPDK00000000000001", 00:08:29.054 "model_number": "SPDK bdev Controller", 00:08:29.054 "max_namespaces": 32, 00:08:29.054 "min_cntlid": 1, 00:08:29.054 "max_cntlid": 65519, 00:08:29.054 "namespaces": [ 00:08:29.054 { 00:08:29.054 "nsid": 1, 00:08:29.054 "bdev_name": "Null1", 00:08:29.054 "name": "Null1", 00:08:29.054 "nguid": "D8FF2358EAD14A6D9485FD1E01E36030", 00:08:29.054 "uuid": "d8ff2358-ead1-4a6d-9485-fd1e01e36030" 00:08:29.054 } 00:08:29.054 ] 00:08:29.054 }, 00:08:29.054 { 00:08:29.054 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:29.054 "subtype": "NVMe", 00:08:29.054 "listen_addresses": [ 00:08:29.054 { 00:08:29.054 "transport": "TCP", 00:08:29.054 "trtype": "TCP", 00:08:29.054 "adrfam": "IPv4", 00:08:29.054 "traddr": "10.0.0.2", 00:08:29.054 "trsvcid": "4420" 00:08:29.054 } 00:08:29.054 ], 00:08:29.054 "allow_any_host": true, 00:08:29.054 "hosts": [], 00:08:29.054 "serial_number": "SPDK00000000000002", 00:08:29.054 "model_number": "SPDK bdev Controller", 00:08:29.054 "max_namespaces": 32, 00:08:29.054 "min_cntlid": 1, 00:08:29.054 "max_cntlid": 65519, 00:08:29.054 "namespaces": [ 00:08:29.054 { 00:08:29.054 "nsid": 1, 00:08:29.054 "bdev_name": "Null2", 00:08:29.054 "name": "Null2", 00:08:29.054 "nguid": "F894BA5E11DD40229101C1A80255E210", 00:08:29.054 "uuid": "f894ba5e-11dd-4022-9101-c1a80255e210" 00:08:29.054 } 00:08:29.054 ] 00:08:29.054 }, 00:08:29.054 { 00:08:29.054 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:29.054 "subtype": "NVMe", 00:08:29.054 "listen_addresses": [ 00:08:29.054 { 00:08:29.054 "transport": "TCP", 00:08:29.054 "trtype": "TCP", 00:08:29.054 "adrfam": "IPv4", 00:08:29.054 "traddr": "10.0.0.2", 00:08:29.054 "trsvcid": "4420" 00:08:29.054 } 00:08:29.054 ], 00:08:29.054 "allow_any_host": true, 00:08:29.054 "hosts": [], 00:08:29.054 "serial_number": "SPDK00000000000003", 00:08:29.054 "model_number": "SPDK bdev Controller", 00:08:29.054 "max_namespaces": 32, 00:08:29.054 "min_cntlid": 1, 00:08:29.054 "max_cntlid": 65519, 00:08:29.054 "namespaces": [ 00:08:29.054 { 00:08:29.054 "nsid": 1, 00:08:29.054 "bdev_name": "Null3", 00:08:29.054 "name": "Null3", 00:08:29.054 "nguid": "EB9A0A064C654CB79870F8E8A4E8FEB7", 00:08:29.054 "uuid": "eb9a0a06-4c65-4cb7-9870-f8e8a4e8feb7" 00:08:29.054 } 00:08:29.054 ] 00:08:29.054 }, 00:08:29.054 { 00:08:29.054 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:29.054 "subtype": "NVMe", 00:08:29.054 "listen_addresses": [ 00:08:29.054 { 00:08:29.054 "transport": "TCP", 00:08:29.054 "trtype": "TCP", 00:08:29.054 "adrfam": "IPv4", 00:08:29.054 "traddr": "10.0.0.2", 00:08:29.054 "trsvcid": "4420" 00:08:29.054 } 00:08:29.054 ], 00:08:29.054 "allow_any_host": true, 00:08:29.054 "hosts": [], 00:08:29.054 "serial_number": "SPDK00000000000004", 00:08:29.054 "model_number": "SPDK bdev Controller", 00:08:29.054 "max_namespaces": 32, 00:08:29.054 "min_cntlid": 1, 00:08:29.054 "max_cntlid": 65519, 00:08:29.054 "namespaces": [ 00:08:29.054 { 00:08:29.054 "nsid": 1, 00:08:29.055 "bdev_name": "Null4", 00:08:29.055 "name": "Null4", 00:08:29.055 "nguid": "C87FC50FCBCA410EA345CF5AA050559C", 00:08:29.055 "uuid": "c87fc50f-cbca-410e-a345-cf5aa050559c" 00:08:29.055 } 00:08:29.055 ] 00:08:29.055 } 00:08:29.055 ] 00:08:29.055 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.055 01:51:03 -- target/discovery.sh@42 -- # seq 1 4 00:08:29.055 01:51:03 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:29.055 01:51:03 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:29.055 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.055 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.055 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.055 01:51:03 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:29.055 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.055 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.312 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.313 01:51:03 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:29.313 01:51:03 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:29.313 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.313 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.313 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.313 01:51:03 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:29.313 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.313 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.313 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.313 01:51:03 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:29.313 01:51:03 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:29.313 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.313 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.313 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.313 01:51:03 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:29.313 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.313 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.313 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.313 01:51:03 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:29.313 01:51:03 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:29.313 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.313 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.313 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.313 01:51:03 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:29.313 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.313 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.313 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.313 01:51:03 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:29.313 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.313 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.313 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.313 01:51:03 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:29.313 01:51:03 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:29.313 01:51:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.313 01:51:03 -- common/autotest_common.sh@10 -- # set +x 00:08:29.313 01:51:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.313 01:51:03 -- target/discovery.sh@49 -- # check_bdevs= 00:08:29.313 01:51:03 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:29.313 01:51:03 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:29.313 01:51:03 -- target/discovery.sh@57 -- # nvmftestfini 00:08:29.313 01:51:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:29.313 01:51:03 -- nvmf/common.sh@116 -- # sync 00:08:29.313 01:51:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:29.313 01:51:03 -- nvmf/common.sh@119 -- # set +e 00:08:29.313 01:51:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:29.313 01:51:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:29.313 rmmod nvme_tcp 00:08:29.313 rmmod nvme_fabrics 00:08:29.313 rmmod nvme_keyring 00:08:29.313 01:51:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:29.313 01:51:03 -- nvmf/common.sh@123 -- # set -e 00:08:29.313 01:51:03 -- nvmf/common.sh@124 -- # return 0 00:08:29.313 01:51:03 -- nvmf/common.sh@477 -- # '[' -n 1110015 ']' 00:08:29.313 01:51:03 -- nvmf/common.sh@478 -- # killprocess 1110015 00:08:29.313 01:51:03 -- common/autotest_common.sh@936 -- # '[' -z 1110015 ']' 00:08:29.313 01:51:03 -- common/autotest_common.sh@940 -- # kill -0 1110015 00:08:29.313 01:51:03 -- common/autotest_common.sh@941 -- # uname 00:08:29.313 01:51:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:29.313 01:51:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1110015 00:08:29.313 01:51:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:29.313 01:51:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:29.313 01:51:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1110015' 00:08:29.313 killing process with pid 1110015 00:08:29.313 01:51:03 -- common/autotest_common.sh@955 -- # kill 1110015 00:08:29.313 [2024-11-18 01:51:03.646575] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:29.313 01:51:03 -- common/autotest_common.sh@960 -- # wait 1110015 00:08:29.572 01:51:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:29.572 01:51:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:29.572 01:51:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:29.572 01:51:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:29.572 01:51:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:29.572 01:51:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:29.572 01:51:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:29.572 01:51:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:32.108 01:51:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:32.108 00:08:32.108 real 0m6.282s 00:08:32.108 user 0m7.717s 00:08:32.108 sys 0m1.937s 00:08:32.108 01:51:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:32.108 01:51:05 -- common/autotest_common.sh@10 -- # set +x 00:08:32.108 ************************************ 00:08:32.108 END TEST nvmf_discovery 00:08:32.108 ************************************ 00:08:32.108 01:51:05 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:32.108 01:51:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:32.109 01:51:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:32.109 01:51:05 -- common/autotest_common.sh@10 -- # set +x 00:08:32.109 ************************************ 00:08:32.109 START TEST nvmf_referrals 00:08:32.109 ************************************ 00:08:32.109 01:51:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:32.109 * Looking for test storage... 00:08:32.109 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:32.109 01:51:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:32.109 01:51:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:32.109 01:51:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:32.109 01:51:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:32.109 01:51:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:32.109 01:51:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:32.109 01:51:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:32.109 01:51:06 -- scripts/common.sh@335 -- # IFS=.-: 00:08:32.109 01:51:06 -- scripts/common.sh@335 -- # read -ra ver1 00:08:32.109 01:51:06 -- scripts/common.sh@336 -- # IFS=.-: 00:08:32.109 01:51:06 -- scripts/common.sh@336 -- # read -ra ver2 00:08:32.109 01:51:06 -- scripts/common.sh@337 -- # local 'op=<' 00:08:32.109 01:51:06 -- scripts/common.sh@339 -- # ver1_l=2 00:08:32.109 01:51:06 -- scripts/common.sh@340 -- # ver2_l=1 00:08:32.109 01:51:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:32.109 01:51:06 -- scripts/common.sh@343 -- # case "$op" in 00:08:32.109 01:51:06 -- scripts/common.sh@344 -- # : 1 00:08:32.109 01:51:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:32.109 01:51:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:32.109 01:51:06 -- scripts/common.sh@364 -- # decimal 1 00:08:32.109 01:51:06 -- scripts/common.sh@352 -- # local d=1 00:08:32.109 01:51:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:32.109 01:51:06 -- scripts/common.sh@354 -- # echo 1 00:08:32.109 01:51:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:32.109 01:51:06 -- scripts/common.sh@365 -- # decimal 2 00:08:32.109 01:51:06 -- scripts/common.sh@352 -- # local d=2 00:08:32.109 01:51:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:32.109 01:51:06 -- scripts/common.sh@354 -- # echo 2 00:08:32.109 01:51:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:32.109 01:51:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:32.109 01:51:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:32.109 01:51:06 -- scripts/common.sh@367 -- # return 0 00:08:32.109 01:51:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:32.109 01:51:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:32.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:32.109 --rc genhtml_branch_coverage=1 00:08:32.109 --rc genhtml_function_coverage=1 00:08:32.109 --rc genhtml_legend=1 00:08:32.109 --rc geninfo_all_blocks=1 00:08:32.109 --rc geninfo_unexecuted_blocks=1 00:08:32.109 00:08:32.109 ' 00:08:32.109 01:51:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:32.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:32.109 --rc genhtml_branch_coverage=1 00:08:32.109 --rc genhtml_function_coverage=1 00:08:32.109 --rc genhtml_legend=1 00:08:32.109 --rc geninfo_all_blocks=1 00:08:32.109 --rc geninfo_unexecuted_blocks=1 00:08:32.109 00:08:32.109 ' 00:08:32.109 01:51:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:32.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:32.109 --rc genhtml_branch_coverage=1 00:08:32.109 --rc genhtml_function_coverage=1 00:08:32.109 --rc genhtml_legend=1 00:08:32.109 --rc geninfo_all_blocks=1 00:08:32.109 --rc geninfo_unexecuted_blocks=1 00:08:32.109 00:08:32.109 ' 00:08:32.109 01:51:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:32.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:32.109 --rc genhtml_branch_coverage=1 00:08:32.109 --rc genhtml_function_coverage=1 00:08:32.109 --rc genhtml_legend=1 00:08:32.109 --rc geninfo_all_blocks=1 00:08:32.109 --rc geninfo_unexecuted_blocks=1 00:08:32.109 00:08:32.109 ' 00:08:32.109 01:51:06 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:32.109 01:51:06 -- nvmf/common.sh@7 -- # uname -s 00:08:32.109 01:51:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:32.109 01:51:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:32.109 01:51:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:32.109 01:51:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:32.109 01:51:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:32.109 01:51:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:32.109 01:51:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:32.109 01:51:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:32.109 01:51:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:32.109 01:51:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:32.109 01:51:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:32.109 01:51:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:32.109 01:51:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:32.109 01:51:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:32.109 01:51:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:32.109 01:51:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:32.109 01:51:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:32.109 01:51:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:32.109 01:51:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:32.109 01:51:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:32.109 01:51:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:32.109 01:51:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:32.109 01:51:06 -- paths/export.sh@5 -- # export PATH 00:08:32.109 01:51:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:32.109 01:51:06 -- nvmf/common.sh@46 -- # : 0 00:08:32.109 01:51:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:32.109 01:51:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:32.109 01:51:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:32.109 01:51:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:32.109 01:51:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:32.109 01:51:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:32.109 01:51:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:32.109 01:51:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:32.109 01:51:06 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:32.109 01:51:06 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:32.109 01:51:06 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:32.109 01:51:06 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:32.109 01:51:06 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:32.109 01:51:06 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:32.109 01:51:06 -- target/referrals.sh@37 -- # nvmftestinit 00:08:32.109 01:51:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:32.109 01:51:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:32.109 01:51:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:32.109 01:51:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:32.109 01:51:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:32.109 01:51:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:32.109 01:51:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:32.109 01:51:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:32.109 01:51:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:32.109 01:51:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:32.109 01:51:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:32.109 01:51:06 -- common/autotest_common.sh@10 -- # set +x 00:08:34.009 01:51:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:34.009 01:51:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:34.009 01:51:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:34.009 01:51:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:34.009 01:51:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:34.009 01:51:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:34.009 01:51:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:34.009 01:51:08 -- nvmf/common.sh@294 -- # net_devs=() 00:08:34.009 01:51:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:34.009 01:51:08 -- nvmf/common.sh@295 -- # e810=() 00:08:34.009 01:51:08 -- nvmf/common.sh@295 -- # local -ga e810 00:08:34.009 01:51:08 -- nvmf/common.sh@296 -- # x722=() 00:08:34.009 01:51:08 -- nvmf/common.sh@296 -- # local -ga x722 00:08:34.009 01:51:08 -- nvmf/common.sh@297 -- # mlx=() 00:08:34.009 01:51:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:34.009 01:51:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:34.009 01:51:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:34.009 01:51:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:34.009 01:51:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:34.009 01:51:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:34.009 01:51:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:34.009 01:51:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:34.009 01:51:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:34.009 01:51:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:34.009 01:51:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:34.009 01:51:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:34.009 01:51:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:34.009 01:51:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:34.009 01:51:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:34.009 01:51:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:34.009 01:51:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:34.009 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:34.009 01:51:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:34.009 01:51:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:34.009 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:34.009 01:51:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:34.009 01:51:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:34.009 01:51:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:34.009 01:51:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:34.009 01:51:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:34.009 01:51:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:34.009 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:34.009 01:51:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:34.009 01:51:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:34.009 01:51:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:34.009 01:51:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:34.009 01:51:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:34.009 01:51:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:34.009 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:34.009 01:51:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:34.009 01:51:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:34.009 01:51:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:34.009 01:51:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:34.009 01:51:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:34.009 01:51:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:34.009 01:51:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:34.009 01:51:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:34.009 01:51:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:34.009 01:51:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:34.009 01:51:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:34.009 01:51:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:34.009 01:51:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:34.009 01:51:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:34.009 01:51:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:34.009 01:51:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:34.009 01:51:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:34.009 01:51:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:34.009 01:51:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:34.009 01:51:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:34.009 01:51:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:34.009 01:51:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:34.009 01:51:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:34.009 01:51:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:34.009 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:34.009 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:08:34.009 00:08:34.009 --- 10.0.0.2 ping statistics --- 00:08:34.009 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:34.009 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:08:34.009 01:51:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:34.009 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:34.009 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:08:34.009 00:08:34.009 --- 10.0.0.1 ping statistics --- 00:08:34.009 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:34.009 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:08:34.009 01:51:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:34.009 01:51:08 -- nvmf/common.sh@410 -- # return 0 00:08:34.009 01:51:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:34.009 01:51:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:34.009 01:51:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:34.009 01:51:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:34.009 01:51:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:34.009 01:51:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:34.009 01:51:08 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:34.009 01:51:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:34.009 01:51:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:34.009 01:51:08 -- common/autotest_common.sh@10 -- # set +x 00:08:34.009 01:51:08 -- nvmf/common.sh@469 -- # nvmfpid=1112621 00:08:34.009 01:51:08 -- nvmf/common.sh@470 -- # waitforlisten 1112621 00:08:34.009 01:51:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:34.009 01:51:08 -- common/autotest_common.sh@829 -- # '[' -z 1112621 ']' 00:08:34.010 01:51:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:34.010 01:51:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:34.010 01:51:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:34.010 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:34.010 01:51:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:34.010 01:51:08 -- common/autotest_common.sh@10 -- # set +x 00:08:34.010 [2024-11-18 01:51:08.392805] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:34.010 [2024-11-18 01:51:08.392886] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:34.267 EAL: No free 2048 kB hugepages reported on node 1 00:08:34.267 [2024-11-18 01:51:08.475004] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:34.267 [2024-11-18 01:51:08.574487] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:34.267 [2024-11-18 01:51:08.574678] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:34.267 [2024-11-18 01:51:08.574710] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:34.267 [2024-11-18 01:51:08.574742] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:34.268 [2024-11-18 01:51:08.574822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:34.268 [2024-11-18 01:51:08.574950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:34.268 [2024-11-18 01:51:08.574992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:34.268 [2024-11-18 01:51:08.575000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:34.525 01:51:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:34.525 01:51:08 -- common/autotest_common.sh@862 -- # return 0 00:08:34.525 01:51:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:34.525 01:51:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:34.525 01:51:08 -- common/autotest_common.sh@10 -- # set +x 00:08:34.525 01:51:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:34.525 01:51:08 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:34.525 01:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.525 01:51:08 -- common/autotest_common.sh@10 -- # set +x 00:08:34.525 [2024-11-18 01:51:08.764810] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:34.525 01:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.525 01:51:08 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:08:34.525 01:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.525 01:51:08 -- common/autotest_common.sh@10 -- # set +x 00:08:34.525 [2024-11-18 01:51:08.777015] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:08:34.525 01:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.525 01:51:08 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:08:34.525 01:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.525 01:51:08 -- common/autotest_common.sh@10 -- # set +x 00:08:34.525 01:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.525 01:51:08 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:08:34.525 01:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.525 01:51:08 -- common/autotest_common.sh@10 -- # set +x 00:08:34.525 01:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.525 01:51:08 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:08:34.525 01:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.525 01:51:08 -- common/autotest_common.sh@10 -- # set +x 00:08:34.525 01:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.525 01:51:08 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:34.525 01:51:08 -- target/referrals.sh@48 -- # jq length 00:08:34.525 01:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.525 01:51:08 -- common/autotest_common.sh@10 -- # set +x 00:08:34.525 01:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.525 01:51:08 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:34.525 01:51:08 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:34.525 01:51:08 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:34.526 01:51:08 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:34.526 01:51:08 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:34.526 01:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.526 01:51:08 -- common/autotest_common.sh@10 -- # set +x 00:08:34.526 01:51:08 -- target/referrals.sh@21 -- # sort 00:08:34.526 01:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.526 01:51:08 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:34.526 01:51:08 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:34.526 01:51:08 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:34.526 01:51:08 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:34.526 01:51:08 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:34.526 01:51:08 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:34.526 01:51:08 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:34.526 01:51:08 -- target/referrals.sh@26 -- # sort 00:08:34.783 01:51:09 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:34.783 01:51:09 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:34.783 01:51:09 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:08:34.783 01:51:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.783 01:51:09 -- common/autotest_common.sh@10 -- # set +x 00:08:34.783 01:51:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.783 01:51:09 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:08:34.783 01:51:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.783 01:51:09 -- common/autotest_common.sh@10 -- # set +x 00:08:34.783 01:51:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.783 01:51:09 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:08:34.783 01:51:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.783 01:51:09 -- common/autotest_common.sh@10 -- # set +x 00:08:34.783 01:51:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.783 01:51:09 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:34.783 01:51:09 -- target/referrals.sh@56 -- # jq length 00:08:34.783 01:51:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.783 01:51:09 -- common/autotest_common.sh@10 -- # set +x 00:08:34.783 01:51:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.783 01:51:09 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:34.783 01:51:09 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:34.783 01:51:09 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:34.783 01:51:09 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:34.783 01:51:09 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:34.783 01:51:09 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:34.783 01:51:09 -- target/referrals.sh@26 -- # sort 00:08:35.041 01:51:09 -- target/referrals.sh@26 -- # echo 00:08:35.041 01:51:09 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:35.041 01:51:09 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:08:35.041 01:51:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.041 01:51:09 -- common/autotest_common.sh@10 -- # set +x 00:08:35.041 01:51:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.041 01:51:09 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:35.041 01:51:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.041 01:51:09 -- common/autotest_common.sh@10 -- # set +x 00:08:35.041 01:51:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.041 01:51:09 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:35.041 01:51:09 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:35.041 01:51:09 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:35.041 01:51:09 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:35.041 01:51:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.041 01:51:09 -- common/autotest_common.sh@10 -- # set +x 00:08:35.041 01:51:09 -- target/referrals.sh@21 -- # sort 00:08:35.041 01:51:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.041 01:51:09 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:35.041 01:51:09 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:35.041 01:51:09 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:35.041 01:51:09 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:35.041 01:51:09 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:35.041 01:51:09 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:35.041 01:51:09 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:35.041 01:51:09 -- target/referrals.sh@26 -- # sort 00:08:35.299 01:51:09 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:35.299 01:51:09 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:35.299 01:51:09 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:35.299 01:51:09 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:35.299 01:51:09 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:35.299 01:51:09 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:35.299 01:51:09 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:35.557 01:51:09 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:35.557 01:51:09 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:35.557 01:51:09 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:35.557 01:51:09 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:35.557 01:51:09 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:35.557 01:51:09 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:35.815 01:51:10 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:35.815 01:51:10 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:35.815 01:51:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.815 01:51:10 -- common/autotest_common.sh@10 -- # set +x 00:08:35.815 01:51:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.815 01:51:10 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:35.815 01:51:10 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:35.815 01:51:10 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:35.815 01:51:10 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:35.815 01:51:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.815 01:51:10 -- common/autotest_common.sh@10 -- # set +x 00:08:35.815 01:51:10 -- target/referrals.sh@21 -- # sort 00:08:35.815 01:51:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.815 01:51:10 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:35.815 01:51:10 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:35.815 01:51:10 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:35.815 01:51:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:35.815 01:51:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:35.815 01:51:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:35.815 01:51:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:35.815 01:51:10 -- target/referrals.sh@26 -- # sort 00:08:35.815 01:51:10 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:35.815 01:51:10 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:35.815 01:51:10 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:35.815 01:51:10 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:35.815 01:51:10 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:35.815 01:51:10 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:35.815 01:51:10 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:36.072 01:51:10 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:36.072 01:51:10 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:36.072 01:51:10 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:36.072 01:51:10 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:36.072 01:51:10 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:36.072 01:51:10 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:36.329 01:51:10 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:36.329 01:51:10 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:36.329 01:51:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:36.329 01:51:10 -- common/autotest_common.sh@10 -- # set +x 00:08:36.329 01:51:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:36.329 01:51:10 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:36.329 01:51:10 -- target/referrals.sh@82 -- # jq length 00:08:36.329 01:51:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:36.329 01:51:10 -- common/autotest_common.sh@10 -- # set +x 00:08:36.329 01:51:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:36.329 01:51:10 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:36.329 01:51:10 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:36.329 01:51:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:36.329 01:51:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:36.329 01:51:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:36.329 01:51:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:36.329 01:51:10 -- target/referrals.sh@26 -- # sort 00:08:36.329 01:51:10 -- target/referrals.sh@26 -- # echo 00:08:36.329 01:51:10 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:36.329 01:51:10 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:36.329 01:51:10 -- target/referrals.sh@86 -- # nvmftestfini 00:08:36.329 01:51:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:36.329 01:51:10 -- nvmf/common.sh@116 -- # sync 00:08:36.329 01:51:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:36.329 01:51:10 -- nvmf/common.sh@119 -- # set +e 00:08:36.329 01:51:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:36.329 01:51:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:36.329 rmmod nvme_tcp 00:08:36.329 rmmod nvme_fabrics 00:08:36.587 rmmod nvme_keyring 00:08:36.587 01:51:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:36.587 01:51:10 -- nvmf/common.sh@123 -- # set -e 00:08:36.587 01:51:10 -- nvmf/common.sh@124 -- # return 0 00:08:36.587 01:51:10 -- nvmf/common.sh@477 -- # '[' -n 1112621 ']' 00:08:36.587 01:51:10 -- nvmf/common.sh@478 -- # killprocess 1112621 00:08:36.587 01:51:10 -- common/autotest_common.sh@936 -- # '[' -z 1112621 ']' 00:08:36.588 01:51:10 -- common/autotest_common.sh@940 -- # kill -0 1112621 00:08:36.588 01:51:10 -- common/autotest_common.sh@941 -- # uname 00:08:36.588 01:51:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:36.588 01:51:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1112621 00:08:36.588 01:51:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:36.588 01:51:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:36.588 01:51:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1112621' 00:08:36.588 killing process with pid 1112621 00:08:36.588 01:51:10 -- common/autotest_common.sh@955 -- # kill 1112621 00:08:36.588 01:51:10 -- common/autotest_common.sh@960 -- # wait 1112621 00:08:36.847 01:51:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:36.847 01:51:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:36.847 01:51:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:36.847 01:51:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:36.847 01:51:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:36.847 01:51:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:36.847 01:51:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:36.847 01:51:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:38.754 01:51:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:38.754 00:08:38.754 real 0m7.153s 00:08:38.754 user 0m11.380s 00:08:38.754 sys 0m2.309s 00:08:38.754 01:51:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:38.754 01:51:13 -- common/autotest_common.sh@10 -- # set +x 00:08:38.754 ************************************ 00:08:38.754 END TEST nvmf_referrals 00:08:38.754 ************************************ 00:08:38.754 01:51:13 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:38.754 01:51:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:38.754 01:51:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:38.754 01:51:13 -- common/autotest_common.sh@10 -- # set +x 00:08:38.754 ************************************ 00:08:38.754 START TEST nvmf_connect_disconnect 00:08:38.754 ************************************ 00:08:38.754 01:51:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:39.013 * Looking for test storage... 00:08:39.013 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:39.014 01:51:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:39.014 01:51:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:39.014 01:51:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:39.014 01:51:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:39.014 01:51:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:39.014 01:51:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:39.014 01:51:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:39.014 01:51:13 -- scripts/common.sh@335 -- # IFS=.-: 00:08:39.014 01:51:13 -- scripts/common.sh@335 -- # read -ra ver1 00:08:39.014 01:51:13 -- scripts/common.sh@336 -- # IFS=.-: 00:08:39.014 01:51:13 -- scripts/common.sh@336 -- # read -ra ver2 00:08:39.014 01:51:13 -- scripts/common.sh@337 -- # local 'op=<' 00:08:39.014 01:51:13 -- scripts/common.sh@339 -- # ver1_l=2 00:08:39.014 01:51:13 -- scripts/common.sh@340 -- # ver2_l=1 00:08:39.014 01:51:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:39.014 01:51:13 -- scripts/common.sh@343 -- # case "$op" in 00:08:39.014 01:51:13 -- scripts/common.sh@344 -- # : 1 00:08:39.014 01:51:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:39.014 01:51:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:39.014 01:51:13 -- scripts/common.sh@364 -- # decimal 1 00:08:39.014 01:51:13 -- scripts/common.sh@352 -- # local d=1 00:08:39.014 01:51:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:39.014 01:51:13 -- scripts/common.sh@354 -- # echo 1 00:08:39.014 01:51:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:39.014 01:51:13 -- scripts/common.sh@365 -- # decimal 2 00:08:39.014 01:51:13 -- scripts/common.sh@352 -- # local d=2 00:08:39.014 01:51:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:39.014 01:51:13 -- scripts/common.sh@354 -- # echo 2 00:08:39.014 01:51:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:39.014 01:51:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:39.014 01:51:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:39.014 01:51:13 -- scripts/common.sh@367 -- # return 0 00:08:39.014 01:51:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:39.014 01:51:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:39.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:39.014 --rc genhtml_branch_coverage=1 00:08:39.014 --rc genhtml_function_coverage=1 00:08:39.014 --rc genhtml_legend=1 00:08:39.014 --rc geninfo_all_blocks=1 00:08:39.014 --rc geninfo_unexecuted_blocks=1 00:08:39.014 00:08:39.014 ' 00:08:39.014 01:51:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:39.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:39.014 --rc genhtml_branch_coverage=1 00:08:39.014 --rc genhtml_function_coverage=1 00:08:39.014 --rc genhtml_legend=1 00:08:39.014 --rc geninfo_all_blocks=1 00:08:39.014 --rc geninfo_unexecuted_blocks=1 00:08:39.014 00:08:39.014 ' 00:08:39.014 01:51:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:39.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:39.014 --rc genhtml_branch_coverage=1 00:08:39.014 --rc genhtml_function_coverage=1 00:08:39.014 --rc genhtml_legend=1 00:08:39.014 --rc geninfo_all_blocks=1 00:08:39.014 --rc geninfo_unexecuted_blocks=1 00:08:39.014 00:08:39.014 ' 00:08:39.014 01:51:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:39.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:39.014 --rc genhtml_branch_coverage=1 00:08:39.014 --rc genhtml_function_coverage=1 00:08:39.014 --rc genhtml_legend=1 00:08:39.014 --rc geninfo_all_blocks=1 00:08:39.014 --rc geninfo_unexecuted_blocks=1 00:08:39.014 00:08:39.014 ' 00:08:39.014 01:51:13 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:39.014 01:51:13 -- nvmf/common.sh@7 -- # uname -s 00:08:39.014 01:51:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:39.014 01:51:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:39.014 01:51:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:39.014 01:51:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:39.014 01:51:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:39.014 01:51:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:39.014 01:51:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:39.014 01:51:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:39.014 01:51:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:39.014 01:51:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:39.014 01:51:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:39.014 01:51:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:39.014 01:51:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:39.014 01:51:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:39.014 01:51:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:39.014 01:51:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:39.014 01:51:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:39.014 01:51:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:39.014 01:51:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:39.014 01:51:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:39.014 01:51:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:39.014 01:51:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:39.014 01:51:13 -- paths/export.sh@5 -- # export PATH 00:08:39.014 01:51:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:39.014 01:51:13 -- nvmf/common.sh@46 -- # : 0 00:08:39.014 01:51:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:39.014 01:51:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:39.014 01:51:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:39.014 01:51:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:39.014 01:51:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:39.014 01:51:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:39.014 01:51:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:39.014 01:51:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:39.014 01:51:13 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:39.014 01:51:13 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:39.014 01:51:13 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:39.014 01:51:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:39.014 01:51:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:39.014 01:51:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:39.014 01:51:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:39.014 01:51:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:39.014 01:51:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:39.014 01:51:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:39.014 01:51:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:39.014 01:51:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:39.014 01:51:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:39.014 01:51:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:39.014 01:51:13 -- common/autotest_common.sh@10 -- # set +x 00:08:40.915 01:51:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:40.915 01:51:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:40.916 01:51:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:40.916 01:51:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:40.916 01:51:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:40.916 01:51:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:40.916 01:51:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:40.916 01:51:15 -- nvmf/common.sh@294 -- # net_devs=() 00:08:40.916 01:51:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:40.916 01:51:15 -- nvmf/common.sh@295 -- # e810=() 00:08:40.916 01:51:15 -- nvmf/common.sh@295 -- # local -ga e810 00:08:40.916 01:51:15 -- nvmf/common.sh@296 -- # x722=() 00:08:40.916 01:51:15 -- nvmf/common.sh@296 -- # local -ga x722 00:08:40.916 01:51:15 -- nvmf/common.sh@297 -- # mlx=() 00:08:40.916 01:51:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:40.916 01:51:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:40.916 01:51:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:40.916 01:51:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:40.916 01:51:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:40.916 01:51:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:40.916 01:51:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:40.916 01:51:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:40.916 01:51:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:40.916 01:51:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:40.916 01:51:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:40.916 01:51:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:40.916 01:51:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:40.916 01:51:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:40.916 01:51:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:40.916 01:51:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:40.916 01:51:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:40.916 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:40.916 01:51:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:40.916 01:51:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:40.916 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:40.916 01:51:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:40.916 01:51:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:40.916 01:51:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:40.916 01:51:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:40.916 01:51:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:40.916 01:51:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:40.916 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:40.916 01:51:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:40.916 01:51:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:40.916 01:51:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:40.916 01:51:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:40.916 01:51:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:40.916 01:51:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:40.916 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:40.916 01:51:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:40.916 01:51:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:40.916 01:51:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:40.916 01:51:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:40.916 01:51:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:40.916 01:51:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:40.916 01:51:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:40.916 01:51:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:40.916 01:51:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:40.916 01:51:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:40.916 01:51:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:40.916 01:51:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:40.916 01:51:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:40.916 01:51:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:40.916 01:51:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:40.916 01:51:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:40.916 01:51:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:40.916 01:51:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:41.174 01:51:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:41.174 01:51:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:41.174 01:51:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:41.174 01:51:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:41.174 01:51:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:41.174 01:51:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:41.174 01:51:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:41.174 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:41.174 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:08:41.174 00:08:41.174 --- 10.0.0.2 ping statistics --- 00:08:41.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:41.174 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:08:41.174 01:51:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:41.174 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:41.174 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:08:41.174 00:08:41.174 --- 10.0.0.1 ping statistics --- 00:08:41.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:41.174 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:08:41.174 01:51:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:41.174 01:51:15 -- nvmf/common.sh@410 -- # return 0 00:08:41.174 01:51:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:41.174 01:51:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:41.174 01:51:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:41.174 01:51:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:41.174 01:51:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:41.174 01:51:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:41.174 01:51:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:41.174 01:51:15 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:41.174 01:51:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:41.174 01:51:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:41.174 01:51:15 -- common/autotest_common.sh@10 -- # set +x 00:08:41.174 01:51:15 -- nvmf/common.sh@469 -- # nvmfpid=1115088 00:08:41.174 01:51:15 -- nvmf/common.sh@470 -- # waitforlisten 1115088 00:08:41.174 01:51:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:41.174 01:51:15 -- common/autotest_common.sh@829 -- # '[' -z 1115088 ']' 00:08:41.174 01:51:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:41.174 01:51:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:41.174 01:51:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:41.175 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:41.175 01:51:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:41.175 01:51:15 -- common/autotest_common.sh@10 -- # set +x 00:08:41.175 [2024-11-18 01:51:15.493926] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:41.175 [2024-11-18 01:51:15.494008] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:41.175 EAL: No free 2048 kB hugepages reported on node 1 00:08:41.175 [2024-11-18 01:51:15.567678] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:41.433 [2024-11-18 01:51:15.660502] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:41.433 [2024-11-18 01:51:15.660663] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:41.433 [2024-11-18 01:51:15.660683] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:41.433 [2024-11-18 01:51:15.660698] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:41.433 [2024-11-18 01:51:15.660784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:41.433 [2024-11-18 01:51:15.660819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:41.433 [2024-11-18 01:51:15.660870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:41.433 [2024-11-18 01:51:15.660872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:42.369 01:51:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:42.369 01:51:16 -- common/autotest_common.sh@862 -- # return 0 00:08:42.369 01:51:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:42.369 01:51:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:42.369 01:51:16 -- common/autotest_common.sh@10 -- # set +x 00:08:42.369 01:51:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:42.369 01:51:16 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:42.369 01:51:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:42.369 01:51:16 -- common/autotest_common.sh@10 -- # set +x 00:08:42.369 [2024-11-18 01:51:16.505029] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:42.369 01:51:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:42.369 01:51:16 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:42.369 01:51:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:42.369 01:51:16 -- common/autotest_common.sh@10 -- # set +x 00:08:42.369 01:51:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:42.369 01:51:16 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:42.369 01:51:16 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:42.369 01:51:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:42.369 01:51:16 -- common/autotest_common.sh@10 -- # set +x 00:08:42.369 01:51:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:42.369 01:51:16 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:42.369 01:51:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:42.369 01:51:16 -- common/autotest_common.sh@10 -- # set +x 00:08:42.369 01:51:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:42.369 01:51:16 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:42.369 01:51:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:42.369 01:51:16 -- common/autotest_common.sh@10 -- # set +x 00:08:42.369 [2024-11-18 01:51:16.556120] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:42.369 01:51:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:42.369 01:51:16 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:08:42.369 01:51:16 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:08:42.369 01:51:16 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:08:42.369 01:51:16 -- target/connect_disconnect.sh@34 -- # set +x 00:08:44.896 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:47.445 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.389 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.916 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:54.442 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.337 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.863 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:01.391 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.289 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.816 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.715 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.241 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.768 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.667 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.196 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.721 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.618 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.143 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.725 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.251 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.150 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.676 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.571 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.097 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.618 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.143 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.670 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.570 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.097 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.626 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.528 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.053 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.582 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.501 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.029 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.557 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.458 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.985 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.513 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.412 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.941 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.471 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.368 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.897 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.796 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.325 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.854 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.753 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.280 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.886 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.784 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.312 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.839 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.738 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.267 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.797 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.696 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.223 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.749 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.645 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.171 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.697 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.592 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.119 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.646 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.625 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.151 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.676 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.573 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.099 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.623 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.148 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.045 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.570 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.095 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.993 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.519 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.045 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.567 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.464 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.990 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.962 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.485 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.007 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.905 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.433 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.969 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.504 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.402 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.928 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.455 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.354 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.887 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.415 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.314 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.842 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:28.398 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.316 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.843 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.741 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.741 01:55:09 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:34.741 01:55:09 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:34.741 01:55:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:34.741 01:55:09 -- nvmf/common.sh@116 -- # sync 00:12:34.741 01:55:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:34.741 01:55:09 -- nvmf/common.sh@119 -- # set +e 00:12:34.741 01:55:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:34.741 01:55:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:34.741 rmmod nvme_tcp 00:12:34.741 rmmod nvme_fabrics 00:12:34.741 rmmod nvme_keyring 00:12:34.741 01:55:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:34.741 01:55:09 -- nvmf/common.sh@123 -- # set -e 00:12:34.741 01:55:09 -- nvmf/common.sh@124 -- # return 0 00:12:34.741 01:55:09 -- nvmf/common.sh@477 -- # '[' -n 1115088 ']' 00:12:34.741 01:55:09 -- nvmf/common.sh@478 -- # killprocess 1115088 00:12:34.741 01:55:09 -- common/autotest_common.sh@936 -- # '[' -z 1115088 ']' 00:12:34.741 01:55:09 -- common/autotest_common.sh@940 -- # kill -0 1115088 00:12:34.741 01:55:09 -- common/autotest_common.sh@941 -- # uname 00:12:34.999 01:55:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:34.999 01:55:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1115088 00:12:34.999 01:55:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:34.999 01:55:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:34.999 01:55:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1115088' 00:12:34.999 killing process with pid 1115088 00:12:34.999 01:55:09 -- common/autotest_common.sh@955 -- # kill 1115088 00:12:34.999 01:55:09 -- common/autotest_common.sh@960 -- # wait 1115088 00:12:35.258 01:55:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:35.258 01:55:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:35.258 01:55:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:35.258 01:55:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:35.258 01:55:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:35.258 01:55:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:35.258 01:55:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:35.258 01:55:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:37.161 01:55:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:37.161 00:12:37.161 real 3m58.344s 00:12:37.161 user 15m9.158s 00:12:37.161 sys 0m35.030s 00:12:37.161 01:55:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:37.161 01:55:11 -- common/autotest_common.sh@10 -- # set +x 00:12:37.161 ************************************ 00:12:37.161 END TEST nvmf_connect_disconnect 00:12:37.161 ************************************ 00:12:37.161 01:55:11 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:37.161 01:55:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:37.161 01:55:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:37.161 01:55:11 -- common/autotest_common.sh@10 -- # set +x 00:12:37.161 ************************************ 00:12:37.161 START TEST nvmf_multitarget 00:12:37.161 ************************************ 00:12:37.161 01:55:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:37.161 * Looking for test storage... 00:12:37.161 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:37.161 01:55:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:37.161 01:55:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:37.161 01:55:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:37.420 01:55:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:37.420 01:55:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:37.420 01:55:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:37.420 01:55:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:37.420 01:55:11 -- scripts/common.sh@335 -- # IFS=.-: 00:12:37.420 01:55:11 -- scripts/common.sh@335 -- # read -ra ver1 00:12:37.420 01:55:11 -- scripts/common.sh@336 -- # IFS=.-: 00:12:37.420 01:55:11 -- scripts/common.sh@336 -- # read -ra ver2 00:12:37.420 01:55:11 -- scripts/common.sh@337 -- # local 'op=<' 00:12:37.420 01:55:11 -- scripts/common.sh@339 -- # ver1_l=2 00:12:37.420 01:55:11 -- scripts/common.sh@340 -- # ver2_l=1 00:12:37.420 01:55:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:37.420 01:55:11 -- scripts/common.sh@343 -- # case "$op" in 00:12:37.420 01:55:11 -- scripts/common.sh@344 -- # : 1 00:12:37.420 01:55:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:37.420 01:55:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:37.420 01:55:11 -- scripts/common.sh@364 -- # decimal 1 00:12:37.420 01:55:11 -- scripts/common.sh@352 -- # local d=1 00:12:37.420 01:55:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:37.420 01:55:11 -- scripts/common.sh@354 -- # echo 1 00:12:37.420 01:55:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:37.420 01:55:11 -- scripts/common.sh@365 -- # decimal 2 00:12:37.420 01:55:11 -- scripts/common.sh@352 -- # local d=2 00:12:37.420 01:55:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:37.420 01:55:11 -- scripts/common.sh@354 -- # echo 2 00:12:37.420 01:55:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:37.420 01:55:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:37.420 01:55:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:37.420 01:55:11 -- scripts/common.sh@367 -- # return 0 00:12:37.420 01:55:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:37.420 01:55:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:37.420 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:37.420 --rc genhtml_branch_coverage=1 00:12:37.420 --rc genhtml_function_coverage=1 00:12:37.420 --rc genhtml_legend=1 00:12:37.420 --rc geninfo_all_blocks=1 00:12:37.420 --rc geninfo_unexecuted_blocks=1 00:12:37.420 00:12:37.420 ' 00:12:37.420 01:55:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:37.420 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:37.420 --rc genhtml_branch_coverage=1 00:12:37.420 --rc genhtml_function_coverage=1 00:12:37.420 --rc genhtml_legend=1 00:12:37.420 --rc geninfo_all_blocks=1 00:12:37.420 --rc geninfo_unexecuted_blocks=1 00:12:37.420 00:12:37.420 ' 00:12:37.420 01:55:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:37.420 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:37.420 --rc genhtml_branch_coverage=1 00:12:37.420 --rc genhtml_function_coverage=1 00:12:37.420 --rc genhtml_legend=1 00:12:37.420 --rc geninfo_all_blocks=1 00:12:37.420 --rc geninfo_unexecuted_blocks=1 00:12:37.420 00:12:37.420 ' 00:12:37.420 01:55:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:37.420 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:37.420 --rc genhtml_branch_coverage=1 00:12:37.420 --rc genhtml_function_coverage=1 00:12:37.420 --rc genhtml_legend=1 00:12:37.420 --rc geninfo_all_blocks=1 00:12:37.420 --rc geninfo_unexecuted_blocks=1 00:12:37.420 00:12:37.420 ' 00:12:37.420 01:55:11 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:37.420 01:55:11 -- nvmf/common.sh@7 -- # uname -s 00:12:37.420 01:55:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:37.420 01:55:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:37.420 01:55:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:37.420 01:55:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:37.420 01:55:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:37.420 01:55:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:37.420 01:55:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:37.420 01:55:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:37.420 01:55:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:37.420 01:55:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:37.420 01:55:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:37.421 01:55:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:37.421 01:55:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:37.421 01:55:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:37.421 01:55:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:37.421 01:55:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:37.421 01:55:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:37.421 01:55:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:37.421 01:55:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:37.421 01:55:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.421 01:55:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.421 01:55:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.421 01:55:11 -- paths/export.sh@5 -- # export PATH 00:12:37.421 01:55:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.421 01:55:11 -- nvmf/common.sh@46 -- # : 0 00:12:37.421 01:55:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:37.421 01:55:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:37.421 01:55:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:37.421 01:55:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:37.421 01:55:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:37.421 01:55:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:37.421 01:55:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:37.421 01:55:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:37.421 01:55:11 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:37.421 01:55:11 -- target/multitarget.sh@15 -- # nvmftestinit 00:12:37.421 01:55:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:37.421 01:55:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:37.421 01:55:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:37.421 01:55:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:37.421 01:55:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:37.421 01:55:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:37.421 01:55:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:37.421 01:55:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:37.421 01:55:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:37.421 01:55:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:37.421 01:55:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:37.421 01:55:11 -- common/autotest_common.sh@10 -- # set +x 00:12:39.344 01:55:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:39.344 01:55:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:39.344 01:55:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:39.344 01:55:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:39.344 01:55:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:39.344 01:55:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:39.344 01:55:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:39.344 01:55:13 -- nvmf/common.sh@294 -- # net_devs=() 00:12:39.344 01:55:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:39.344 01:55:13 -- nvmf/common.sh@295 -- # e810=() 00:12:39.344 01:55:13 -- nvmf/common.sh@295 -- # local -ga e810 00:12:39.344 01:55:13 -- nvmf/common.sh@296 -- # x722=() 00:12:39.344 01:55:13 -- nvmf/common.sh@296 -- # local -ga x722 00:12:39.344 01:55:13 -- nvmf/common.sh@297 -- # mlx=() 00:12:39.344 01:55:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:39.344 01:55:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:39.344 01:55:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:39.344 01:55:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:39.344 01:55:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:39.344 01:55:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:39.344 01:55:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:39.344 01:55:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:39.344 01:55:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:39.344 01:55:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:39.344 01:55:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:39.344 01:55:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:39.344 01:55:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:39.344 01:55:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:39.344 01:55:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:39.344 01:55:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:39.344 01:55:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:39.344 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:39.344 01:55:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:39.344 01:55:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:39.344 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:39.344 01:55:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:39.344 01:55:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:39.344 01:55:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:39.344 01:55:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:39.344 01:55:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:39.344 01:55:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:39.344 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:39.344 01:55:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:39.344 01:55:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:39.344 01:55:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:39.344 01:55:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:39.344 01:55:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:39.344 01:55:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:39.344 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:39.344 01:55:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:39.344 01:55:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:39.344 01:55:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:39.344 01:55:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:39.344 01:55:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:39.344 01:55:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:39.344 01:55:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:39.344 01:55:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:39.344 01:55:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:39.344 01:55:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:39.344 01:55:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:39.344 01:55:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:39.344 01:55:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:39.344 01:55:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:39.344 01:55:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:39.344 01:55:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:39.344 01:55:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:39.344 01:55:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:39.603 01:55:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:39.603 01:55:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:39.603 01:55:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:39.603 01:55:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:39.603 01:55:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:39.603 01:55:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:39.603 01:55:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:39.603 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:39.603 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:12:39.603 00:12:39.603 --- 10.0.0.2 ping statistics --- 00:12:39.603 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:39.603 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:12:39.603 01:55:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:39.603 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:39.603 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:12:39.603 00:12:39.603 --- 10.0.0.1 ping statistics --- 00:12:39.603 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:39.603 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:12:39.603 01:55:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:39.603 01:55:13 -- nvmf/common.sh@410 -- # return 0 00:12:39.603 01:55:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:39.603 01:55:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:39.603 01:55:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:39.603 01:55:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:39.603 01:55:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:39.603 01:55:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:39.603 01:55:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:39.603 01:55:13 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:12:39.603 01:55:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:39.603 01:55:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:39.603 01:55:13 -- common/autotest_common.sh@10 -- # set +x 00:12:39.603 01:55:13 -- nvmf/common.sh@469 -- # nvmfpid=1147286 00:12:39.603 01:55:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:39.603 01:55:13 -- nvmf/common.sh@470 -- # waitforlisten 1147286 00:12:39.603 01:55:13 -- common/autotest_common.sh@829 -- # '[' -z 1147286 ']' 00:12:39.603 01:55:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:39.603 01:55:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:39.603 01:55:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:39.603 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:39.603 01:55:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:39.603 01:55:13 -- common/autotest_common.sh@10 -- # set +x 00:12:39.603 [2024-11-18 01:55:13.982986] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:12:39.603 [2024-11-18 01:55:13.983061] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:39.862 EAL: No free 2048 kB hugepages reported on node 1 00:12:39.862 [2024-11-18 01:55:14.058320] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:39.862 [2024-11-18 01:55:14.158244] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:39.862 [2024-11-18 01:55:14.158421] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:39.862 [2024-11-18 01:55:14.158444] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:39.862 [2024-11-18 01:55:14.158459] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:39.862 [2024-11-18 01:55:14.158518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:39.862 [2024-11-18 01:55:14.158590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:39.862 [2024-11-18 01:55:14.158555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:39.862 [2024-11-18 01:55:14.158592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:40.796 01:55:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:40.796 01:55:15 -- common/autotest_common.sh@862 -- # return 0 00:12:40.796 01:55:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:40.796 01:55:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:40.796 01:55:15 -- common/autotest_common.sh@10 -- # set +x 00:12:40.796 01:55:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:40.796 01:55:15 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:40.796 01:55:15 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:40.796 01:55:15 -- target/multitarget.sh@21 -- # jq length 00:12:41.054 01:55:15 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:41.054 01:55:15 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:41.054 "nvmf_tgt_1" 00:12:41.054 01:55:15 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:41.054 "nvmf_tgt_2" 00:12:41.054 01:55:15 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:41.054 01:55:15 -- target/multitarget.sh@28 -- # jq length 00:12:41.312 01:55:15 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:41.312 01:55:15 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:41.312 true 00:12:41.313 01:55:15 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:41.571 true 00:12:41.571 01:55:15 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:41.571 01:55:15 -- target/multitarget.sh@35 -- # jq length 00:12:41.571 01:55:15 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:41.571 01:55:15 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:41.571 01:55:15 -- target/multitarget.sh@41 -- # nvmftestfini 00:12:41.571 01:55:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:41.571 01:55:15 -- nvmf/common.sh@116 -- # sync 00:12:41.571 01:55:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:41.571 01:55:15 -- nvmf/common.sh@119 -- # set +e 00:12:41.571 01:55:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:41.571 01:55:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:41.571 rmmod nvme_tcp 00:12:41.571 rmmod nvme_fabrics 00:12:41.571 rmmod nvme_keyring 00:12:41.829 01:55:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:41.829 01:55:15 -- nvmf/common.sh@123 -- # set -e 00:12:41.829 01:55:15 -- nvmf/common.sh@124 -- # return 0 00:12:41.829 01:55:15 -- nvmf/common.sh@477 -- # '[' -n 1147286 ']' 00:12:41.829 01:55:15 -- nvmf/common.sh@478 -- # killprocess 1147286 00:12:41.829 01:55:15 -- common/autotest_common.sh@936 -- # '[' -z 1147286 ']' 00:12:41.829 01:55:15 -- common/autotest_common.sh@940 -- # kill -0 1147286 00:12:41.829 01:55:15 -- common/autotest_common.sh@941 -- # uname 00:12:41.829 01:55:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:41.829 01:55:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1147286 00:12:41.829 01:55:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:41.829 01:55:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:41.829 01:55:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1147286' 00:12:41.829 killing process with pid 1147286 00:12:41.829 01:55:16 -- common/autotest_common.sh@955 -- # kill 1147286 00:12:41.829 01:55:16 -- common/autotest_common.sh@960 -- # wait 1147286 00:12:42.088 01:55:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:42.088 01:55:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:42.088 01:55:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:42.088 01:55:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:42.088 01:55:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:42.088 01:55:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:42.088 01:55:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:42.088 01:55:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:43.996 01:55:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:43.996 00:12:43.996 real 0m6.785s 00:12:43.996 user 0m10.127s 00:12:43.996 sys 0m2.087s 00:12:43.996 01:55:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:43.996 01:55:18 -- common/autotest_common.sh@10 -- # set +x 00:12:43.996 ************************************ 00:12:43.996 END TEST nvmf_multitarget 00:12:43.996 ************************************ 00:12:43.996 01:55:18 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:43.996 01:55:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:43.996 01:55:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:43.996 01:55:18 -- common/autotest_common.sh@10 -- # set +x 00:12:43.996 ************************************ 00:12:43.996 START TEST nvmf_rpc 00:12:43.996 ************************************ 00:12:43.996 01:55:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:43.996 * Looking for test storage... 00:12:43.996 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:43.996 01:55:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:43.996 01:55:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:43.996 01:55:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:44.255 01:55:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:44.255 01:55:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:44.255 01:55:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:44.255 01:55:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:44.255 01:55:18 -- scripts/common.sh@335 -- # IFS=.-: 00:12:44.255 01:55:18 -- scripts/common.sh@335 -- # read -ra ver1 00:12:44.255 01:55:18 -- scripts/common.sh@336 -- # IFS=.-: 00:12:44.255 01:55:18 -- scripts/common.sh@336 -- # read -ra ver2 00:12:44.255 01:55:18 -- scripts/common.sh@337 -- # local 'op=<' 00:12:44.255 01:55:18 -- scripts/common.sh@339 -- # ver1_l=2 00:12:44.255 01:55:18 -- scripts/common.sh@340 -- # ver2_l=1 00:12:44.255 01:55:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:44.255 01:55:18 -- scripts/common.sh@343 -- # case "$op" in 00:12:44.255 01:55:18 -- scripts/common.sh@344 -- # : 1 00:12:44.255 01:55:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:44.255 01:55:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:44.255 01:55:18 -- scripts/common.sh@364 -- # decimal 1 00:12:44.255 01:55:18 -- scripts/common.sh@352 -- # local d=1 00:12:44.255 01:55:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:44.255 01:55:18 -- scripts/common.sh@354 -- # echo 1 00:12:44.255 01:55:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:44.255 01:55:18 -- scripts/common.sh@365 -- # decimal 2 00:12:44.255 01:55:18 -- scripts/common.sh@352 -- # local d=2 00:12:44.255 01:55:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:44.255 01:55:18 -- scripts/common.sh@354 -- # echo 2 00:12:44.255 01:55:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:44.255 01:55:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:44.255 01:55:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:44.255 01:55:18 -- scripts/common.sh@367 -- # return 0 00:12:44.255 01:55:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:44.255 01:55:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:44.255 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:44.255 --rc genhtml_branch_coverage=1 00:12:44.255 --rc genhtml_function_coverage=1 00:12:44.255 --rc genhtml_legend=1 00:12:44.255 --rc geninfo_all_blocks=1 00:12:44.255 --rc geninfo_unexecuted_blocks=1 00:12:44.255 00:12:44.255 ' 00:12:44.255 01:55:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:44.255 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:44.255 --rc genhtml_branch_coverage=1 00:12:44.255 --rc genhtml_function_coverage=1 00:12:44.255 --rc genhtml_legend=1 00:12:44.255 --rc geninfo_all_blocks=1 00:12:44.255 --rc geninfo_unexecuted_blocks=1 00:12:44.255 00:12:44.255 ' 00:12:44.255 01:55:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:44.255 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:44.255 --rc genhtml_branch_coverage=1 00:12:44.255 --rc genhtml_function_coverage=1 00:12:44.255 --rc genhtml_legend=1 00:12:44.255 --rc geninfo_all_blocks=1 00:12:44.255 --rc geninfo_unexecuted_blocks=1 00:12:44.255 00:12:44.255 ' 00:12:44.255 01:55:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:44.255 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:44.255 --rc genhtml_branch_coverage=1 00:12:44.255 --rc genhtml_function_coverage=1 00:12:44.255 --rc genhtml_legend=1 00:12:44.255 --rc geninfo_all_blocks=1 00:12:44.255 --rc geninfo_unexecuted_blocks=1 00:12:44.255 00:12:44.255 ' 00:12:44.255 01:55:18 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:44.256 01:55:18 -- nvmf/common.sh@7 -- # uname -s 00:12:44.256 01:55:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:44.256 01:55:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:44.256 01:55:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:44.256 01:55:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:44.256 01:55:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:44.256 01:55:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:44.256 01:55:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:44.256 01:55:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:44.256 01:55:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:44.256 01:55:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:44.256 01:55:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:44.256 01:55:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:44.256 01:55:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:44.256 01:55:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:44.256 01:55:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:44.256 01:55:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:44.256 01:55:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:44.256 01:55:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:44.256 01:55:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:44.256 01:55:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:44.256 01:55:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:44.256 01:55:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:44.256 01:55:18 -- paths/export.sh@5 -- # export PATH 00:12:44.256 01:55:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:44.256 01:55:18 -- nvmf/common.sh@46 -- # : 0 00:12:44.256 01:55:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:44.256 01:55:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:44.256 01:55:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:44.256 01:55:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:44.256 01:55:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:44.256 01:55:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:44.256 01:55:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:44.256 01:55:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:44.256 01:55:18 -- target/rpc.sh@11 -- # loops=5 00:12:44.256 01:55:18 -- target/rpc.sh@23 -- # nvmftestinit 00:12:44.256 01:55:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:44.256 01:55:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:44.256 01:55:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:44.256 01:55:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:44.256 01:55:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:44.256 01:55:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:44.256 01:55:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:44.256 01:55:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:44.256 01:55:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:44.256 01:55:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:44.256 01:55:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:44.256 01:55:18 -- common/autotest_common.sh@10 -- # set +x 00:12:46.160 01:55:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:46.160 01:55:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:46.160 01:55:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:46.160 01:55:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:46.160 01:55:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:46.160 01:55:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:46.160 01:55:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:46.160 01:55:20 -- nvmf/common.sh@294 -- # net_devs=() 00:12:46.160 01:55:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:46.160 01:55:20 -- nvmf/common.sh@295 -- # e810=() 00:12:46.161 01:55:20 -- nvmf/common.sh@295 -- # local -ga e810 00:12:46.161 01:55:20 -- nvmf/common.sh@296 -- # x722=() 00:12:46.161 01:55:20 -- nvmf/common.sh@296 -- # local -ga x722 00:12:46.161 01:55:20 -- nvmf/common.sh@297 -- # mlx=() 00:12:46.161 01:55:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:46.161 01:55:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:46.161 01:55:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:46.161 01:55:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:46.161 01:55:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:46.161 01:55:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:46.161 01:55:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:46.161 01:55:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:46.161 01:55:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:46.161 01:55:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:46.161 01:55:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:46.161 01:55:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:46.161 01:55:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:46.161 01:55:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:46.161 01:55:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:46.161 01:55:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:46.161 01:55:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:46.161 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:46.161 01:55:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:46.161 01:55:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:46.161 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:46.161 01:55:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:46.161 01:55:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:46.161 01:55:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:46.161 01:55:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:46.161 01:55:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:46.161 01:55:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:46.161 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:46.161 01:55:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:46.161 01:55:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:46.161 01:55:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:46.161 01:55:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:46.161 01:55:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:46.161 01:55:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:46.161 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:46.161 01:55:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:46.161 01:55:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:46.161 01:55:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:46.161 01:55:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:46.161 01:55:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:46.161 01:55:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:46.161 01:55:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:46.161 01:55:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:46.161 01:55:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:46.161 01:55:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:46.161 01:55:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:46.161 01:55:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:46.161 01:55:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:46.161 01:55:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:46.161 01:55:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:46.161 01:55:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:46.161 01:55:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:46.419 01:55:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:46.419 01:55:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:46.419 01:55:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:46.419 01:55:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:46.419 01:55:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:46.419 01:55:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:46.420 01:55:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:46.420 01:55:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:46.420 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:46.420 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.174 ms 00:12:46.420 00:12:46.420 --- 10.0.0.2 ping statistics --- 00:12:46.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:46.420 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:12:46.420 01:55:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:46.420 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:46.420 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:12:46.420 00:12:46.420 --- 10.0.0.1 ping statistics --- 00:12:46.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:46.420 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:12:46.420 01:55:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:46.420 01:55:20 -- nvmf/common.sh@410 -- # return 0 00:12:46.420 01:55:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:46.420 01:55:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:46.420 01:55:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:46.420 01:55:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:46.420 01:55:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:46.420 01:55:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:46.420 01:55:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:46.420 01:55:20 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:46.420 01:55:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:46.420 01:55:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:46.420 01:55:20 -- common/autotest_common.sh@10 -- # set +x 00:12:46.420 01:55:20 -- nvmf/common.sh@469 -- # nvmfpid=1149544 00:12:46.420 01:55:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:46.420 01:55:20 -- nvmf/common.sh@470 -- # waitforlisten 1149544 00:12:46.420 01:55:20 -- common/autotest_common.sh@829 -- # '[' -z 1149544 ']' 00:12:46.420 01:55:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:46.420 01:55:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:46.420 01:55:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:46.420 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:46.420 01:55:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:46.420 01:55:20 -- common/autotest_common.sh@10 -- # set +x 00:12:46.420 [2024-11-18 01:55:20.753886] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:12:46.420 [2024-11-18 01:55:20.753970] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:46.420 EAL: No free 2048 kB hugepages reported on node 1 00:12:46.678 [2024-11-18 01:55:20.826969] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:46.678 [2024-11-18 01:55:20.918957] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:46.678 [2024-11-18 01:55:20.919118] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:46.678 [2024-11-18 01:55:20.919137] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:46.678 [2024-11-18 01:55:20.919152] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:46.678 [2024-11-18 01:55:20.919231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:46.678 [2024-11-18 01:55:20.919267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:46.678 [2024-11-18 01:55:20.919335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:46.678 [2024-11-18 01:55:20.919338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:47.614 01:55:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:47.614 01:55:21 -- common/autotest_common.sh@862 -- # return 0 00:12:47.614 01:55:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:47.614 01:55:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:47.614 01:55:21 -- common/autotest_common.sh@10 -- # set +x 00:12:47.614 01:55:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:47.614 01:55:21 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:47.614 01:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.614 01:55:21 -- common/autotest_common.sh@10 -- # set +x 00:12:47.614 01:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.614 01:55:21 -- target/rpc.sh@26 -- # stats='{ 00:12:47.614 "tick_rate": 2700000000, 00:12:47.614 "poll_groups": [ 00:12:47.614 { 00:12:47.614 "name": "nvmf_tgt_poll_group_0", 00:12:47.614 "admin_qpairs": 0, 00:12:47.614 "io_qpairs": 0, 00:12:47.614 "current_admin_qpairs": 0, 00:12:47.614 "current_io_qpairs": 0, 00:12:47.614 "pending_bdev_io": 0, 00:12:47.614 "completed_nvme_io": 0, 00:12:47.614 "transports": [] 00:12:47.614 }, 00:12:47.614 { 00:12:47.614 "name": "nvmf_tgt_poll_group_1", 00:12:47.614 "admin_qpairs": 0, 00:12:47.614 "io_qpairs": 0, 00:12:47.614 "current_admin_qpairs": 0, 00:12:47.614 "current_io_qpairs": 0, 00:12:47.614 "pending_bdev_io": 0, 00:12:47.614 "completed_nvme_io": 0, 00:12:47.614 "transports": [] 00:12:47.614 }, 00:12:47.614 { 00:12:47.614 "name": "nvmf_tgt_poll_group_2", 00:12:47.614 "admin_qpairs": 0, 00:12:47.614 "io_qpairs": 0, 00:12:47.614 "current_admin_qpairs": 0, 00:12:47.614 "current_io_qpairs": 0, 00:12:47.614 "pending_bdev_io": 0, 00:12:47.614 "completed_nvme_io": 0, 00:12:47.614 "transports": [] 00:12:47.614 }, 00:12:47.614 { 00:12:47.614 "name": "nvmf_tgt_poll_group_3", 00:12:47.614 "admin_qpairs": 0, 00:12:47.614 "io_qpairs": 0, 00:12:47.614 "current_admin_qpairs": 0, 00:12:47.614 "current_io_qpairs": 0, 00:12:47.614 "pending_bdev_io": 0, 00:12:47.614 "completed_nvme_io": 0, 00:12:47.614 "transports": [] 00:12:47.615 } 00:12:47.615 ] 00:12:47.615 }' 00:12:47.615 01:55:21 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:47.615 01:55:21 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:47.615 01:55:21 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:47.615 01:55:21 -- target/rpc.sh@15 -- # wc -l 00:12:47.615 01:55:21 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:47.615 01:55:21 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:47.615 01:55:21 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:47.615 01:55:21 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:47.615 01:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.615 01:55:21 -- common/autotest_common.sh@10 -- # set +x 00:12:47.615 [2024-11-18 01:55:21.830185] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:47.615 01:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.615 01:55:21 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:47.615 01:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.615 01:55:21 -- common/autotest_common.sh@10 -- # set +x 00:12:47.615 01:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.615 01:55:21 -- target/rpc.sh@33 -- # stats='{ 00:12:47.615 "tick_rate": 2700000000, 00:12:47.615 "poll_groups": [ 00:12:47.615 { 00:12:47.615 "name": "nvmf_tgt_poll_group_0", 00:12:47.615 "admin_qpairs": 0, 00:12:47.615 "io_qpairs": 0, 00:12:47.615 "current_admin_qpairs": 0, 00:12:47.615 "current_io_qpairs": 0, 00:12:47.615 "pending_bdev_io": 0, 00:12:47.615 "completed_nvme_io": 0, 00:12:47.615 "transports": [ 00:12:47.615 { 00:12:47.615 "trtype": "TCP" 00:12:47.615 } 00:12:47.615 ] 00:12:47.615 }, 00:12:47.615 { 00:12:47.615 "name": "nvmf_tgt_poll_group_1", 00:12:47.615 "admin_qpairs": 0, 00:12:47.615 "io_qpairs": 0, 00:12:47.615 "current_admin_qpairs": 0, 00:12:47.615 "current_io_qpairs": 0, 00:12:47.615 "pending_bdev_io": 0, 00:12:47.615 "completed_nvme_io": 0, 00:12:47.615 "transports": [ 00:12:47.615 { 00:12:47.615 "trtype": "TCP" 00:12:47.615 } 00:12:47.615 ] 00:12:47.615 }, 00:12:47.615 { 00:12:47.615 "name": "nvmf_tgt_poll_group_2", 00:12:47.615 "admin_qpairs": 0, 00:12:47.615 "io_qpairs": 0, 00:12:47.615 "current_admin_qpairs": 0, 00:12:47.615 "current_io_qpairs": 0, 00:12:47.615 "pending_bdev_io": 0, 00:12:47.615 "completed_nvme_io": 0, 00:12:47.615 "transports": [ 00:12:47.615 { 00:12:47.615 "trtype": "TCP" 00:12:47.615 } 00:12:47.615 ] 00:12:47.615 }, 00:12:47.615 { 00:12:47.615 "name": "nvmf_tgt_poll_group_3", 00:12:47.615 "admin_qpairs": 0, 00:12:47.615 "io_qpairs": 0, 00:12:47.615 "current_admin_qpairs": 0, 00:12:47.615 "current_io_qpairs": 0, 00:12:47.615 "pending_bdev_io": 0, 00:12:47.615 "completed_nvme_io": 0, 00:12:47.615 "transports": [ 00:12:47.615 { 00:12:47.615 "trtype": "TCP" 00:12:47.615 } 00:12:47.615 ] 00:12:47.615 } 00:12:47.615 ] 00:12:47.615 }' 00:12:47.615 01:55:21 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:47.615 01:55:21 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:47.615 01:55:21 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:47.615 01:55:21 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:47.615 01:55:21 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:47.615 01:55:21 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:47.615 01:55:21 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:47.615 01:55:21 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:47.615 01:55:21 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:47.615 01:55:21 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:47.615 01:55:21 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:47.615 01:55:21 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:47.615 01:55:21 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:47.615 01:55:21 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:47.615 01:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.615 01:55:21 -- common/autotest_common.sh@10 -- # set +x 00:12:47.615 Malloc1 00:12:47.615 01:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.615 01:55:21 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:47.615 01:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.615 01:55:21 -- common/autotest_common.sh@10 -- # set +x 00:12:47.615 01:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.615 01:55:21 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:47.615 01:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.615 01:55:21 -- common/autotest_common.sh@10 -- # set +x 00:12:47.615 01:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.615 01:55:21 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:47.615 01:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.615 01:55:21 -- common/autotest_common.sh@10 -- # set +x 00:12:47.615 01:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.615 01:55:21 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:47.615 01:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.615 01:55:21 -- common/autotest_common.sh@10 -- # set +x 00:12:47.615 [2024-11-18 01:55:21.983790] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:47.615 01:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.615 01:55:21 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:47.615 01:55:21 -- common/autotest_common.sh@650 -- # local es=0 00:12:47.615 01:55:21 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:47.615 01:55:21 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:47.615 01:55:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:47.615 01:55:21 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:47.615 01:55:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:47.615 01:55:21 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:47.615 01:55:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:47.615 01:55:21 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:47.615 01:55:21 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:47.615 01:55:21 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:47.615 [2024-11-18 01:55:22.006332] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:47.874 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:47.874 could not add new controller: failed to write to nvme-fabrics device 00:12:47.874 01:55:22 -- common/autotest_common.sh@653 -- # es=1 00:12:47.874 01:55:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:47.874 01:55:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:47.874 01:55:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:47.874 01:55:22 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:47.874 01:55:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.874 01:55:22 -- common/autotest_common.sh@10 -- # set +x 00:12:47.874 01:55:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.874 01:55:22 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:48.440 01:55:22 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:48.440 01:55:22 -- common/autotest_common.sh@1187 -- # local i=0 00:12:48.440 01:55:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:48.440 01:55:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:48.440 01:55:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:50.341 01:55:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:50.341 01:55:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:50.341 01:55:24 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:50.341 01:55:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:50.341 01:55:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:50.341 01:55:24 -- common/autotest_common.sh@1197 -- # return 0 00:12:50.341 01:55:24 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:50.599 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:50.599 01:55:24 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:50.599 01:55:24 -- common/autotest_common.sh@1208 -- # local i=0 00:12:50.599 01:55:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:50.599 01:55:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:50.599 01:55:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:50.599 01:55:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:50.599 01:55:24 -- common/autotest_common.sh@1220 -- # return 0 00:12:50.599 01:55:24 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:50.599 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:50.599 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:12:50.599 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:50.599 01:55:24 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:50.599 01:55:24 -- common/autotest_common.sh@650 -- # local es=0 00:12:50.599 01:55:24 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:50.599 01:55:24 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:50.599 01:55:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:50.599 01:55:24 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:50.599 01:55:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:50.599 01:55:24 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:50.599 01:55:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:50.599 01:55:24 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:50.599 01:55:24 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:50.599 01:55:24 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:50.599 [2024-11-18 01:55:24.805046] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:50.599 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:50.599 could not add new controller: failed to write to nvme-fabrics device 00:12:50.599 01:55:24 -- common/autotest_common.sh@653 -- # es=1 00:12:50.599 01:55:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:50.599 01:55:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:50.599 01:55:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:50.599 01:55:24 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:50.599 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:50.599 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:12:50.599 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:50.599 01:55:24 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:51.166 01:55:25 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:51.166 01:55:25 -- common/autotest_common.sh@1187 -- # local i=0 00:12:51.166 01:55:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:51.166 01:55:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:51.166 01:55:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:53.067 01:55:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:53.067 01:55:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:53.067 01:55:27 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:53.067 01:55:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:53.067 01:55:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:53.067 01:55:27 -- common/autotest_common.sh@1197 -- # return 0 00:12:53.067 01:55:27 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:53.325 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.325 01:55:27 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:53.325 01:55:27 -- common/autotest_common.sh@1208 -- # local i=0 00:12:53.325 01:55:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:53.325 01:55:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:53.325 01:55:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:53.325 01:55:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:53.325 01:55:27 -- common/autotest_common.sh@1220 -- # return 0 00:12:53.325 01:55:27 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:53.325 01:55:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:53.325 01:55:27 -- common/autotest_common.sh@10 -- # set +x 00:12:53.325 01:55:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:53.325 01:55:27 -- target/rpc.sh@81 -- # seq 1 5 00:12:53.325 01:55:27 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:53.325 01:55:27 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:53.325 01:55:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:53.325 01:55:27 -- common/autotest_common.sh@10 -- # set +x 00:12:53.325 01:55:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:53.325 01:55:27 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:53.325 01:55:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:53.325 01:55:27 -- common/autotest_common.sh@10 -- # set +x 00:12:53.325 [2024-11-18 01:55:27.588898] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:53.325 01:55:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:53.325 01:55:27 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:53.325 01:55:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:53.325 01:55:27 -- common/autotest_common.sh@10 -- # set +x 00:12:53.325 01:55:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:53.325 01:55:27 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:53.325 01:55:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:53.325 01:55:27 -- common/autotest_common.sh@10 -- # set +x 00:12:53.325 01:55:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:53.325 01:55:27 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:54.259 01:55:28 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:54.259 01:55:28 -- common/autotest_common.sh@1187 -- # local i=0 00:12:54.259 01:55:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:54.259 01:55:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:54.259 01:55:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:56.160 01:55:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:56.160 01:55:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:56.160 01:55:30 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:56.160 01:55:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:56.160 01:55:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:56.160 01:55:30 -- common/autotest_common.sh@1197 -- # return 0 00:12:56.160 01:55:30 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:56.160 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:56.160 01:55:30 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:56.160 01:55:30 -- common/autotest_common.sh@1208 -- # local i=0 00:12:56.160 01:55:30 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:56.160 01:55:30 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:56.160 01:55:30 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:56.160 01:55:30 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:56.160 01:55:30 -- common/autotest_common.sh@1220 -- # return 0 00:12:56.160 01:55:30 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:56.160 01:55:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.160 01:55:30 -- common/autotest_common.sh@10 -- # set +x 00:12:56.160 01:55:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.160 01:55:30 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:56.160 01:55:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.160 01:55:30 -- common/autotest_common.sh@10 -- # set +x 00:12:56.160 01:55:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.160 01:55:30 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:56.160 01:55:30 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:56.160 01:55:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.160 01:55:30 -- common/autotest_common.sh@10 -- # set +x 00:12:56.160 01:55:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.160 01:55:30 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:56.160 01:55:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.160 01:55:30 -- common/autotest_common.sh@10 -- # set +x 00:12:56.160 [2024-11-18 01:55:30.411708] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:56.160 01:55:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.160 01:55:30 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:56.160 01:55:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.160 01:55:30 -- common/autotest_common.sh@10 -- # set +x 00:12:56.160 01:55:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.160 01:55:30 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:56.160 01:55:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.160 01:55:30 -- common/autotest_common.sh@10 -- # set +x 00:12:56.160 01:55:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.160 01:55:30 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:56.727 01:55:31 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:56.727 01:55:31 -- common/autotest_common.sh@1187 -- # local i=0 00:12:56.727 01:55:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:56.727 01:55:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:56.727 01:55:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:59.261 01:55:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:59.261 01:55:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:59.261 01:55:33 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:59.261 01:55:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:59.261 01:55:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:59.261 01:55:33 -- common/autotest_common.sh@1197 -- # return 0 00:12:59.261 01:55:33 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:59.261 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:59.261 01:55:33 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:59.261 01:55:33 -- common/autotest_common.sh@1208 -- # local i=0 00:12:59.261 01:55:33 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:59.261 01:55:33 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:59.261 01:55:33 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:59.261 01:55:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:59.261 01:55:33 -- common/autotest_common.sh@1220 -- # return 0 00:12:59.261 01:55:33 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:59.261 01:55:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.261 01:55:33 -- common/autotest_common.sh@10 -- # set +x 00:12:59.261 01:55:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.261 01:55:33 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:59.261 01:55:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.261 01:55:33 -- common/autotest_common.sh@10 -- # set +x 00:12:59.261 01:55:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.261 01:55:33 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:59.261 01:55:33 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:59.261 01:55:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.261 01:55:33 -- common/autotest_common.sh@10 -- # set +x 00:12:59.261 01:55:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.261 01:55:33 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:59.261 01:55:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.261 01:55:33 -- common/autotest_common.sh@10 -- # set +x 00:12:59.261 [2024-11-18 01:55:33.153330] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:59.261 01:55:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.261 01:55:33 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:59.261 01:55:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.261 01:55:33 -- common/autotest_common.sh@10 -- # set +x 00:12:59.261 01:55:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.261 01:55:33 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:59.261 01:55:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.261 01:55:33 -- common/autotest_common.sh@10 -- # set +x 00:12:59.261 01:55:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.261 01:55:33 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:59.563 01:55:33 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:59.563 01:55:33 -- common/autotest_common.sh@1187 -- # local i=0 00:12:59.563 01:55:33 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:59.563 01:55:33 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:59.563 01:55:33 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:01.487 01:55:35 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:01.487 01:55:35 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:01.487 01:55:35 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:01.487 01:55:35 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:01.487 01:55:35 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:01.487 01:55:35 -- common/autotest_common.sh@1197 -- # return 0 00:13:01.487 01:55:35 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:01.487 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:01.487 01:55:35 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:01.487 01:55:35 -- common/autotest_common.sh@1208 -- # local i=0 00:13:01.487 01:55:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:01.487 01:55:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:01.746 01:55:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:01.746 01:55:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:01.746 01:55:35 -- common/autotest_common.sh@1220 -- # return 0 00:13:01.746 01:55:35 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:01.746 01:55:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.746 01:55:35 -- common/autotest_common.sh@10 -- # set +x 00:13:01.746 01:55:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.746 01:55:35 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:01.746 01:55:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.746 01:55:35 -- common/autotest_common.sh@10 -- # set +x 00:13:01.746 01:55:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.746 01:55:35 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:01.746 01:55:35 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:01.746 01:55:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.746 01:55:35 -- common/autotest_common.sh@10 -- # set +x 00:13:01.746 01:55:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.746 01:55:35 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:01.746 01:55:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.746 01:55:35 -- common/autotest_common.sh@10 -- # set +x 00:13:01.746 [2024-11-18 01:55:35.933306] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:01.746 01:55:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.746 01:55:35 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:01.746 01:55:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.746 01:55:35 -- common/autotest_common.sh@10 -- # set +x 00:13:01.746 01:55:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.746 01:55:35 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:01.746 01:55:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.746 01:55:35 -- common/autotest_common.sh@10 -- # set +x 00:13:01.746 01:55:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.746 01:55:35 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:02.312 01:55:36 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:02.312 01:55:36 -- common/autotest_common.sh@1187 -- # local i=0 00:13:02.312 01:55:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:02.312 01:55:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:02.312 01:55:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:04.212 01:55:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:04.212 01:55:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:04.212 01:55:38 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:04.212 01:55:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:04.212 01:55:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:04.212 01:55:38 -- common/autotest_common.sh@1197 -- # return 0 00:13:04.212 01:55:38 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:04.470 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:04.470 01:55:38 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:04.470 01:55:38 -- common/autotest_common.sh@1208 -- # local i=0 00:13:04.470 01:55:38 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:04.470 01:55:38 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:04.470 01:55:38 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:04.471 01:55:38 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:04.471 01:55:38 -- common/autotest_common.sh@1220 -- # return 0 00:13:04.471 01:55:38 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:04.471 01:55:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.471 01:55:38 -- common/autotest_common.sh@10 -- # set +x 00:13:04.471 01:55:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.471 01:55:38 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:04.471 01:55:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.471 01:55:38 -- common/autotest_common.sh@10 -- # set +x 00:13:04.471 01:55:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.471 01:55:38 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:04.471 01:55:38 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:04.471 01:55:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.471 01:55:38 -- common/autotest_common.sh@10 -- # set +x 00:13:04.471 01:55:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.471 01:55:38 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:04.471 01:55:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.471 01:55:38 -- common/autotest_common.sh@10 -- # set +x 00:13:04.471 [2024-11-18 01:55:38.748889] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:04.471 01:55:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.471 01:55:38 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:04.471 01:55:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.471 01:55:38 -- common/autotest_common.sh@10 -- # set +x 00:13:04.471 01:55:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.471 01:55:38 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:04.471 01:55:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.471 01:55:38 -- common/autotest_common.sh@10 -- # set +x 00:13:04.471 01:55:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.471 01:55:38 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:05.404 01:55:39 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:05.404 01:55:39 -- common/autotest_common.sh@1187 -- # local i=0 00:13:05.404 01:55:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:05.404 01:55:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:05.404 01:55:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:07.304 01:55:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:07.304 01:55:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:07.304 01:55:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:07.304 01:55:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:07.304 01:55:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:07.304 01:55:41 -- common/autotest_common.sh@1197 -- # return 0 00:13:07.304 01:55:41 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:07.304 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:07.304 01:55:41 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:07.304 01:55:41 -- common/autotest_common.sh@1208 -- # local i=0 00:13:07.304 01:55:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:07.304 01:55:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:07.304 01:55:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:07.304 01:55:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:07.304 01:55:41 -- common/autotest_common.sh@1220 -- # return 0 00:13:07.304 01:55:41 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:07.304 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.304 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.304 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.304 01:55:41 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:07.304 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.304 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.304 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.304 01:55:41 -- target/rpc.sh@99 -- # seq 1 5 00:13:07.304 01:55:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:07.304 01:55:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:07.304 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.304 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.304 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.304 01:55:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:07.304 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.304 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.304 [2024-11-18 01:55:41.635243] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:07.304 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.304 01:55:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:07.304 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.304 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.304 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.304 01:55:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:07.305 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.305 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.305 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.305 01:55:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.305 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.305 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.305 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.305 01:55:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:07.305 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.305 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.305 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.305 01:55:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:07.305 01:55:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:07.305 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.305 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.305 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.305 01:55:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:07.305 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.305 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.305 [2024-11-18 01:55:41.683351] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:07.305 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.305 01:55:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:07.305 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.305 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.305 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.305 01:55:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:07.305 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.305 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.305 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.305 01:55:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.305 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.305 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.563 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.563 01:55:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:07.563 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.563 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.563 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.563 01:55:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:07.563 01:55:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:07.563 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.563 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.563 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.563 01:55:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:07.563 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.563 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.563 [2024-11-18 01:55:41.731532] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:07.563 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.563 01:55:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:07.563 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.563 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.563 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.563 01:55:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:07.563 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:07.564 01:55:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 [2024-11-18 01:55:41.779711] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:07.564 01:55:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 [2024-11-18 01:55:41.827867] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:07.564 01:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 01:55:41 -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 01:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 01:55:41 -- target/rpc.sh@110 -- # stats='{ 00:13:07.564 "tick_rate": 2700000000, 00:13:07.564 "poll_groups": [ 00:13:07.564 { 00:13:07.564 "name": "nvmf_tgt_poll_group_0", 00:13:07.564 "admin_qpairs": 2, 00:13:07.564 "io_qpairs": 84, 00:13:07.564 "current_admin_qpairs": 0, 00:13:07.564 "current_io_qpairs": 0, 00:13:07.564 "pending_bdev_io": 0, 00:13:07.564 "completed_nvme_io": 164, 00:13:07.564 "transports": [ 00:13:07.564 { 00:13:07.564 "trtype": "TCP" 00:13:07.564 } 00:13:07.564 ] 00:13:07.564 }, 00:13:07.564 { 00:13:07.564 "name": "nvmf_tgt_poll_group_1", 00:13:07.564 "admin_qpairs": 2, 00:13:07.564 "io_qpairs": 84, 00:13:07.564 "current_admin_qpairs": 0, 00:13:07.564 "current_io_qpairs": 0, 00:13:07.564 "pending_bdev_io": 0, 00:13:07.564 "completed_nvme_io": 254, 00:13:07.564 "transports": [ 00:13:07.564 { 00:13:07.564 "trtype": "TCP" 00:13:07.564 } 00:13:07.564 ] 00:13:07.564 }, 00:13:07.564 { 00:13:07.564 "name": "nvmf_tgt_poll_group_2", 00:13:07.564 "admin_qpairs": 1, 00:13:07.564 "io_qpairs": 84, 00:13:07.564 "current_admin_qpairs": 0, 00:13:07.564 "current_io_qpairs": 0, 00:13:07.564 "pending_bdev_io": 0, 00:13:07.564 "completed_nvme_io": 134, 00:13:07.564 "transports": [ 00:13:07.564 { 00:13:07.564 "trtype": "TCP" 00:13:07.564 } 00:13:07.564 ] 00:13:07.564 }, 00:13:07.564 { 00:13:07.564 "name": "nvmf_tgt_poll_group_3", 00:13:07.564 "admin_qpairs": 2, 00:13:07.564 "io_qpairs": 84, 00:13:07.564 "current_admin_qpairs": 0, 00:13:07.564 "current_io_qpairs": 0, 00:13:07.564 "pending_bdev_io": 0, 00:13:07.564 "completed_nvme_io": 134, 00:13:07.564 "transports": [ 00:13:07.564 { 00:13:07.564 "trtype": "TCP" 00:13:07.564 } 00:13:07.564 ] 00:13:07.564 } 00:13:07.564 ] 00:13:07.564 }' 00:13:07.564 01:55:41 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:07.564 01:55:41 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:07.564 01:55:41 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:07.564 01:55:41 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:07.564 01:55:41 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:07.564 01:55:41 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:07.564 01:55:41 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:07.564 01:55:41 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:07.564 01:55:41 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:07.564 01:55:41 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:07.564 01:55:41 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:07.564 01:55:41 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:07.564 01:55:41 -- target/rpc.sh@123 -- # nvmftestfini 00:13:07.564 01:55:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:07.564 01:55:41 -- nvmf/common.sh@116 -- # sync 00:13:07.564 01:55:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:07.564 01:55:41 -- nvmf/common.sh@119 -- # set +e 00:13:07.564 01:55:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:07.564 01:55:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:07.564 rmmod nvme_tcp 00:13:07.822 rmmod nvme_fabrics 00:13:07.822 rmmod nvme_keyring 00:13:07.822 01:55:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:07.822 01:55:42 -- nvmf/common.sh@123 -- # set -e 00:13:07.822 01:55:42 -- nvmf/common.sh@124 -- # return 0 00:13:07.822 01:55:42 -- nvmf/common.sh@477 -- # '[' -n 1149544 ']' 00:13:07.822 01:55:42 -- nvmf/common.sh@478 -- # killprocess 1149544 00:13:07.822 01:55:42 -- common/autotest_common.sh@936 -- # '[' -z 1149544 ']' 00:13:07.822 01:55:42 -- common/autotest_common.sh@940 -- # kill -0 1149544 00:13:07.822 01:55:42 -- common/autotest_common.sh@941 -- # uname 00:13:07.822 01:55:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:07.822 01:55:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1149544 00:13:07.822 01:55:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:07.822 01:55:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:07.822 01:55:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1149544' 00:13:07.823 killing process with pid 1149544 00:13:07.823 01:55:42 -- common/autotest_common.sh@955 -- # kill 1149544 00:13:07.823 01:55:42 -- common/autotest_common.sh@960 -- # wait 1149544 00:13:08.080 01:55:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:08.080 01:55:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:08.080 01:55:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:08.080 01:55:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:08.080 01:55:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:08.081 01:55:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:08.081 01:55:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:08.081 01:55:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:09.988 01:55:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:09.988 00:13:09.988 real 0m26.029s 00:13:09.988 user 1m24.847s 00:13:09.988 sys 0m4.394s 00:13:09.988 01:55:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:09.988 01:55:44 -- common/autotest_common.sh@10 -- # set +x 00:13:09.988 ************************************ 00:13:09.988 END TEST nvmf_rpc 00:13:09.988 ************************************ 00:13:09.988 01:55:44 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:09.988 01:55:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:09.988 01:55:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:09.988 01:55:44 -- common/autotest_common.sh@10 -- # set +x 00:13:09.988 ************************************ 00:13:09.988 START TEST nvmf_invalid 00:13:09.988 ************************************ 00:13:09.988 01:55:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:10.247 * Looking for test storage... 00:13:10.247 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:10.247 01:55:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:10.247 01:55:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:10.247 01:55:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:10.247 01:55:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:10.247 01:55:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:10.247 01:55:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:10.247 01:55:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:10.247 01:55:44 -- scripts/common.sh@335 -- # IFS=.-: 00:13:10.247 01:55:44 -- scripts/common.sh@335 -- # read -ra ver1 00:13:10.247 01:55:44 -- scripts/common.sh@336 -- # IFS=.-: 00:13:10.247 01:55:44 -- scripts/common.sh@336 -- # read -ra ver2 00:13:10.247 01:55:44 -- scripts/common.sh@337 -- # local 'op=<' 00:13:10.247 01:55:44 -- scripts/common.sh@339 -- # ver1_l=2 00:13:10.247 01:55:44 -- scripts/common.sh@340 -- # ver2_l=1 00:13:10.247 01:55:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:10.247 01:55:44 -- scripts/common.sh@343 -- # case "$op" in 00:13:10.247 01:55:44 -- scripts/common.sh@344 -- # : 1 00:13:10.247 01:55:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:10.247 01:55:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:10.247 01:55:44 -- scripts/common.sh@364 -- # decimal 1 00:13:10.247 01:55:44 -- scripts/common.sh@352 -- # local d=1 00:13:10.247 01:55:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:10.247 01:55:44 -- scripts/common.sh@354 -- # echo 1 00:13:10.247 01:55:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:10.247 01:55:44 -- scripts/common.sh@365 -- # decimal 2 00:13:10.247 01:55:44 -- scripts/common.sh@352 -- # local d=2 00:13:10.247 01:55:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:10.247 01:55:44 -- scripts/common.sh@354 -- # echo 2 00:13:10.247 01:55:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:10.247 01:55:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:10.247 01:55:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:10.247 01:55:44 -- scripts/common.sh@367 -- # return 0 00:13:10.247 01:55:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:10.247 01:55:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:10.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:10.247 --rc genhtml_branch_coverage=1 00:13:10.247 --rc genhtml_function_coverage=1 00:13:10.247 --rc genhtml_legend=1 00:13:10.247 --rc geninfo_all_blocks=1 00:13:10.247 --rc geninfo_unexecuted_blocks=1 00:13:10.247 00:13:10.247 ' 00:13:10.247 01:55:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:10.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:10.247 --rc genhtml_branch_coverage=1 00:13:10.247 --rc genhtml_function_coverage=1 00:13:10.247 --rc genhtml_legend=1 00:13:10.247 --rc geninfo_all_blocks=1 00:13:10.247 --rc geninfo_unexecuted_blocks=1 00:13:10.247 00:13:10.247 ' 00:13:10.247 01:55:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:10.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:10.247 --rc genhtml_branch_coverage=1 00:13:10.247 --rc genhtml_function_coverage=1 00:13:10.247 --rc genhtml_legend=1 00:13:10.247 --rc geninfo_all_blocks=1 00:13:10.247 --rc geninfo_unexecuted_blocks=1 00:13:10.247 00:13:10.247 ' 00:13:10.247 01:55:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:10.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:10.247 --rc genhtml_branch_coverage=1 00:13:10.247 --rc genhtml_function_coverage=1 00:13:10.247 --rc genhtml_legend=1 00:13:10.247 --rc geninfo_all_blocks=1 00:13:10.247 --rc geninfo_unexecuted_blocks=1 00:13:10.247 00:13:10.247 ' 00:13:10.247 01:55:44 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:10.247 01:55:44 -- nvmf/common.sh@7 -- # uname -s 00:13:10.247 01:55:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:10.247 01:55:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:10.247 01:55:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:10.247 01:55:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:10.247 01:55:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:10.247 01:55:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:10.247 01:55:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:10.247 01:55:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:10.247 01:55:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:10.247 01:55:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:10.247 01:55:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:10.247 01:55:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:10.247 01:55:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:10.247 01:55:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:10.247 01:55:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:10.247 01:55:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:10.248 01:55:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:10.248 01:55:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:10.248 01:55:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:10.248 01:55:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.248 01:55:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.248 01:55:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.248 01:55:44 -- paths/export.sh@5 -- # export PATH 00:13:10.248 01:55:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.248 01:55:44 -- nvmf/common.sh@46 -- # : 0 00:13:10.248 01:55:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:10.248 01:55:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:10.248 01:55:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:10.248 01:55:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:10.248 01:55:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:10.248 01:55:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:10.248 01:55:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:10.248 01:55:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:10.248 01:55:44 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:10.248 01:55:44 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:10.248 01:55:44 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:10.248 01:55:44 -- target/invalid.sh@14 -- # target=foobar 00:13:10.248 01:55:44 -- target/invalid.sh@16 -- # RANDOM=0 00:13:10.248 01:55:44 -- target/invalid.sh@34 -- # nvmftestinit 00:13:10.248 01:55:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:10.248 01:55:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:10.248 01:55:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:10.248 01:55:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:10.248 01:55:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:10.248 01:55:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:10.248 01:55:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:10.248 01:55:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:10.248 01:55:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:10.248 01:55:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:10.248 01:55:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:10.248 01:55:44 -- common/autotest_common.sh@10 -- # set +x 00:13:12.150 01:55:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:12.150 01:55:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:12.150 01:55:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:12.150 01:55:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:12.150 01:55:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:12.150 01:55:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:12.150 01:55:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:12.150 01:55:46 -- nvmf/common.sh@294 -- # net_devs=() 00:13:12.150 01:55:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:12.150 01:55:46 -- nvmf/common.sh@295 -- # e810=() 00:13:12.150 01:55:46 -- nvmf/common.sh@295 -- # local -ga e810 00:13:12.150 01:55:46 -- nvmf/common.sh@296 -- # x722=() 00:13:12.150 01:55:46 -- nvmf/common.sh@296 -- # local -ga x722 00:13:12.150 01:55:46 -- nvmf/common.sh@297 -- # mlx=() 00:13:12.150 01:55:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:12.150 01:55:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:12.150 01:55:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:12.150 01:55:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:12.150 01:55:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:12.150 01:55:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:12.150 01:55:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:12.150 01:55:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:12.150 01:55:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:12.150 01:55:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:12.150 01:55:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:12.150 01:55:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:12.150 01:55:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:12.150 01:55:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:12.150 01:55:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:12.150 01:55:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:12.150 01:55:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:12.150 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:12.150 01:55:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:12.150 01:55:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:12.150 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:12.150 01:55:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:12.150 01:55:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:12.150 01:55:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:12.150 01:55:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:12.150 01:55:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:12.150 01:55:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:12.150 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:12.150 01:55:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:12.150 01:55:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:12.150 01:55:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:12.150 01:55:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:12.150 01:55:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:12.150 01:55:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:12.150 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:12.150 01:55:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:12.150 01:55:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:12.150 01:55:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:12.150 01:55:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:12.150 01:55:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:12.150 01:55:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:12.150 01:55:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:12.150 01:55:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:12.150 01:55:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:12.150 01:55:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:12.150 01:55:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:12.150 01:55:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:12.150 01:55:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:12.150 01:55:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:12.150 01:55:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:12.150 01:55:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:12.150 01:55:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:12.150 01:55:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:12.150 01:55:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:12.150 01:55:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:12.150 01:55:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:12.150 01:55:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:12.408 01:55:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:12.408 01:55:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:12.408 01:55:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:12.408 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:12.408 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.199 ms 00:13:12.408 00:13:12.408 --- 10.0.0.2 ping statistics --- 00:13:12.408 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:12.408 rtt min/avg/max/mdev = 0.199/0.199/0.199/0.000 ms 00:13:12.408 01:55:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:12.408 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:12.408 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:13:12.408 00:13:12.408 --- 10.0.0.1 ping statistics --- 00:13:12.408 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:12.408 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:13:12.408 01:55:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:12.408 01:55:46 -- nvmf/common.sh@410 -- # return 0 00:13:12.408 01:55:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:12.408 01:55:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:12.408 01:55:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:12.409 01:55:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:12.409 01:55:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:12.409 01:55:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:12.409 01:55:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:12.409 01:55:46 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:12.409 01:55:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:12.409 01:55:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:12.409 01:55:46 -- common/autotest_common.sh@10 -- # set +x 00:13:12.409 01:55:46 -- nvmf/common.sh@469 -- # nvmfpid=1154236 00:13:12.409 01:55:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:12.409 01:55:46 -- nvmf/common.sh@470 -- # waitforlisten 1154236 00:13:12.409 01:55:46 -- common/autotest_common.sh@829 -- # '[' -z 1154236 ']' 00:13:12.409 01:55:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:12.409 01:55:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:12.409 01:55:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:12.409 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:12.409 01:55:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:12.409 01:55:46 -- common/autotest_common.sh@10 -- # set +x 00:13:12.409 [2024-11-18 01:55:46.669218] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:12.409 [2024-11-18 01:55:46.669281] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:12.409 EAL: No free 2048 kB hugepages reported on node 1 00:13:12.409 [2024-11-18 01:55:46.739494] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:12.667 [2024-11-18 01:55:46.838167] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:12.667 [2024-11-18 01:55:46.838339] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:12.667 [2024-11-18 01:55:46.838378] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:12.667 [2024-11-18 01:55:46.838392] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:12.667 [2024-11-18 01:55:46.838450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:12.667 [2024-11-18 01:55:46.838481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:12.667 [2024-11-18 01:55:46.838512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:12.667 [2024-11-18 01:55:46.838516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:13.604 01:55:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:13.604 01:55:47 -- common/autotest_common.sh@862 -- # return 0 00:13:13.604 01:55:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:13.604 01:55:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:13.604 01:55:47 -- common/autotest_common.sh@10 -- # set +x 00:13:13.604 01:55:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:13.604 01:55:47 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:13.604 01:55:47 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode2174 00:13:13.604 [2024-11-18 01:55:47.931890] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:13.604 01:55:47 -- target/invalid.sh@40 -- # out='request: 00:13:13.604 { 00:13:13.604 "nqn": "nqn.2016-06.io.spdk:cnode2174", 00:13:13.604 "tgt_name": "foobar", 00:13:13.604 "method": "nvmf_create_subsystem", 00:13:13.604 "req_id": 1 00:13:13.604 } 00:13:13.604 Got JSON-RPC error response 00:13:13.604 response: 00:13:13.604 { 00:13:13.604 "code": -32603, 00:13:13.604 "message": "Unable to find target foobar" 00:13:13.604 }' 00:13:13.604 01:55:47 -- target/invalid.sh@41 -- # [[ request: 00:13:13.604 { 00:13:13.604 "nqn": "nqn.2016-06.io.spdk:cnode2174", 00:13:13.604 "tgt_name": "foobar", 00:13:13.604 "method": "nvmf_create_subsystem", 00:13:13.604 "req_id": 1 00:13:13.604 } 00:13:13.604 Got JSON-RPC error response 00:13:13.604 response: 00:13:13.604 { 00:13:13.604 "code": -32603, 00:13:13.604 "message": "Unable to find target foobar" 00:13:13.604 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:13.604 01:55:47 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:13.604 01:55:47 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode18768 00:13:13.862 [2024-11-18 01:55:48.196794] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode18768: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:13.862 01:55:48 -- target/invalid.sh@45 -- # out='request: 00:13:13.862 { 00:13:13.862 "nqn": "nqn.2016-06.io.spdk:cnode18768", 00:13:13.862 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:13.862 "method": "nvmf_create_subsystem", 00:13:13.862 "req_id": 1 00:13:13.862 } 00:13:13.862 Got JSON-RPC error response 00:13:13.862 response: 00:13:13.862 { 00:13:13.862 "code": -32602, 00:13:13.862 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:13.862 }' 00:13:13.862 01:55:48 -- target/invalid.sh@46 -- # [[ request: 00:13:13.862 { 00:13:13.862 "nqn": "nqn.2016-06.io.spdk:cnode18768", 00:13:13.862 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:13.862 "method": "nvmf_create_subsystem", 00:13:13.862 "req_id": 1 00:13:13.862 } 00:13:13.862 Got JSON-RPC error response 00:13:13.862 response: 00:13:13.862 { 00:13:13.862 "code": -32602, 00:13:13.862 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:13.862 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:13.862 01:55:48 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:13.862 01:55:48 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode12929 00:13:14.120 [2024-11-18 01:55:48.441578] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode12929: invalid model number 'SPDK_Controller' 00:13:14.120 01:55:48 -- target/invalid.sh@50 -- # out='request: 00:13:14.120 { 00:13:14.120 "nqn": "nqn.2016-06.io.spdk:cnode12929", 00:13:14.120 "model_number": "SPDK_Controller\u001f", 00:13:14.120 "method": "nvmf_create_subsystem", 00:13:14.120 "req_id": 1 00:13:14.120 } 00:13:14.120 Got JSON-RPC error response 00:13:14.120 response: 00:13:14.120 { 00:13:14.120 "code": -32602, 00:13:14.120 "message": "Invalid MN SPDK_Controller\u001f" 00:13:14.120 }' 00:13:14.120 01:55:48 -- target/invalid.sh@51 -- # [[ request: 00:13:14.120 { 00:13:14.120 "nqn": "nqn.2016-06.io.spdk:cnode12929", 00:13:14.120 "model_number": "SPDK_Controller\u001f", 00:13:14.120 "method": "nvmf_create_subsystem", 00:13:14.120 "req_id": 1 00:13:14.120 } 00:13:14.120 Got JSON-RPC error response 00:13:14.120 response: 00:13:14.120 { 00:13:14.120 "code": -32602, 00:13:14.120 "message": "Invalid MN SPDK_Controller\u001f" 00:13:14.120 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:14.120 01:55:48 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:14.120 01:55:48 -- target/invalid.sh@19 -- # local length=21 ll 00:13:14.120 01:55:48 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:14.120 01:55:48 -- target/invalid.sh@21 -- # local chars 00:13:14.120 01:55:48 -- target/invalid.sh@22 -- # local string 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 85 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=U 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 32 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x20' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=' ' 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 58 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=: 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 80 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=P 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 93 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=']' 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 95 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=_ 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 56 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x38' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=8 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 74 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=J 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 126 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+='~' 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 71 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=G 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 117 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=u 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 93 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=']' 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 69 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x45' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=E 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 82 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=R 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # printf %x 46 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:13:14.120 01:55:48 -- target/invalid.sh@25 -- # string+=. 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.120 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # printf %x 116 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # string+=t 00:13:14.378 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.378 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # printf %x 60 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # string+='<' 00:13:14.378 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.378 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # printf %x 88 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # string+=X 00:13:14.378 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.378 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # printf %x 80 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # string+=P 00:13:14.378 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.378 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # printf %x 50 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x32' 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # string+=2 00:13:14.378 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.378 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # printf %x 81 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # echo -e '\x51' 00:13:14.378 01:55:48 -- target/invalid.sh@25 -- # string+=Q 00:13:14.378 01:55:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:14.378 01:55:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:14.378 01:55:48 -- target/invalid.sh@28 -- # [[ U == \- ]] 00:13:14.378 01:55:48 -- target/invalid.sh@31 -- # echo 'U :P]_8J~Gu]ER.t /dev/null' 00:13:17.478 01:55:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:19.386 01:55:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:19.386 00:13:19.386 real 0m9.327s 00:13:19.386 user 0m23.232s 00:13:19.386 sys 0m2.359s 00:13:19.386 01:55:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:19.386 01:55:53 -- common/autotest_common.sh@10 -- # set +x 00:13:19.386 ************************************ 00:13:19.386 END TEST nvmf_invalid 00:13:19.386 ************************************ 00:13:19.386 01:55:53 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:19.386 01:55:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:19.386 01:55:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:19.386 01:55:53 -- common/autotest_common.sh@10 -- # set +x 00:13:19.386 ************************************ 00:13:19.386 START TEST nvmf_abort 00:13:19.386 ************************************ 00:13:19.386 01:55:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:19.386 * Looking for test storage... 00:13:19.386 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:19.386 01:55:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:19.386 01:55:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:19.386 01:55:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:19.645 01:55:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:19.645 01:55:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:19.645 01:55:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:19.645 01:55:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:19.645 01:55:53 -- scripts/common.sh@335 -- # IFS=.-: 00:13:19.645 01:55:53 -- scripts/common.sh@335 -- # read -ra ver1 00:13:19.645 01:55:53 -- scripts/common.sh@336 -- # IFS=.-: 00:13:19.645 01:55:53 -- scripts/common.sh@336 -- # read -ra ver2 00:13:19.645 01:55:53 -- scripts/common.sh@337 -- # local 'op=<' 00:13:19.645 01:55:53 -- scripts/common.sh@339 -- # ver1_l=2 00:13:19.645 01:55:53 -- scripts/common.sh@340 -- # ver2_l=1 00:13:19.645 01:55:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:19.645 01:55:53 -- scripts/common.sh@343 -- # case "$op" in 00:13:19.645 01:55:53 -- scripts/common.sh@344 -- # : 1 00:13:19.645 01:55:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:19.645 01:55:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:19.645 01:55:53 -- scripts/common.sh@364 -- # decimal 1 00:13:19.645 01:55:53 -- scripts/common.sh@352 -- # local d=1 00:13:19.645 01:55:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:19.645 01:55:53 -- scripts/common.sh@354 -- # echo 1 00:13:19.645 01:55:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:19.645 01:55:53 -- scripts/common.sh@365 -- # decimal 2 00:13:19.645 01:55:53 -- scripts/common.sh@352 -- # local d=2 00:13:19.645 01:55:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:19.645 01:55:53 -- scripts/common.sh@354 -- # echo 2 00:13:19.645 01:55:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:19.645 01:55:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:19.645 01:55:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:19.645 01:55:53 -- scripts/common.sh@367 -- # return 0 00:13:19.645 01:55:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:19.645 01:55:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:19.645 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:19.645 --rc genhtml_branch_coverage=1 00:13:19.645 --rc genhtml_function_coverage=1 00:13:19.645 --rc genhtml_legend=1 00:13:19.645 --rc geninfo_all_blocks=1 00:13:19.645 --rc geninfo_unexecuted_blocks=1 00:13:19.645 00:13:19.645 ' 00:13:19.645 01:55:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:19.645 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:19.645 --rc genhtml_branch_coverage=1 00:13:19.645 --rc genhtml_function_coverage=1 00:13:19.645 --rc genhtml_legend=1 00:13:19.645 --rc geninfo_all_blocks=1 00:13:19.645 --rc geninfo_unexecuted_blocks=1 00:13:19.645 00:13:19.645 ' 00:13:19.645 01:55:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:19.645 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:19.645 --rc genhtml_branch_coverage=1 00:13:19.645 --rc genhtml_function_coverage=1 00:13:19.645 --rc genhtml_legend=1 00:13:19.645 --rc geninfo_all_blocks=1 00:13:19.645 --rc geninfo_unexecuted_blocks=1 00:13:19.645 00:13:19.645 ' 00:13:19.645 01:55:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:19.645 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:19.645 --rc genhtml_branch_coverage=1 00:13:19.645 --rc genhtml_function_coverage=1 00:13:19.645 --rc genhtml_legend=1 00:13:19.645 --rc geninfo_all_blocks=1 00:13:19.645 --rc geninfo_unexecuted_blocks=1 00:13:19.645 00:13:19.645 ' 00:13:19.645 01:55:53 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:19.645 01:55:53 -- nvmf/common.sh@7 -- # uname -s 00:13:19.645 01:55:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:19.645 01:55:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:19.645 01:55:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:19.645 01:55:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:19.645 01:55:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:19.645 01:55:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:19.645 01:55:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:19.645 01:55:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:19.645 01:55:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:19.645 01:55:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:19.645 01:55:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:19.645 01:55:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:19.645 01:55:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:19.645 01:55:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:19.645 01:55:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:19.645 01:55:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:19.645 01:55:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:19.645 01:55:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:19.645 01:55:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:19.645 01:55:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.645 01:55:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.645 01:55:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.645 01:55:53 -- paths/export.sh@5 -- # export PATH 00:13:19.646 01:55:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.646 01:55:53 -- nvmf/common.sh@46 -- # : 0 00:13:19.646 01:55:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:19.646 01:55:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:19.646 01:55:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:19.646 01:55:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:19.646 01:55:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:19.646 01:55:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:19.646 01:55:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:19.646 01:55:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:19.646 01:55:53 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:19.646 01:55:53 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:19.646 01:55:53 -- target/abort.sh@14 -- # nvmftestinit 00:13:19.646 01:55:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:19.646 01:55:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:19.646 01:55:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:19.646 01:55:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:19.646 01:55:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:19.646 01:55:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:19.646 01:55:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:19.646 01:55:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:19.646 01:55:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:19.646 01:55:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:19.646 01:55:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:19.646 01:55:53 -- common/autotest_common.sh@10 -- # set +x 00:13:21.580 01:55:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:21.580 01:55:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:21.580 01:55:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:21.580 01:55:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:21.580 01:55:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:21.580 01:55:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:21.580 01:55:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:21.580 01:55:55 -- nvmf/common.sh@294 -- # net_devs=() 00:13:21.580 01:55:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:21.580 01:55:55 -- nvmf/common.sh@295 -- # e810=() 00:13:21.580 01:55:55 -- nvmf/common.sh@295 -- # local -ga e810 00:13:21.580 01:55:55 -- nvmf/common.sh@296 -- # x722=() 00:13:21.580 01:55:55 -- nvmf/common.sh@296 -- # local -ga x722 00:13:21.580 01:55:55 -- nvmf/common.sh@297 -- # mlx=() 00:13:21.580 01:55:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:21.580 01:55:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:21.580 01:55:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:21.580 01:55:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:21.580 01:55:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:21.580 01:55:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:21.580 01:55:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:21.580 01:55:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:21.580 01:55:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:21.580 01:55:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:21.580 01:55:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:21.580 01:55:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:21.580 01:55:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:21.580 01:55:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:21.580 01:55:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:21.580 01:55:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:21.580 01:55:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:21.580 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:21.580 01:55:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:21.580 01:55:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:21.580 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:21.580 01:55:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:21.580 01:55:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:21.580 01:55:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.580 01:55:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:21.580 01:55:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.580 01:55:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:21.580 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:21.580 01:55:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.580 01:55:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:21.580 01:55:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.580 01:55:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:21.580 01:55:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.580 01:55:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:21.580 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:21.580 01:55:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.580 01:55:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:21.580 01:55:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:21.580 01:55:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:21.580 01:55:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:21.580 01:55:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:21.580 01:55:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:21.580 01:55:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:21.580 01:55:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:21.580 01:55:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:21.580 01:55:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:21.580 01:55:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:21.580 01:55:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:21.580 01:55:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:21.580 01:55:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:21.580 01:55:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:21.580 01:55:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:21.580 01:55:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:21.580 01:55:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:21.580 01:55:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:21.580 01:55:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:21.580 01:55:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:21.580 01:55:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:21.580 01:55:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:21.580 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:21.580 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.184 ms 00:13:21.580 00:13:21.580 --- 10.0.0.2 ping statistics --- 00:13:21.580 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.580 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:13:21.580 01:55:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:21.580 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:21.580 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.043 ms 00:13:21.580 00:13:21.580 --- 10.0.0.1 ping statistics --- 00:13:21.580 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.580 rtt min/avg/max/mdev = 0.043/0.043/0.043/0.000 ms 00:13:21.580 01:55:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:21.580 01:55:55 -- nvmf/common.sh@410 -- # return 0 00:13:21.580 01:55:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:21.580 01:55:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:21.580 01:55:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:21.580 01:55:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:21.581 01:55:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:21.581 01:55:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:21.581 01:55:55 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:21.581 01:55:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:21.581 01:55:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:21.581 01:55:55 -- common/autotest_common.sh@10 -- # set +x 00:13:21.581 01:55:55 -- nvmf/common.sh@469 -- # nvmfpid=1156974 00:13:21.581 01:55:55 -- nvmf/common.sh@470 -- # waitforlisten 1156974 00:13:21.581 01:55:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:21.581 01:55:55 -- common/autotest_common.sh@829 -- # '[' -z 1156974 ']' 00:13:21.581 01:55:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:21.581 01:55:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:21.581 01:55:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:21.581 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:21.581 01:55:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:21.581 01:55:55 -- common/autotest_common.sh@10 -- # set +x 00:13:21.877 [2024-11-18 01:55:56.026924] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:21.877 [2024-11-18 01:55:56.027012] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:21.877 EAL: No free 2048 kB hugepages reported on node 1 00:13:21.877 [2024-11-18 01:55:56.101810] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:21.877 [2024-11-18 01:55:56.193971] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:21.877 [2024-11-18 01:55:56.194133] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:21.877 [2024-11-18 01:55:56.194153] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:21.877 [2024-11-18 01:55:56.194167] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:21.877 [2024-11-18 01:55:56.194256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:21.877 [2024-11-18 01:55:56.194299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:21.877 [2024-11-18 01:55:56.194302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:22.811 01:55:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:22.811 01:55:56 -- common/autotest_common.sh@862 -- # return 0 00:13:22.811 01:55:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:22.811 01:55:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:22.811 01:55:56 -- common/autotest_common.sh@10 -- # set +x 00:13:22.811 01:55:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:22.811 01:55:56 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:22.811 01:55:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.811 01:55:56 -- common/autotest_common.sh@10 -- # set +x 00:13:22.811 [2024-11-18 01:55:57.004164] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:22.811 01:55:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.811 01:55:57 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:22.811 01:55:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.811 01:55:57 -- common/autotest_common.sh@10 -- # set +x 00:13:22.811 Malloc0 00:13:22.811 01:55:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.811 01:55:57 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:22.811 01:55:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.811 01:55:57 -- common/autotest_common.sh@10 -- # set +x 00:13:22.811 Delay0 00:13:22.811 01:55:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.811 01:55:57 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:22.811 01:55:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.811 01:55:57 -- common/autotest_common.sh@10 -- # set +x 00:13:22.811 01:55:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.811 01:55:57 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:22.811 01:55:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.811 01:55:57 -- common/autotest_common.sh@10 -- # set +x 00:13:22.811 01:55:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.811 01:55:57 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:22.811 01:55:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.811 01:55:57 -- common/autotest_common.sh@10 -- # set +x 00:13:22.811 [2024-11-18 01:55:57.070673] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:22.811 01:55:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.811 01:55:57 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:22.811 01:55:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.811 01:55:57 -- common/autotest_common.sh@10 -- # set +x 00:13:22.811 01:55:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.811 01:55:57 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:22.811 EAL: No free 2048 kB hugepages reported on node 1 00:13:22.811 [2024-11-18 01:55:57.176663] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:25.340 Initializing NVMe Controllers 00:13:25.340 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:25.340 controller IO queue size 128 less than required 00:13:25.340 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:25.340 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:25.340 Initialization complete. Launching workers. 00:13:25.340 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 33277 00:13:25.340 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33338, failed to submit 62 00:13:25.340 success 33277, unsuccess 61, failed 0 00:13:25.340 01:55:59 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:25.340 01:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.340 01:55:59 -- common/autotest_common.sh@10 -- # set +x 00:13:25.340 01:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.340 01:55:59 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:25.340 01:55:59 -- target/abort.sh@38 -- # nvmftestfini 00:13:25.340 01:55:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:25.340 01:55:59 -- nvmf/common.sh@116 -- # sync 00:13:25.340 01:55:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:25.340 01:55:59 -- nvmf/common.sh@119 -- # set +e 00:13:25.340 01:55:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:25.340 01:55:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:25.340 rmmod nvme_tcp 00:13:25.340 rmmod nvme_fabrics 00:13:25.340 rmmod nvme_keyring 00:13:25.340 01:55:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:25.340 01:55:59 -- nvmf/common.sh@123 -- # set -e 00:13:25.340 01:55:59 -- nvmf/common.sh@124 -- # return 0 00:13:25.340 01:55:59 -- nvmf/common.sh@477 -- # '[' -n 1156974 ']' 00:13:25.340 01:55:59 -- nvmf/common.sh@478 -- # killprocess 1156974 00:13:25.340 01:55:59 -- common/autotest_common.sh@936 -- # '[' -z 1156974 ']' 00:13:25.340 01:55:59 -- common/autotest_common.sh@940 -- # kill -0 1156974 00:13:25.340 01:55:59 -- common/autotest_common.sh@941 -- # uname 00:13:25.340 01:55:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:25.340 01:55:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1156974 00:13:25.340 01:55:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:25.340 01:55:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:25.340 01:55:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1156974' 00:13:25.340 killing process with pid 1156974 00:13:25.340 01:55:59 -- common/autotest_common.sh@955 -- # kill 1156974 00:13:25.340 01:55:59 -- common/autotest_common.sh@960 -- # wait 1156974 00:13:25.340 01:55:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:25.340 01:55:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:25.340 01:55:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:25.340 01:55:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:25.340 01:55:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:25.340 01:55:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:25.340 01:55:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:25.340 01:55:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:27.869 01:56:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:27.869 00:13:27.869 real 0m8.015s 00:13:27.869 user 0m13.018s 00:13:27.869 sys 0m2.578s 00:13:27.869 01:56:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:27.869 01:56:01 -- common/autotest_common.sh@10 -- # set +x 00:13:27.869 ************************************ 00:13:27.869 END TEST nvmf_abort 00:13:27.869 ************************************ 00:13:27.869 01:56:01 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:27.869 01:56:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:27.869 01:56:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:27.869 01:56:01 -- common/autotest_common.sh@10 -- # set +x 00:13:27.869 ************************************ 00:13:27.869 START TEST nvmf_ns_hotplug_stress 00:13:27.869 ************************************ 00:13:27.869 01:56:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:27.869 * Looking for test storage... 00:13:27.869 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:27.869 01:56:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:27.869 01:56:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:27.869 01:56:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:27.869 01:56:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:27.869 01:56:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:27.869 01:56:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:27.869 01:56:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:27.869 01:56:01 -- scripts/common.sh@335 -- # IFS=.-: 00:13:27.869 01:56:01 -- scripts/common.sh@335 -- # read -ra ver1 00:13:27.869 01:56:01 -- scripts/common.sh@336 -- # IFS=.-: 00:13:27.869 01:56:01 -- scripts/common.sh@336 -- # read -ra ver2 00:13:27.869 01:56:01 -- scripts/common.sh@337 -- # local 'op=<' 00:13:27.869 01:56:01 -- scripts/common.sh@339 -- # ver1_l=2 00:13:27.869 01:56:01 -- scripts/common.sh@340 -- # ver2_l=1 00:13:27.869 01:56:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:27.869 01:56:01 -- scripts/common.sh@343 -- # case "$op" in 00:13:27.869 01:56:01 -- scripts/common.sh@344 -- # : 1 00:13:27.869 01:56:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:27.869 01:56:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:27.869 01:56:01 -- scripts/common.sh@364 -- # decimal 1 00:13:27.869 01:56:01 -- scripts/common.sh@352 -- # local d=1 00:13:27.869 01:56:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:27.869 01:56:01 -- scripts/common.sh@354 -- # echo 1 00:13:27.869 01:56:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:27.869 01:56:01 -- scripts/common.sh@365 -- # decimal 2 00:13:27.869 01:56:01 -- scripts/common.sh@352 -- # local d=2 00:13:27.869 01:56:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:27.869 01:56:01 -- scripts/common.sh@354 -- # echo 2 00:13:27.869 01:56:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:27.869 01:56:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:27.869 01:56:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:27.869 01:56:01 -- scripts/common.sh@367 -- # return 0 00:13:27.869 01:56:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:27.869 01:56:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:27.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:27.869 --rc genhtml_branch_coverage=1 00:13:27.869 --rc genhtml_function_coverage=1 00:13:27.869 --rc genhtml_legend=1 00:13:27.869 --rc geninfo_all_blocks=1 00:13:27.869 --rc geninfo_unexecuted_blocks=1 00:13:27.869 00:13:27.869 ' 00:13:27.870 01:56:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:27.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:27.870 --rc genhtml_branch_coverage=1 00:13:27.870 --rc genhtml_function_coverage=1 00:13:27.870 --rc genhtml_legend=1 00:13:27.870 --rc geninfo_all_blocks=1 00:13:27.870 --rc geninfo_unexecuted_blocks=1 00:13:27.870 00:13:27.870 ' 00:13:27.870 01:56:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:27.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:27.870 --rc genhtml_branch_coverage=1 00:13:27.870 --rc genhtml_function_coverage=1 00:13:27.870 --rc genhtml_legend=1 00:13:27.870 --rc geninfo_all_blocks=1 00:13:27.870 --rc geninfo_unexecuted_blocks=1 00:13:27.870 00:13:27.870 ' 00:13:27.870 01:56:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:27.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:27.870 --rc genhtml_branch_coverage=1 00:13:27.870 --rc genhtml_function_coverage=1 00:13:27.870 --rc genhtml_legend=1 00:13:27.870 --rc geninfo_all_blocks=1 00:13:27.870 --rc geninfo_unexecuted_blocks=1 00:13:27.870 00:13:27.870 ' 00:13:27.870 01:56:01 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:27.870 01:56:01 -- nvmf/common.sh@7 -- # uname -s 00:13:27.870 01:56:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:27.870 01:56:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:27.870 01:56:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:27.870 01:56:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:27.870 01:56:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:27.870 01:56:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:27.870 01:56:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:27.870 01:56:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:27.870 01:56:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:27.870 01:56:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:27.870 01:56:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:27.870 01:56:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:27.870 01:56:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:27.870 01:56:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:27.870 01:56:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:27.870 01:56:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:27.870 01:56:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:27.870 01:56:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:27.870 01:56:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:27.870 01:56:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.870 01:56:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.870 01:56:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.870 01:56:01 -- paths/export.sh@5 -- # export PATH 00:13:27.870 01:56:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.870 01:56:01 -- nvmf/common.sh@46 -- # : 0 00:13:27.870 01:56:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:27.870 01:56:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:27.870 01:56:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:27.870 01:56:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:27.870 01:56:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:27.870 01:56:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:27.870 01:56:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:27.870 01:56:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:27.870 01:56:01 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:27.870 01:56:01 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:27.870 01:56:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:27.870 01:56:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:27.870 01:56:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:27.870 01:56:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:27.870 01:56:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:27.870 01:56:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:27.870 01:56:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:27.870 01:56:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:27.870 01:56:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:27.870 01:56:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:27.870 01:56:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:27.870 01:56:01 -- common/autotest_common.sh@10 -- # set +x 00:13:29.771 01:56:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:29.771 01:56:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:29.771 01:56:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:29.771 01:56:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:29.771 01:56:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:29.771 01:56:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:29.771 01:56:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:29.771 01:56:03 -- nvmf/common.sh@294 -- # net_devs=() 00:13:29.771 01:56:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:29.771 01:56:03 -- nvmf/common.sh@295 -- # e810=() 00:13:29.771 01:56:03 -- nvmf/common.sh@295 -- # local -ga e810 00:13:29.771 01:56:03 -- nvmf/common.sh@296 -- # x722=() 00:13:29.771 01:56:03 -- nvmf/common.sh@296 -- # local -ga x722 00:13:29.771 01:56:03 -- nvmf/common.sh@297 -- # mlx=() 00:13:29.771 01:56:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:29.771 01:56:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:29.771 01:56:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:29.771 01:56:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:29.771 01:56:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:29.771 01:56:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:29.771 01:56:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:29.771 01:56:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:29.771 01:56:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:29.771 01:56:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:29.771 01:56:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:29.771 01:56:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:29.771 01:56:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:29.771 01:56:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:29.771 01:56:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:29.771 01:56:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:29.771 01:56:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:29.771 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:29.771 01:56:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:29.771 01:56:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:29.771 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:29.771 01:56:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:29.771 01:56:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:29.771 01:56:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:29.771 01:56:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:29.771 01:56:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:29.771 01:56:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:29.771 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:29.771 01:56:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:29.771 01:56:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:29.771 01:56:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:29.771 01:56:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:29.771 01:56:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:29.771 01:56:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:29.771 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:29.771 01:56:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:29.771 01:56:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:29.771 01:56:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:29.771 01:56:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:29.771 01:56:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:29.771 01:56:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:29.771 01:56:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:29.771 01:56:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:29.771 01:56:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:29.771 01:56:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:29.771 01:56:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:29.771 01:56:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:29.771 01:56:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:29.771 01:56:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:29.771 01:56:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:29.771 01:56:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:29.771 01:56:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:29.771 01:56:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:29.771 01:56:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:29.771 01:56:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:29.772 01:56:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:29.772 01:56:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:29.772 01:56:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:29.772 01:56:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:29.772 01:56:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:29.772 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:29.772 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:13:29.772 00:13:29.772 --- 10.0.0.2 ping statistics --- 00:13:29.772 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:29.772 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:13:29.772 01:56:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:29.772 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:29.772 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:13:29.772 00:13:29.772 --- 10.0.0.1 ping statistics --- 00:13:29.772 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:29.772 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:13:29.772 01:56:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:29.772 01:56:04 -- nvmf/common.sh@410 -- # return 0 00:13:29.772 01:56:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:29.772 01:56:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:29.772 01:56:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:29.772 01:56:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:29.772 01:56:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:29.772 01:56:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:29.772 01:56:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:29.772 01:56:04 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:29.772 01:56:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:29.772 01:56:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:29.772 01:56:04 -- common/autotest_common.sh@10 -- # set +x 00:13:29.772 01:56:04 -- nvmf/common.sh@469 -- # nvmfpid=1159420 00:13:29.772 01:56:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:29.772 01:56:04 -- nvmf/common.sh@470 -- # waitforlisten 1159420 00:13:29.772 01:56:04 -- common/autotest_common.sh@829 -- # '[' -z 1159420 ']' 00:13:29.772 01:56:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:29.772 01:56:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:29.772 01:56:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:29.772 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:29.772 01:56:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:29.772 01:56:04 -- common/autotest_common.sh@10 -- # set +x 00:13:30.030 [2024-11-18 01:56:04.188890] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:30.030 [2024-11-18 01:56:04.188976] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:30.030 EAL: No free 2048 kB hugepages reported on node 1 00:13:30.030 [2024-11-18 01:56:04.267100] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:30.030 [2024-11-18 01:56:04.366445] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:30.030 [2024-11-18 01:56:04.366613] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:30.030 [2024-11-18 01:56:04.366633] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:30.030 [2024-11-18 01:56:04.366647] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:30.030 [2024-11-18 01:56:04.366711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:30.030 [2024-11-18 01:56:04.366741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:30.030 [2024-11-18 01:56:04.366744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:30.964 01:56:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:30.964 01:56:05 -- common/autotest_common.sh@862 -- # return 0 00:13:30.964 01:56:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:30.964 01:56:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:30.964 01:56:05 -- common/autotest_common.sh@10 -- # set +x 00:13:30.964 01:56:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:30.964 01:56:05 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:30.964 01:56:05 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:31.222 [2024-11-18 01:56:05.536507] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:31.222 01:56:05 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:31.479 01:56:05 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:31.737 [2024-11-18 01:56:06.139814] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:31.994 01:56:06 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:32.251 01:56:06 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:32.510 Malloc0 00:13:32.510 01:56:06 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:32.768 Delay0 00:13:32.768 01:56:06 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:33.025 01:56:07 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:33.283 NULL1 00:13:33.283 01:56:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:33.541 01:56:07 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=1159855 00:13:33.541 01:56:07 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:33.541 01:56:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:33.541 01:56:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.541 EAL: No free 2048 kB hugepages reported on node 1 00:13:34.915 Read completed with error (sct=0, sc=11) 00:13:34.915 01:56:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:34.915 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.915 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.915 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.915 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.915 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.915 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.915 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.915 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.915 01:56:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:13:34.915 01:56:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:35.173 true 00:13:35.173 01:56:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:35.173 01:56:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:36.106 01:56:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:36.106 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:36.364 01:56:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:13:36.364 01:56:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:36.622 true 00:13:36.622 01:56:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:36.622 01:56:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:36.880 01:56:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:37.138 01:56:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:13:37.138 01:56:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:37.396 true 00:13:37.396 01:56:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:37.396 01:56:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.962 01:56:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:38.220 01:56:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:13:38.220 01:56:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:13:38.478 true 00:13:38.478 01:56:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:38.478 01:56:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:38.735 01:56:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:38.993 01:56:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:13:38.993 01:56:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:13:39.251 true 00:13:39.251 01:56:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:39.251 01:56:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:40.184 01:56:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:40.184 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:40.184 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:40.442 01:56:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:13:40.442 01:56:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:13:40.700 true 00:13:40.700 01:56:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:40.700 01:56:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:40.958 01:56:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:41.215 01:56:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:13:41.215 01:56:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:13:41.473 true 00:13:41.474 01:56:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:41.474 01:56:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:42.407 01:56:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:42.407 01:56:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:13:42.407 01:56:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:13:42.664 true 00:13:42.664 01:56:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:42.664 01:56:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:42.922 01:56:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:43.179 01:56:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:13:43.179 01:56:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:13:43.437 true 00:13:43.437 01:56:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:43.437 01:56:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.370 01:56:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:44.370 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:44.370 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:44.370 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:44.628 01:56:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:13:44.628 01:56:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:13:44.890 true 00:13:44.890 01:56:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:44.890 01:56:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:45.148 01:56:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:45.405 01:56:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:13:45.405 01:56:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:45.663 true 00:13:45.664 01:56:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:45.664 01:56:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:46.598 01:56:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.598 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:46.598 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:46.856 01:56:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:13:46.856 01:56:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:47.114 true 00:13:47.114 01:56:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:47.114 01:56:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:47.373 01:56:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:47.630 01:56:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:47.630 01:56:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:47.887 true 00:13:47.887 01:56:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:47.887 01:56:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.820 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:48.820 01:56:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:48.820 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:48.820 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:49.078 01:56:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:49.078 01:56:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:49.335 true 00:13:49.335 01:56:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:49.335 01:56:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:49.593 01:56:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:49.851 01:56:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:49.851 01:56:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:50.109 true 00:13:50.109 01:56:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:50.109 01:56:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:51.041 01:56:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:51.041 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:51.299 01:56:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:51.299 01:56:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:51.556 true 00:13:51.556 01:56:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:51.556 01:56:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:51.814 01:56:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:52.071 01:56:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:52.071 01:56:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:52.329 true 00:13:52.329 01:56:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:52.329 01:56:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:53.262 01:56:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:53.532 01:56:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:53.532 01:56:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:53.789 true 00:13:53.789 01:56:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:53.789 01:56:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:54.047 01:56:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:54.304 01:56:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:54.304 01:56:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:54.562 true 00:13:54.562 01:56:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:54.562 01:56:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:54.819 01:56:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:55.076 01:56:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:55.076 01:56:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:55.076 true 00:13:55.076 01:56:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:55.076 01:56:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.448 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:56.449 01:56:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:56.449 01:56:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:56.449 01:56:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:56.706 true 00:13:56.706 01:56:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:56.706 01:56:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.964 01:56:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:57.222 01:56:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:57.222 01:56:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:57.480 true 00:13:57.480 01:56:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:57.480 01:56:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:58.414 01:56:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:58.414 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:58.672 01:56:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:58.672 01:56:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:58.930 true 00:13:58.930 01:56:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:58.930 01:56:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.188 01:56:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.445 01:56:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:59.445 01:56:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:59.703 true 00:13:59.703 01:56:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:13:59.703 01:56:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.961 01:56:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.219 01:56:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:00.219 01:56:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:00.219 true 00:14:00.219 01:56:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:14:00.477 01:56:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:01.409 01:56:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:01.409 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:01.667 01:56:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:01.667 01:56:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:01.925 true 00:14:01.925 01:56:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:14:01.925 01:56:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:02.183 01:56:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:02.441 01:56:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:02.441 01:56:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:02.699 true 00:14:02.699 01:56:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:14:02.699 01:56:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.633 01:56:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.633 Initializing NVMe Controllers 00:14:03.633 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:03.633 Controller IO queue size 128, less than required. 00:14:03.633 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:03.633 Controller IO queue size 128, less than required. 00:14:03.633 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:03.633 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:03.633 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:03.633 Initialization complete. Launching workers. 00:14:03.633 ======================================================== 00:14:03.633 Latency(us) 00:14:03.633 Device Information : IOPS MiB/s Average min max 00:14:03.633 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 841.93 0.41 79861.87 2345.40 1043102.74 00:14:03.633 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11630.37 5.68 11006.54 1582.22 449302.00 00:14:03.633 ======================================================== 00:14:03.633 Total : 12472.30 6.09 15654.57 1582.22 1043102.74 00:14:03.633 00:14:03.633 01:56:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:03.633 01:56:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:03.890 true 00:14:03.891 01:56:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1159855 00:14:03.891 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (1159855) - No such process 00:14:03.891 01:56:38 -- target/ns_hotplug_stress.sh@53 -- # wait 1159855 00:14:03.891 01:56:38 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:04.148 01:56:38 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:04.406 01:56:38 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:04.406 01:56:38 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:04.406 01:56:38 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:04.406 01:56:38 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:04.406 01:56:38 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:04.663 null0 00:14:04.663 01:56:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:04.663 01:56:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:04.663 01:56:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:04.931 null1 00:14:04.931 01:56:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:04.931 01:56:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:04.931 01:56:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:05.229 null2 00:14:05.229 01:56:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:05.229 01:56:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:05.229 01:56:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:05.520 null3 00:14:05.520 01:56:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:05.520 01:56:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:05.520 01:56:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:05.781 null4 00:14:05.781 01:56:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:05.781 01:56:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:05.781 01:56:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:06.040 null5 00:14:06.040 01:56:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:06.040 01:56:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:06.040 01:56:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:06.297 null6 00:14:06.297 01:56:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:06.297 01:56:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:06.297 01:56:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:06.555 null7 00:14:06.555 01:56:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:06.555 01:56:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:06.555 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:06.555 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:06.555 01:56:40 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:06.555 01:56:40 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:06.555 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@66 -- # wait 1163972 1163974 1163977 1163981 1163984 1163987 1163990 1163994 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.556 01:56:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:06.813 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.813 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:06.813 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:06.813 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:06.813 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:06.813 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:06.813 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:06.813 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.070 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:07.328 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.328 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:07.328 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:07.328 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:07.328 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:07.328 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:07.328 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:07.328 01:56:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.587 01:56:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:07.845 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:07.845 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.845 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:07.845 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:07.845 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:07.845 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:07.845 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:07.845 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:08.103 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.103 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.103 01:56:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:08.103 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.103 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.103 01:56:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.361 01:56:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:08.619 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:08.619 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:08.619 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:08.619 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:08.619 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:08.619 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:08.619 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:08.619 01:56:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.878 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:09.136 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:09.136 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:09.136 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.136 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:09.136 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:09.136 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:09.136 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:09.136 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.394 01:56:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:09.652 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:09.652 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:09.652 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:09.652 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:09.652 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:09.652 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.652 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:09.652 01:56:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.911 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:10.170 01:56:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:10.170 01:56:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:10.170 01:56:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:10.170 01:56:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:10.170 01:56:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.170 01:56:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:10.170 01:56:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:10.170 01:56:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.428 01:56:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:10.686 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:10.686 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:10.686 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:10.686 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:10.686 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:10.686 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:10.686 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.686 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:10.945 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:11.203 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:11.203 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:11.203 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:11.203 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:11.203 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:11.203 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:11.462 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.462 01:56:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:11.720 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.720 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.720 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:11.720 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.720 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.720 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:11.720 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.720 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.720 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:11.720 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.721 01:56:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:11.979 01:56:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:11.979 01:56:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:11.979 01:56:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:11.979 01:56:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:11.979 01:56:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.979 01:56:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:11.979 01:56:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:11.979 01:56:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:12.236 01:56:46 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:12.236 01:56:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:12.236 01:56:46 -- nvmf/common.sh@116 -- # sync 00:14:12.236 01:56:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:12.236 01:56:46 -- nvmf/common.sh@119 -- # set +e 00:14:12.236 01:56:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:12.236 01:56:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:12.236 rmmod nvme_tcp 00:14:12.236 rmmod nvme_fabrics 00:14:12.236 rmmod nvme_keyring 00:14:12.236 01:56:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:12.236 01:56:46 -- nvmf/common.sh@123 -- # set -e 00:14:12.236 01:56:46 -- nvmf/common.sh@124 -- # return 0 00:14:12.236 01:56:46 -- nvmf/common.sh@477 -- # '[' -n 1159420 ']' 00:14:12.236 01:56:46 -- nvmf/common.sh@478 -- # killprocess 1159420 00:14:12.236 01:56:46 -- common/autotest_common.sh@936 -- # '[' -z 1159420 ']' 00:14:12.236 01:56:46 -- common/autotest_common.sh@940 -- # kill -0 1159420 00:14:12.236 01:56:46 -- common/autotest_common.sh@941 -- # uname 00:14:12.236 01:56:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:12.236 01:56:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1159420 00:14:12.237 01:56:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:12.237 01:56:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:12.237 01:56:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1159420' 00:14:12.237 killing process with pid 1159420 00:14:12.237 01:56:46 -- common/autotest_common.sh@955 -- # kill 1159420 00:14:12.237 01:56:46 -- common/autotest_common.sh@960 -- # wait 1159420 00:14:12.496 01:56:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:12.496 01:56:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:12.496 01:56:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:12.496 01:56:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:12.496 01:56:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:12.496 01:56:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:12.496 01:56:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:12.496 01:56:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:15.029 01:56:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:15.029 00:14:15.029 real 0m47.073s 00:14:15.029 user 3m34.220s 00:14:15.029 sys 0m15.783s 00:14:15.029 01:56:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:15.029 01:56:48 -- common/autotest_common.sh@10 -- # set +x 00:14:15.029 ************************************ 00:14:15.029 END TEST nvmf_ns_hotplug_stress 00:14:15.029 ************************************ 00:14:15.029 01:56:48 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:15.029 01:56:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:15.029 01:56:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:15.029 01:56:48 -- common/autotest_common.sh@10 -- # set +x 00:14:15.029 ************************************ 00:14:15.029 START TEST nvmf_connect_stress 00:14:15.029 ************************************ 00:14:15.029 01:56:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:15.029 * Looking for test storage... 00:14:15.029 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:15.029 01:56:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:15.029 01:56:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:15.029 01:56:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:15.029 01:56:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:15.029 01:56:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:15.029 01:56:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:15.029 01:56:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:15.029 01:56:48 -- scripts/common.sh@335 -- # IFS=.-: 00:14:15.029 01:56:48 -- scripts/common.sh@335 -- # read -ra ver1 00:14:15.029 01:56:48 -- scripts/common.sh@336 -- # IFS=.-: 00:14:15.029 01:56:48 -- scripts/common.sh@336 -- # read -ra ver2 00:14:15.029 01:56:48 -- scripts/common.sh@337 -- # local 'op=<' 00:14:15.029 01:56:48 -- scripts/common.sh@339 -- # ver1_l=2 00:14:15.029 01:56:48 -- scripts/common.sh@340 -- # ver2_l=1 00:14:15.029 01:56:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:15.029 01:56:48 -- scripts/common.sh@343 -- # case "$op" in 00:14:15.029 01:56:48 -- scripts/common.sh@344 -- # : 1 00:14:15.029 01:56:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:15.029 01:56:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:15.029 01:56:48 -- scripts/common.sh@364 -- # decimal 1 00:14:15.029 01:56:48 -- scripts/common.sh@352 -- # local d=1 00:14:15.029 01:56:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:15.029 01:56:48 -- scripts/common.sh@354 -- # echo 1 00:14:15.029 01:56:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:15.029 01:56:48 -- scripts/common.sh@365 -- # decimal 2 00:14:15.029 01:56:48 -- scripts/common.sh@352 -- # local d=2 00:14:15.029 01:56:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:15.029 01:56:48 -- scripts/common.sh@354 -- # echo 2 00:14:15.029 01:56:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:15.029 01:56:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:15.029 01:56:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:15.029 01:56:48 -- scripts/common.sh@367 -- # return 0 00:14:15.029 01:56:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:15.029 01:56:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:15.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:15.029 --rc genhtml_branch_coverage=1 00:14:15.029 --rc genhtml_function_coverage=1 00:14:15.029 --rc genhtml_legend=1 00:14:15.029 --rc geninfo_all_blocks=1 00:14:15.029 --rc geninfo_unexecuted_blocks=1 00:14:15.029 00:14:15.029 ' 00:14:15.029 01:56:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:15.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:15.029 --rc genhtml_branch_coverage=1 00:14:15.029 --rc genhtml_function_coverage=1 00:14:15.029 --rc genhtml_legend=1 00:14:15.029 --rc geninfo_all_blocks=1 00:14:15.029 --rc geninfo_unexecuted_blocks=1 00:14:15.029 00:14:15.029 ' 00:14:15.029 01:56:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:15.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:15.029 --rc genhtml_branch_coverage=1 00:14:15.029 --rc genhtml_function_coverage=1 00:14:15.029 --rc genhtml_legend=1 00:14:15.029 --rc geninfo_all_blocks=1 00:14:15.029 --rc geninfo_unexecuted_blocks=1 00:14:15.029 00:14:15.029 ' 00:14:15.029 01:56:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:15.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:15.029 --rc genhtml_branch_coverage=1 00:14:15.029 --rc genhtml_function_coverage=1 00:14:15.029 --rc genhtml_legend=1 00:14:15.029 --rc geninfo_all_blocks=1 00:14:15.029 --rc geninfo_unexecuted_blocks=1 00:14:15.029 00:14:15.029 ' 00:14:15.029 01:56:48 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:15.029 01:56:48 -- nvmf/common.sh@7 -- # uname -s 00:14:15.029 01:56:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:15.029 01:56:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:15.029 01:56:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:15.029 01:56:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:15.029 01:56:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:15.029 01:56:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:15.029 01:56:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:15.029 01:56:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:15.029 01:56:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:15.029 01:56:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:15.029 01:56:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:15.029 01:56:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:15.029 01:56:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:15.030 01:56:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:15.030 01:56:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:15.030 01:56:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:15.030 01:56:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:15.030 01:56:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:15.030 01:56:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:15.030 01:56:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:15.030 01:56:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:15.030 01:56:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:15.030 01:56:49 -- paths/export.sh@5 -- # export PATH 00:14:15.030 01:56:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:15.030 01:56:49 -- nvmf/common.sh@46 -- # : 0 00:14:15.030 01:56:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:15.030 01:56:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:15.030 01:56:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:15.030 01:56:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:15.030 01:56:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:15.030 01:56:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:15.030 01:56:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:15.030 01:56:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:15.030 01:56:49 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:15.030 01:56:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:15.030 01:56:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:15.030 01:56:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:15.030 01:56:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:15.030 01:56:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:15.030 01:56:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:15.030 01:56:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:15.030 01:56:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:15.030 01:56:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:15.030 01:56:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:15.030 01:56:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:15.030 01:56:49 -- common/autotest_common.sh@10 -- # set +x 00:14:16.929 01:56:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:16.929 01:56:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:16.929 01:56:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:16.929 01:56:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:16.929 01:56:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:16.929 01:56:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:16.929 01:56:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:16.929 01:56:50 -- nvmf/common.sh@294 -- # net_devs=() 00:14:16.929 01:56:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:16.929 01:56:50 -- nvmf/common.sh@295 -- # e810=() 00:14:16.929 01:56:50 -- nvmf/common.sh@295 -- # local -ga e810 00:14:16.929 01:56:50 -- nvmf/common.sh@296 -- # x722=() 00:14:16.929 01:56:50 -- nvmf/common.sh@296 -- # local -ga x722 00:14:16.929 01:56:50 -- nvmf/common.sh@297 -- # mlx=() 00:14:16.929 01:56:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:16.929 01:56:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:16.929 01:56:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:16.929 01:56:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:16.929 01:56:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:16.929 01:56:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:16.929 01:56:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:16.929 01:56:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:16.929 01:56:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:16.930 01:56:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:16.930 01:56:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:16.930 01:56:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:16.930 01:56:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:16.930 01:56:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:16.930 01:56:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:16.930 01:56:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:16.930 01:56:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:16.930 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:16.930 01:56:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:16.930 01:56:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:16.930 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:16.930 01:56:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:16.930 01:56:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:16.930 01:56:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:16.930 01:56:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:16.930 01:56:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:16.930 01:56:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:16.930 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:16.930 01:56:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:16.930 01:56:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:16.930 01:56:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:16.930 01:56:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:16.930 01:56:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:16.930 01:56:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:16.930 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:16.930 01:56:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:16.930 01:56:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:16.930 01:56:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:16.930 01:56:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:16.930 01:56:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:16.930 01:56:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:16.930 01:56:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:16.930 01:56:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:16.930 01:56:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:16.930 01:56:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:16.930 01:56:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:16.930 01:56:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:16.930 01:56:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:16.930 01:56:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:16.930 01:56:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:16.930 01:56:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:16.930 01:56:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:16.930 01:56:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:16.930 01:56:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:16.930 01:56:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:16.930 01:56:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:16.930 01:56:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:16.930 01:56:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:16.930 01:56:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:16.930 01:56:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:16.930 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:16.930 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.197 ms 00:14:16.930 00:14:16.930 --- 10.0.0.2 ping statistics --- 00:14:16.930 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:16.930 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:14:16.930 01:56:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:16.930 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:16.930 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.162 ms 00:14:16.930 00:14:16.930 --- 10.0.0.1 ping statistics --- 00:14:16.930 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:16.930 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:14:16.930 01:56:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:16.930 01:56:51 -- nvmf/common.sh@410 -- # return 0 00:14:16.930 01:56:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:16.930 01:56:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:16.930 01:56:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:16.930 01:56:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:16.930 01:56:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:16.930 01:56:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:16.930 01:56:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:16.930 01:56:51 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:16.930 01:56:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:16.930 01:56:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:16.930 01:56:51 -- common/autotest_common.sh@10 -- # set +x 00:14:16.930 01:56:51 -- nvmf/common.sh@469 -- # nvmfpid=1166813 00:14:16.930 01:56:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:16.930 01:56:51 -- nvmf/common.sh@470 -- # waitforlisten 1166813 00:14:16.930 01:56:51 -- common/autotest_common.sh@829 -- # '[' -z 1166813 ']' 00:14:16.930 01:56:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:16.930 01:56:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:16.930 01:56:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:16.930 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:16.930 01:56:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:16.930 01:56:51 -- common/autotest_common.sh@10 -- # set +x 00:14:16.930 [2024-11-18 01:56:51.114433] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:16.930 [2024-11-18 01:56:51.114509] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:16.930 EAL: No free 2048 kB hugepages reported on node 1 00:14:16.930 [2024-11-18 01:56:51.179707] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:16.930 [2024-11-18 01:56:51.268824] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:16.930 [2024-11-18 01:56:51.268981] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:16.930 [2024-11-18 01:56:51.269000] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:16.930 [2024-11-18 01:56:51.269013] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:16.930 [2024-11-18 01:56:51.269106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:16.930 [2024-11-18 01:56:51.269159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:16.930 [2024-11-18 01:56:51.269161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:17.863 01:56:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:17.863 01:56:52 -- common/autotest_common.sh@862 -- # return 0 00:14:17.863 01:56:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:17.863 01:56:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:17.863 01:56:52 -- common/autotest_common.sh@10 -- # set +x 00:14:17.863 01:56:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:17.863 01:56:52 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:17.863 01:56:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.863 01:56:52 -- common/autotest_common.sh@10 -- # set +x 00:14:17.863 [2024-11-18 01:56:52.125079] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:17.863 01:56:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.863 01:56:52 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:17.863 01:56:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.863 01:56:52 -- common/autotest_common.sh@10 -- # set +x 00:14:17.863 01:56:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.863 01:56:52 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:17.863 01:56:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.863 01:56:52 -- common/autotest_common.sh@10 -- # set +x 00:14:17.863 [2024-11-18 01:56:52.152487] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:17.863 01:56:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.863 01:56:52 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:17.863 01:56:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.863 01:56:52 -- common/autotest_common.sh@10 -- # set +x 00:14:17.863 NULL1 00:14:17.863 01:56:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.863 01:56:52 -- target/connect_stress.sh@21 -- # PERF_PID=1166972 00:14:17.863 01:56:52 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:17.863 01:56:52 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:17.863 01:56:52 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 EAL: No free 2048 kB hugepages reported on node 1 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.863 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.863 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.864 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.864 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.864 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.864 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.864 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.864 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.864 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.864 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.864 01:56:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:17.864 01:56:52 -- target/connect_stress.sh@28 -- # cat 00:14:17.864 01:56:52 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:17.864 01:56:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:17.864 01:56:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.864 01:56:52 -- common/autotest_common.sh@10 -- # set +x 00:14:18.429 01:56:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.429 01:56:52 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:18.429 01:56:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:18.429 01:56:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.429 01:56:52 -- common/autotest_common.sh@10 -- # set +x 00:14:18.687 01:56:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.687 01:56:52 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:18.687 01:56:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:18.687 01:56:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.687 01:56:52 -- common/autotest_common.sh@10 -- # set +x 00:14:18.945 01:56:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.945 01:56:53 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:18.945 01:56:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:18.945 01:56:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.945 01:56:53 -- common/autotest_common.sh@10 -- # set +x 00:14:19.203 01:56:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:19.203 01:56:53 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:19.203 01:56:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:19.203 01:56:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:19.203 01:56:53 -- common/autotest_common.sh@10 -- # set +x 00:14:19.461 01:56:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:19.461 01:56:53 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:19.461 01:56:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:19.461 01:56:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:19.461 01:56:53 -- common/autotest_common.sh@10 -- # set +x 00:14:20.026 01:56:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.026 01:56:54 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:20.026 01:56:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:20.026 01:56:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.026 01:56:54 -- common/autotest_common.sh@10 -- # set +x 00:14:20.284 01:56:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.284 01:56:54 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:20.284 01:56:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:20.284 01:56:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.284 01:56:54 -- common/autotest_common.sh@10 -- # set +x 00:14:20.542 01:56:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.542 01:56:54 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:20.542 01:56:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:20.542 01:56:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.542 01:56:54 -- common/autotest_common.sh@10 -- # set +x 00:14:20.799 01:56:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.799 01:56:55 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:20.799 01:56:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:20.799 01:56:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.799 01:56:55 -- common/autotest_common.sh@10 -- # set +x 00:14:21.057 01:56:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.057 01:56:55 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:21.057 01:56:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:21.057 01:56:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.057 01:56:55 -- common/autotest_common.sh@10 -- # set +x 00:14:21.623 01:56:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.623 01:56:55 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:21.623 01:56:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:21.623 01:56:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.623 01:56:55 -- common/autotest_common.sh@10 -- # set +x 00:14:21.881 01:56:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.881 01:56:56 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:21.881 01:56:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:21.881 01:56:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.881 01:56:56 -- common/autotest_common.sh@10 -- # set +x 00:14:22.139 01:56:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.139 01:56:56 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:22.139 01:56:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:22.139 01:56:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.139 01:56:56 -- common/autotest_common.sh@10 -- # set +x 00:14:22.396 01:56:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.396 01:56:56 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:22.396 01:56:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:22.396 01:56:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.396 01:56:56 -- common/autotest_common.sh@10 -- # set +x 00:14:22.654 01:56:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.654 01:56:57 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:22.654 01:56:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:22.654 01:56:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.654 01:56:57 -- common/autotest_common.sh@10 -- # set +x 00:14:23.220 01:56:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.220 01:56:57 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:23.220 01:56:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:23.220 01:56:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.220 01:56:57 -- common/autotest_common.sh@10 -- # set +x 00:14:23.477 01:56:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.477 01:56:57 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:23.477 01:56:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:23.477 01:56:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.477 01:56:57 -- common/autotest_common.sh@10 -- # set +x 00:14:23.735 01:56:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.735 01:56:57 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:23.735 01:56:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:23.735 01:56:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.735 01:56:57 -- common/autotest_common.sh@10 -- # set +x 00:14:23.992 01:56:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.993 01:56:58 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:23.993 01:56:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:23.993 01:56:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.993 01:56:58 -- common/autotest_common.sh@10 -- # set +x 00:14:24.250 01:56:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:24.250 01:56:58 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:24.250 01:56:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:24.250 01:56:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:24.250 01:56:58 -- common/autotest_common.sh@10 -- # set +x 00:14:24.815 01:56:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:24.815 01:56:58 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:24.816 01:56:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:24.816 01:56:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:24.816 01:56:58 -- common/autotest_common.sh@10 -- # set +x 00:14:25.073 01:56:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:25.073 01:56:59 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:25.073 01:56:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:25.073 01:56:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:25.073 01:56:59 -- common/autotest_common.sh@10 -- # set +x 00:14:25.331 01:56:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:25.331 01:56:59 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:25.331 01:56:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:25.331 01:56:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:25.331 01:56:59 -- common/autotest_common.sh@10 -- # set +x 00:14:25.589 01:56:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:25.589 01:56:59 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:25.589 01:56:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:25.589 01:56:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:25.589 01:56:59 -- common/autotest_common.sh@10 -- # set +x 00:14:25.847 01:57:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:25.847 01:57:00 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:25.847 01:57:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:25.847 01:57:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:25.847 01:57:00 -- common/autotest_common.sh@10 -- # set +x 00:14:26.413 01:57:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:26.413 01:57:00 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:26.413 01:57:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:26.413 01:57:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:26.413 01:57:00 -- common/autotest_common.sh@10 -- # set +x 00:14:26.671 01:57:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:26.671 01:57:00 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:26.671 01:57:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:26.671 01:57:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:26.671 01:57:00 -- common/autotest_common.sh@10 -- # set +x 00:14:26.930 01:57:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:26.930 01:57:01 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:26.930 01:57:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:26.930 01:57:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:26.930 01:57:01 -- common/autotest_common.sh@10 -- # set +x 00:14:27.187 01:57:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:27.187 01:57:01 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:27.187 01:57:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:27.187 01:57:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:27.187 01:57:01 -- common/autotest_common.sh@10 -- # set +x 00:14:27.753 01:57:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:27.753 01:57:01 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:27.753 01:57:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:27.753 01:57:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:27.753 01:57:01 -- common/autotest_common.sh@10 -- # set +x 00:14:28.011 01:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.011 01:57:02 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:28.011 01:57:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.011 01:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.011 01:57:02 -- common/autotest_common.sh@10 -- # set +x 00:14:28.011 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:28.269 01:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.269 01:57:02 -- target/connect_stress.sh@34 -- # kill -0 1166972 00:14:28.269 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1166972) - No such process 00:14:28.269 01:57:02 -- target/connect_stress.sh@38 -- # wait 1166972 00:14:28.269 01:57:02 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:28.269 01:57:02 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:28.269 01:57:02 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:28.269 01:57:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:28.269 01:57:02 -- nvmf/common.sh@116 -- # sync 00:14:28.269 01:57:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:28.269 01:57:02 -- nvmf/common.sh@119 -- # set +e 00:14:28.269 01:57:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:28.269 01:57:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:28.269 rmmod nvme_tcp 00:14:28.269 rmmod nvme_fabrics 00:14:28.269 rmmod nvme_keyring 00:14:28.269 01:57:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:28.269 01:57:02 -- nvmf/common.sh@123 -- # set -e 00:14:28.269 01:57:02 -- nvmf/common.sh@124 -- # return 0 00:14:28.269 01:57:02 -- nvmf/common.sh@477 -- # '[' -n 1166813 ']' 00:14:28.269 01:57:02 -- nvmf/common.sh@478 -- # killprocess 1166813 00:14:28.269 01:57:02 -- common/autotest_common.sh@936 -- # '[' -z 1166813 ']' 00:14:28.269 01:57:02 -- common/autotest_common.sh@940 -- # kill -0 1166813 00:14:28.269 01:57:02 -- common/autotest_common.sh@941 -- # uname 00:14:28.269 01:57:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:28.269 01:57:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1166813 00:14:28.269 01:57:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:28.269 01:57:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:28.269 01:57:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1166813' 00:14:28.269 killing process with pid 1166813 00:14:28.269 01:57:02 -- common/autotest_common.sh@955 -- # kill 1166813 00:14:28.269 01:57:02 -- common/autotest_common.sh@960 -- # wait 1166813 00:14:28.527 01:57:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:28.527 01:57:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:28.527 01:57:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:28.527 01:57:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:28.527 01:57:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:28.527 01:57:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:28.527 01:57:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:28.528 01:57:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:31.082 01:57:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:31.082 00:14:31.082 real 0m15.982s 00:14:31.082 user 0m40.865s 00:14:31.082 sys 0m5.704s 00:14:31.082 01:57:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:31.082 01:57:04 -- common/autotest_common.sh@10 -- # set +x 00:14:31.082 ************************************ 00:14:31.082 END TEST nvmf_connect_stress 00:14:31.082 ************************************ 00:14:31.082 01:57:04 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:31.082 01:57:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:31.082 01:57:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:31.082 01:57:04 -- common/autotest_common.sh@10 -- # set +x 00:14:31.082 ************************************ 00:14:31.082 START TEST nvmf_fused_ordering 00:14:31.082 ************************************ 00:14:31.082 01:57:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:31.082 * Looking for test storage... 00:14:31.082 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:31.082 01:57:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:31.082 01:57:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:31.082 01:57:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:31.082 01:57:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:31.082 01:57:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:31.082 01:57:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:31.082 01:57:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:31.082 01:57:05 -- scripts/common.sh@335 -- # IFS=.-: 00:14:31.082 01:57:05 -- scripts/common.sh@335 -- # read -ra ver1 00:14:31.082 01:57:05 -- scripts/common.sh@336 -- # IFS=.-: 00:14:31.082 01:57:05 -- scripts/common.sh@336 -- # read -ra ver2 00:14:31.082 01:57:05 -- scripts/common.sh@337 -- # local 'op=<' 00:14:31.082 01:57:05 -- scripts/common.sh@339 -- # ver1_l=2 00:14:31.082 01:57:05 -- scripts/common.sh@340 -- # ver2_l=1 00:14:31.082 01:57:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:31.082 01:57:05 -- scripts/common.sh@343 -- # case "$op" in 00:14:31.082 01:57:05 -- scripts/common.sh@344 -- # : 1 00:14:31.082 01:57:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:31.082 01:57:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:31.082 01:57:05 -- scripts/common.sh@364 -- # decimal 1 00:14:31.082 01:57:05 -- scripts/common.sh@352 -- # local d=1 00:14:31.082 01:57:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:31.082 01:57:05 -- scripts/common.sh@354 -- # echo 1 00:14:31.082 01:57:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:31.082 01:57:05 -- scripts/common.sh@365 -- # decimal 2 00:14:31.082 01:57:05 -- scripts/common.sh@352 -- # local d=2 00:14:31.082 01:57:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:31.082 01:57:05 -- scripts/common.sh@354 -- # echo 2 00:14:31.082 01:57:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:31.082 01:57:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:31.082 01:57:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:31.082 01:57:05 -- scripts/common.sh@367 -- # return 0 00:14:31.082 01:57:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:31.082 01:57:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:31.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:31.082 --rc genhtml_branch_coverage=1 00:14:31.082 --rc genhtml_function_coverage=1 00:14:31.082 --rc genhtml_legend=1 00:14:31.082 --rc geninfo_all_blocks=1 00:14:31.082 --rc geninfo_unexecuted_blocks=1 00:14:31.082 00:14:31.082 ' 00:14:31.082 01:57:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:31.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:31.082 --rc genhtml_branch_coverage=1 00:14:31.082 --rc genhtml_function_coverage=1 00:14:31.082 --rc genhtml_legend=1 00:14:31.082 --rc geninfo_all_blocks=1 00:14:31.082 --rc geninfo_unexecuted_blocks=1 00:14:31.082 00:14:31.082 ' 00:14:31.082 01:57:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:31.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:31.082 --rc genhtml_branch_coverage=1 00:14:31.082 --rc genhtml_function_coverage=1 00:14:31.082 --rc genhtml_legend=1 00:14:31.082 --rc geninfo_all_blocks=1 00:14:31.082 --rc geninfo_unexecuted_blocks=1 00:14:31.082 00:14:31.082 ' 00:14:31.083 01:57:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:31.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:31.083 --rc genhtml_branch_coverage=1 00:14:31.083 --rc genhtml_function_coverage=1 00:14:31.083 --rc genhtml_legend=1 00:14:31.083 --rc geninfo_all_blocks=1 00:14:31.083 --rc geninfo_unexecuted_blocks=1 00:14:31.083 00:14:31.083 ' 00:14:31.083 01:57:05 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:31.083 01:57:05 -- nvmf/common.sh@7 -- # uname -s 00:14:31.083 01:57:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:31.083 01:57:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:31.083 01:57:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:31.083 01:57:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:31.083 01:57:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:31.083 01:57:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:31.083 01:57:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:31.083 01:57:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:31.083 01:57:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:31.083 01:57:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:31.083 01:57:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:31.083 01:57:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:31.083 01:57:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:31.083 01:57:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:31.083 01:57:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:31.083 01:57:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:31.083 01:57:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:31.083 01:57:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:31.083 01:57:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:31.083 01:57:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.083 01:57:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.083 01:57:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.083 01:57:05 -- paths/export.sh@5 -- # export PATH 00:14:31.083 01:57:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.083 01:57:05 -- nvmf/common.sh@46 -- # : 0 00:14:31.083 01:57:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:31.083 01:57:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:31.083 01:57:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:31.083 01:57:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:31.083 01:57:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:31.083 01:57:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:31.083 01:57:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:31.083 01:57:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:31.083 01:57:05 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:31.083 01:57:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:31.083 01:57:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:31.083 01:57:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:31.083 01:57:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:31.083 01:57:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:31.083 01:57:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:31.083 01:57:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:31.083 01:57:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:31.083 01:57:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:31.083 01:57:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:31.083 01:57:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:31.083 01:57:05 -- common/autotest_common.sh@10 -- # set +x 00:14:32.983 01:57:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:32.983 01:57:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:32.983 01:57:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:32.983 01:57:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:32.983 01:57:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:32.983 01:57:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:32.983 01:57:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:32.983 01:57:06 -- nvmf/common.sh@294 -- # net_devs=() 00:14:32.983 01:57:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:32.983 01:57:06 -- nvmf/common.sh@295 -- # e810=() 00:14:32.983 01:57:06 -- nvmf/common.sh@295 -- # local -ga e810 00:14:32.984 01:57:06 -- nvmf/common.sh@296 -- # x722=() 00:14:32.984 01:57:06 -- nvmf/common.sh@296 -- # local -ga x722 00:14:32.984 01:57:06 -- nvmf/common.sh@297 -- # mlx=() 00:14:32.984 01:57:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:32.984 01:57:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:32.984 01:57:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:32.984 01:57:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:32.984 01:57:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:32.984 01:57:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:32.984 01:57:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:32.984 01:57:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:32.984 01:57:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:32.984 01:57:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:32.984 01:57:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:32.984 01:57:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:32.984 01:57:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:32.984 01:57:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:32.984 01:57:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:32.984 01:57:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:32.984 01:57:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:32.984 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:32.984 01:57:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:32.984 01:57:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:32.984 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:32.984 01:57:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:32.984 01:57:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:32.984 01:57:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:32.984 01:57:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:32.984 01:57:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:32.984 01:57:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:32.984 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:32.984 01:57:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:32.984 01:57:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:32.984 01:57:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:32.984 01:57:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:32.984 01:57:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:32.984 01:57:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:32.984 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:32.984 01:57:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:32.984 01:57:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:32.984 01:57:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:32.984 01:57:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:32.984 01:57:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:32.984 01:57:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:32.984 01:57:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:32.984 01:57:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:32.984 01:57:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:32.984 01:57:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:32.984 01:57:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:32.984 01:57:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:32.984 01:57:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:32.984 01:57:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:32.984 01:57:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:32.984 01:57:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:32.984 01:57:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:32.984 01:57:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:32.984 01:57:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:32.984 01:57:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:32.984 01:57:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:32.984 01:57:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:32.984 01:57:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:32.984 01:57:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:32.984 01:57:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:32.984 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:32.984 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:14:32.984 00:14:32.984 --- 10.0.0.2 ping statistics --- 00:14:32.984 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:32.984 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:14:32.984 01:57:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:32.984 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:32.984 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.086 ms 00:14:32.984 00:14:32.984 --- 10.0.0.1 ping statistics --- 00:14:32.984 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:32.984 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:14:32.984 01:57:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:32.984 01:57:07 -- nvmf/common.sh@410 -- # return 0 00:14:32.984 01:57:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:32.984 01:57:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:32.984 01:57:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:32.984 01:57:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:32.984 01:57:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:32.984 01:57:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:32.984 01:57:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:32.984 01:57:07 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:32.984 01:57:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:32.984 01:57:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:32.984 01:57:07 -- common/autotest_common.sh@10 -- # set +x 00:14:32.984 01:57:07 -- nvmf/common.sh@469 -- # nvmfpid=1170288 00:14:32.984 01:57:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:32.984 01:57:07 -- nvmf/common.sh@470 -- # waitforlisten 1170288 00:14:32.984 01:57:07 -- common/autotest_common.sh@829 -- # '[' -z 1170288 ']' 00:14:32.984 01:57:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:32.984 01:57:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:32.984 01:57:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:32.984 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:32.984 01:57:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:32.984 01:57:07 -- common/autotest_common.sh@10 -- # set +x 00:14:32.984 [2024-11-18 01:57:07.155225] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:32.984 [2024-11-18 01:57:07.155291] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:32.984 EAL: No free 2048 kB hugepages reported on node 1 00:14:32.984 [2024-11-18 01:57:07.220167] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:32.984 [2024-11-18 01:57:07.310898] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:32.984 [2024-11-18 01:57:07.311078] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:32.984 [2024-11-18 01:57:07.311097] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:32.984 [2024-11-18 01:57:07.311112] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:32.984 [2024-11-18 01:57:07.311152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:33.918 01:57:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:33.918 01:57:08 -- common/autotest_common.sh@862 -- # return 0 00:14:33.918 01:57:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:33.918 01:57:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:33.918 01:57:08 -- common/autotest_common.sh@10 -- # set +x 00:14:33.918 01:57:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:33.918 01:57:08 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:33.918 01:57:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.918 01:57:08 -- common/autotest_common.sh@10 -- # set +x 00:14:33.918 [2024-11-18 01:57:08.156922] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:33.918 01:57:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.918 01:57:08 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:33.918 01:57:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.918 01:57:08 -- common/autotest_common.sh@10 -- # set +x 00:14:33.918 01:57:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.918 01:57:08 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:33.919 01:57:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.919 01:57:08 -- common/autotest_common.sh@10 -- # set +x 00:14:33.919 [2024-11-18 01:57:08.173115] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:33.919 01:57:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.919 01:57:08 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:33.919 01:57:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.919 01:57:08 -- common/autotest_common.sh@10 -- # set +x 00:14:33.919 NULL1 00:14:33.919 01:57:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.919 01:57:08 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:33.919 01:57:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.919 01:57:08 -- common/autotest_common.sh@10 -- # set +x 00:14:33.919 01:57:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.919 01:57:08 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:33.919 01:57:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.919 01:57:08 -- common/autotest_common.sh@10 -- # set +x 00:14:33.919 01:57:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.919 01:57:08 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:33.919 [2024-11-18 01:57:08.217708] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:33.919 [2024-11-18 01:57:08.217749] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1170800 ] 00:14:33.919 EAL: No free 2048 kB hugepages reported on node 1 00:14:34.483 Attached to nqn.2016-06.io.spdk:cnode1 00:14:34.483 Namespace ID: 1 size: 1GB 00:14:34.483 fused_ordering(0) 00:14:34.483 fused_ordering(1) 00:14:34.483 fused_ordering(2) 00:14:34.483 fused_ordering(3) 00:14:34.483 fused_ordering(4) 00:14:34.483 fused_ordering(5) 00:14:34.483 fused_ordering(6) 00:14:34.483 fused_ordering(7) 00:14:34.483 fused_ordering(8) 00:14:34.483 fused_ordering(9) 00:14:34.483 fused_ordering(10) 00:14:34.483 fused_ordering(11) 00:14:34.483 fused_ordering(12) 00:14:34.483 fused_ordering(13) 00:14:34.483 fused_ordering(14) 00:14:34.483 fused_ordering(15) 00:14:34.483 fused_ordering(16) 00:14:34.483 fused_ordering(17) 00:14:34.483 fused_ordering(18) 00:14:34.483 fused_ordering(19) 00:14:34.483 fused_ordering(20) 00:14:34.483 fused_ordering(21) 00:14:34.483 fused_ordering(22) 00:14:34.483 fused_ordering(23) 00:14:34.483 fused_ordering(24) 00:14:34.483 fused_ordering(25) 00:14:34.483 fused_ordering(26) 00:14:34.483 fused_ordering(27) 00:14:34.483 fused_ordering(28) 00:14:34.483 fused_ordering(29) 00:14:34.483 fused_ordering(30) 00:14:34.483 fused_ordering(31) 00:14:34.483 fused_ordering(32) 00:14:34.483 fused_ordering(33) 00:14:34.483 fused_ordering(34) 00:14:34.483 fused_ordering(35) 00:14:34.483 fused_ordering(36) 00:14:34.483 fused_ordering(37) 00:14:34.483 fused_ordering(38) 00:14:34.483 fused_ordering(39) 00:14:34.483 fused_ordering(40) 00:14:34.484 fused_ordering(41) 00:14:34.484 fused_ordering(42) 00:14:34.484 fused_ordering(43) 00:14:34.484 fused_ordering(44) 00:14:34.484 fused_ordering(45) 00:14:34.484 fused_ordering(46) 00:14:34.484 fused_ordering(47) 00:14:34.484 fused_ordering(48) 00:14:34.484 fused_ordering(49) 00:14:34.484 fused_ordering(50) 00:14:34.484 fused_ordering(51) 00:14:34.484 fused_ordering(52) 00:14:34.484 fused_ordering(53) 00:14:34.484 fused_ordering(54) 00:14:34.484 fused_ordering(55) 00:14:34.484 fused_ordering(56) 00:14:34.484 fused_ordering(57) 00:14:34.484 fused_ordering(58) 00:14:34.484 fused_ordering(59) 00:14:34.484 fused_ordering(60) 00:14:34.484 fused_ordering(61) 00:14:34.484 fused_ordering(62) 00:14:34.484 fused_ordering(63) 00:14:34.484 fused_ordering(64) 00:14:34.484 fused_ordering(65) 00:14:34.484 fused_ordering(66) 00:14:34.484 fused_ordering(67) 00:14:34.484 fused_ordering(68) 00:14:34.484 fused_ordering(69) 00:14:34.484 fused_ordering(70) 00:14:34.484 fused_ordering(71) 00:14:34.484 fused_ordering(72) 00:14:34.484 fused_ordering(73) 00:14:34.484 fused_ordering(74) 00:14:34.484 fused_ordering(75) 00:14:34.484 fused_ordering(76) 00:14:34.484 fused_ordering(77) 00:14:34.484 fused_ordering(78) 00:14:34.484 fused_ordering(79) 00:14:34.484 fused_ordering(80) 00:14:34.484 fused_ordering(81) 00:14:34.484 fused_ordering(82) 00:14:34.484 fused_ordering(83) 00:14:34.484 fused_ordering(84) 00:14:34.484 fused_ordering(85) 00:14:34.484 fused_ordering(86) 00:14:34.484 fused_ordering(87) 00:14:34.484 fused_ordering(88) 00:14:34.484 fused_ordering(89) 00:14:34.484 fused_ordering(90) 00:14:34.484 fused_ordering(91) 00:14:34.484 fused_ordering(92) 00:14:34.484 fused_ordering(93) 00:14:34.484 fused_ordering(94) 00:14:34.484 fused_ordering(95) 00:14:34.484 fused_ordering(96) 00:14:34.484 fused_ordering(97) 00:14:34.484 fused_ordering(98) 00:14:34.484 fused_ordering(99) 00:14:34.484 fused_ordering(100) 00:14:34.484 fused_ordering(101) 00:14:34.484 fused_ordering(102) 00:14:34.484 fused_ordering(103) 00:14:34.484 fused_ordering(104) 00:14:34.484 fused_ordering(105) 00:14:34.484 fused_ordering(106) 00:14:34.484 fused_ordering(107) 00:14:34.484 fused_ordering(108) 00:14:34.484 fused_ordering(109) 00:14:34.484 fused_ordering(110) 00:14:34.484 fused_ordering(111) 00:14:34.484 fused_ordering(112) 00:14:34.484 fused_ordering(113) 00:14:34.484 fused_ordering(114) 00:14:34.484 fused_ordering(115) 00:14:34.484 fused_ordering(116) 00:14:34.484 fused_ordering(117) 00:14:34.484 fused_ordering(118) 00:14:34.484 fused_ordering(119) 00:14:34.484 fused_ordering(120) 00:14:34.484 fused_ordering(121) 00:14:34.484 fused_ordering(122) 00:14:34.484 fused_ordering(123) 00:14:34.484 fused_ordering(124) 00:14:34.484 fused_ordering(125) 00:14:34.484 fused_ordering(126) 00:14:34.484 fused_ordering(127) 00:14:34.484 fused_ordering(128) 00:14:34.484 fused_ordering(129) 00:14:34.484 fused_ordering(130) 00:14:34.484 fused_ordering(131) 00:14:34.484 fused_ordering(132) 00:14:34.484 fused_ordering(133) 00:14:34.484 fused_ordering(134) 00:14:34.484 fused_ordering(135) 00:14:34.484 fused_ordering(136) 00:14:34.484 fused_ordering(137) 00:14:34.484 fused_ordering(138) 00:14:34.484 fused_ordering(139) 00:14:34.484 fused_ordering(140) 00:14:34.484 fused_ordering(141) 00:14:34.484 fused_ordering(142) 00:14:34.484 fused_ordering(143) 00:14:34.484 fused_ordering(144) 00:14:34.484 fused_ordering(145) 00:14:34.484 fused_ordering(146) 00:14:34.484 fused_ordering(147) 00:14:34.484 fused_ordering(148) 00:14:34.484 fused_ordering(149) 00:14:34.484 fused_ordering(150) 00:14:34.484 fused_ordering(151) 00:14:34.484 fused_ordering(152) 00:14:34.484 fused_ordering(153) 00:14:34.484 fused_ordering(154) 00:14:34.484 fused_ordering(155) 00:14:34.484 fused_ordering(156) 00:14:34.484 fused_ordering(157) 00:14:34.484 fused_ordering(158) 00:14:34.484 fused_ordering(159) 00:14:34.484 fused_ordering(160) 00:14:34.484 fused_ordering(161) 00:14:34.484 fused_ordering(162) 00:14:34.484 fused_ordering(163) 00:14:34.484 fused_ordering(164) 00:14:34.484 fused_ordering(165) 00:14:34.484 fused_ordering(166) 00:14:34.484 fused_ordering(167) 00:14:34.484 fused_ordering(168) 00:14:34.484 fused_ordering(169) 00:14:34.484 fused_ordering(170) 00:14:34.484 fused_ordering(171) 00:14:34.484 fused_ordering(172) 00:14:34.484 fused_ordering(173) 00:14:34.484 fused_ordering(174) 00:14:34.484 fused_ordering(175) 00:14:34.484 fused_ordering(176) 00:14:34.484 fused_ordering(177) 00:14:34.484 fused_ordering(178) 00:14:34.484 fused_ordering(179) 00:14:34.484 fused_ordering(180) 00:14:34.484 fused_ordering(181) 00:14:34.484 fused_ordering(182) 00:14:34.484 fused_ordering(183) 00:14:34.484 fused_ordering(184) 00:14:34.484 fused_ordering(185) 00:14:34.484 fused_ordering(186) 00:14:34.484 fused_ordering(187) 00:14:34.484 fused_ordering(188) 00:14:34.484 fused_ordering(189) 00:14:34.484 fused_ordering(190) 00:14:34.484 fused_ordering(191) 00:14:34.484 fused_ordering(192) 00:14:34.484 fused_ordering(193) 00:14:34.484 fused_ordering(194) 00:14:34.484 fused_ordering(195) 00:14:34.484 fused_ordering(196) 00:14:34.484 fused_ordering(197) 00:14:34.484 fused_ordering(198) 00:14:34.484 fused_ordering(199) 00:14:34.484 fused_ordering(200) 00:14:34.484 fused_ordering(201) 00:14:34.484 fused_ordering(202) 00:14:34.484 fused_ordering(203) 00:14:34.484 fused_ordering(204) 00:14:34.484 fused_ordering(205) 00:14:34.742 fused_ordering(206) 00:14:34.742 fused_ordering(207) 00:14:34.742 fused_ordering(208) 00:14:34.742 fused_ordering(209) 00:14:34.742 fused_ordering(210) 00:14:34.742 fused_ordering(211) 00:14:34.742 fused_ordering(212) 00:14:34.742 fused_ordering(213) 00:14:34.742 fused_ordering(214) 00:14:34.742 fused_ordering(215) 00:14:34.742 fused_ordering(216) 00:14:34.742 fused_ordering(217) 00:14:34.742 fused_ordering(218) 00:14:34.742 fused_ordering(219) 00:14:34.742 fused_ordering(220) 00:14:34.742 fused_ordering(221) 00:14:34.742 fused_ordering(222) 00:14:34.742 fused_ordering(223) 00:14:34.742 fused_ordering(224) 00:14:34.742 fused_ordering(225) 00:14:34.742 fused_ordering(226) 00:14:34.742 fused_ordering(227) 00:14:34.742 fused_ordering(228) 00:14:34.742 fused_ordering(229) 00:14:34.742 fused_ordering(230) 00:14:34.742 fused_ordering(231) 00:14:34.742 fused_ordering(232) 00:14:34.742 fused_ordering(233) 00:14:34.742 fused_ordering(234) 00:14:34.742 fused_ordering(235) 00:14:34.742 fused_ordering(236) 00:14:34.742 fused_ordering(237) 00:14:34.742 fused_ordering(238) 00:14:34.742 fused_ordering(239) 00:14:34.742 fused_ordering(240) 00:14:34.742 fused_ordering(241) 00:14:34.742 fused_ordering(242) 00:14:34.742 fused_ordering(243) 00:14:34.742 fused_ordering(244) 00:14:34.742 fused_ordering(245) 00:14:34.742 fused_ordering(246) 00:14:34.742 fused_ordering(247) 00:14:34.742 fused_ordering(248) 00:14:34.742 fused_ordering(249) 00:14:34.742 fused_ordering(250) 00:14:34.742 fused_ordering(251) 00:14:34.742 fused_ordering(252) 00:14:34.742 fused_ordering(253) 00:14:34.742 fused_ordering(254) 00:14:34.742 fused_ordering(255) 00:14:34.742 fused_ordering(256) 00:14:34.742 fused_ordering(257) 00:14:34.742 fused_ordering(258) 00:14:34.742 fused_ordering(259) 00:14:34.742 fused_ordering(260) 00:14:34.742 fused_ordering(261) 00:14:34.742 fused_ordering(262) 00:14:34.742 fused_ordering(263) 00:14:34.742 fused_ordering(264) 00:14:34.742 fused_ordering(265) 00:14:34.742 fused_ordering(266) 00:14:34.742 fused_ordering(267) 00:14:34.742 fused_ordering(268) 00:14:34.742 fused_ordering(269) 00:14:34.742 fused_ordering(270) 00:14:34.742 fused_ordering(271) 00:14:34.742 fused_ordering(272) 00:14:34.742 fused_ordering(273) 00:14:34.742 fused_ordering(274) 00:14:34.742 fused_ordering(275) 00:14:34.742 fused_ordering(276) 00:14:34.742 fused_ordering(277) 00:14:34.742 fused_ordering(278) 00:14:34.742 fused_ordering(279) 00:14:34.742 fused_ordering(280) 00:14:34.742 fused_ordering(281) 00:14:34.742 fused_ordering(282) 00:14:34.742 fused_ordering(283) 00:14:34.742 fused_ordering(284) 00:14:34.742 fused_ordering(285) 00:14:34.742 fused_ordering(286) 00:14:34.742 fused_ordering(287) 00:14:34.742 fused_ordering(288) 00:14:34.742 fused_ordering(289) 00:14:34.742 fused_ordering(290) 00:14:34.742 fused_ordering(291) 00:14:34.742 fused_ordering(292) 00:14:34.742 fused_ordering(293) 00:14:34.742 fused_ordering(294) 00:14:34.742 fused_ordering(295) 00:14:34.742 fused_ordering(296) 00:14:34.742 fused_ordering(297) 00:14:34.742 fused_ordering(298) 00:14:34.742 fused_ordering(299) 00:14:34.742 fused_ordering(300) 00:14:34.742 fused_ordering(301) 00:14:34.742 fused_ordering(302) 00:14:34.742 fused_ordering(303) 00:14:34.742 fused_ordering(304) 00:14:34.742 fused_ordering(305) 00:14:34.742 fused_ordering(306) 00:14:34.742 fused_ordering(307) 00:14:34.742 fused_ordering(308) 00:14:34.742 fused_ordering(309) 00:14:34.742 fused_ordering(310) 00:14:34.742 fused_ordering(311) 00:14:34.742 fused_ordering(312) 00:14:34.742 fused_ordering(313) 00:14:34.742 fused_ordering(314) 00:14:34.742 fused_ordering(315) 00:14:34.742 fused_ordering(316) 00:14:34.742 fused_ordering(317) 00:14:34.742 fused_ordering(318) 00:14:34.743 fused_ordering(319) 00:14:34.743 fused_ordering(320) 00:14:34.743 fused_ordering(321) 00:14:34.743 fused_ordering(322) 00:14:34.743 fused_ordering(323) 00:14:34.743 fused_ordering(324) 00:14:34.743 fused_ordering(325) 00:14:34.743 fused_ordering(326) 00:14:34.743 fused_ordering(327) 00:14:34.743 fused_ordering(328) 00:14:34.743 fused_ordering(329) 00:14:34.743 fused_ordering(330) 00:14:34.743 fused_ordering(331) 00:14:34.743 fused_ordering(332) 00:14:34.743 fused_ordering(333) 00:14:34.743 fused_ordering(334) 00:14:34.743 fused_ordering(335) 00:14:34.743 fused_ordering(336) 00:14:34.743 fused_ordering(337) 00:14:34.743 fused_ordering(338) 00:14:34.743 fused_ordering(339) 00:14:34.743 fused_ordering(340) 00:14:34.743 fused_ordering(341) 00:14:34.743 fused_ordering(342) 00:14:34.743 fused_ordering(343) 00:14:34.743 fused_ordering(344) 00:14:34.743 fused_ordering(345) 00:14:34.743 fused_ordering(346) 00:14:34.743 fused_ordering(347) 00:14:34.743 fused_ordering(348) 00:14:34.743 fused_ordering(349) 00:14:34.743 fused_ordering(350) 00:14:34.743 fused_ordering(351) 00:14:34.743 fused_ordering(352) 00:14:34.743 fused_ordering(353) 00:14:34.743 fused_ordering(354) 00:14:34.743 fused_ordering(355) 00:14:34.743 fused_ordering(356) 00:14:34.743 fused_ordering(357) 00:14:34.743 fused_ordering(358) 00:14:34.743 fused_ordering(359) 00:14:34.743 fused_ordering(360) 00:14:34.743 fused_ordering(361) 00:14:34.743 fused_ordering(362) 00:14:34.743 fused_ordering(363) 00:14:34.743 fused_ordering(364) 00:14:34.743 fused_ordering(365) 00:14:34.743 fused_ordering(366) 00:14:34.743 fused_ordering(367) 00:14:34.743 fused_ordering(368) 00:14:34.743 fused_ordering(369) 00:14:34.743 fused_ordering(370) 00:14:34.743 fused_ordering(371) 00:14:34.743 fused_ordering(372) 00:14:34.743 fused_ordering(373) 00:14:34.743 fused_ordering(374) 00:14:34.743 fused_ordering(375) 00:14:34.743 fused_ordering(376) 00:14:34.743 fused_ordering(377) 00:14:34.743 fused_ordering(378) 00:14:34.743 fused_ordering(379) 00:14:34.743 fused_ordering(380) 00:14:34.743 fused_ordering(381) 00:14:34.743 fused_ordering(382) 00:14:34.743 fused_ordering(383) 00:14:34.743 fused_ordering(384) 00:14:34.743 fused_ordering(385) 00:14:34.743 fused_ordering(386) 00:14:34.743 fused_ordering(387) 00:14:34.743 fused_ordering(388) 00:14:34.743 fused_ordering(389) 00:14:34.743 fused_ordering(390) 00:14:34.743 fused_ordering(391) 00:14:34.743 fused_ordering(392) 00:14:34.743 fused_ordering(393) 00:14:34.743 fused_ordering(394) 00:14:34.743 fused_ordering(395) 00:14:34.743 fused_ordering(396) 00:14:34.743 fused_ordering(397) 00:14:34.743 fused_ordering(398) 00:14:34.743 fused_ordering(399) 00:14:34.743 fused_ordering(400) 00:14:34.743 fused_ordering(401) 00:14:34.743 fused_ordering(402) 00:14:34.743 fused_ordering(403) 00:14:34.743 fused_ordering(404) 00:14:34.743 fused_ordering(405) 00:14:34.743 fused_ordering(406) 00:14:34.743 fused_ordering(407) 00:14:34.743 fused_ordering(408) 00:14:34.743 fused_ordering(409) 00:14:34.743 fused_ordering(410) 00:14:35.308 fused_ordering(411) 00:14:35.308 fused_ordering(412) 00:14:35.308 fused_ordering(413) 00:14:35.308 fused_ordering(414) 00:14:35.308 fused_ordering(415) 00:14:35.308 fused_ordering(416) 00:14:35.308 fused_ordering(417) 00:14:35.308 fused_ordering(418) 00:14:35.308 fused_ordering(419) 00:14:35.308 fused_ordering(420) 00:14:35.308 fused_ordering(421) 00:14:35.308 fused_ordering(422) 00:14:35.308 fused_ordering(423) 00:14:35.308 fused_ordering(424) 00:14:35.308 fused_ordering(425) 00:14:35.308 fused_ordering(426) 00:14:35.308 fused_ordering(427) 00:14:35.308 fused_ordering(428) 00:14:35.308 fused_ordering(429) 00:14:35.308 fused_ordering(430) 00:14:35.308 fused_ordering(431) 00:14:35.308 fused_ordering(432) 00:14:35.308 fused_ordering(433) 00:14:35.308 fused_ordering(434) 00:14:35.308 fused_ordering(435) 00:14:35.308 fused_ordering(436) 00:14:35.308 fused_ordering(437) 00:14:35.308 fused_ordering(438) 00:14:35.308 fused_ordering(439) 00:14:35.308 fused_ordering(440) 00:14:35.308 fused_ordering(441) 00:14:35.308 fused_ordering(442) 00:14:35.308 fused_ordering(443) 00:14:35.308 fused_ordering(444) 00:14:35.308 fused_ordering(445) 00:14:35.308 fused_ordering(446) 00:14:35.308 fused_ordering(447) 00:14:35.308 fused_ordering(448) 00:14:35.308 fused_ordering(449) 00:14:35.308 fused_ordering(450) 00:14:35.308 fused_ordering(451) 00:14:35.308 fused_ordering(452) 00:14:35.308 fused_ordering(453) 00:14:35.308 fused_ordering(454) 00:14:35.308 fused_ordering(455) 00:14:35.308 fused_ordering(456) 00:14:35.308 fused_ordering(457) 00:14:35.308 fused_ordering(458) 00:14:35.308 fused_ordering(459) 00:14:35.308 fused_ordering(460) 00:14:35.308 fused_ordering(461) 00:14:35.308 fused_ordering(462) 00:14:35.308 fused_ordering(463) 00:14:35.308 fused_ordering(464) 00:14:35.308 fused_ordering(465) 00:14:35.308 fused_ordering(466) 00:14:35.308 fused_ordering(467) 00:14:35.308 fused_ordering(468) 00:14:35.308 fused_ordering(469) 00:14:35.308 fused_ordering(470) 00:14:35.308 fused_ordering(471) 00:14:35.308 fused_ordering(472) 00:14:35.308 fused_ordering(473) 00:14:35.308 fused_ordering(474) 00:14:35.308 fused_ordering(475) 00:14:35.308 fused_ordering(476) 00:14:35.308 fused_ordering(477) 00:14:35.308 fused_ordering(478) 00:14:35.308 fused_ordering(479) 00:14:35.308 fused_ordering(480) 00:14:35.308 fused_ordering(481) 00:14:35.308 fused_ordering(482) 00:14:35.308 fused_ordering(483) 00:14:35.308 fused_ordering(484) 00:14:35.308 fused_ordering(485) 00:14:35.308 fused_ordering(486) 00:14:35.308 fused_ordering(487) 00:14:35.308 fused_ordering(488) 00:14:35.308 fused_ordering(489) 00:14:35.308 fused_ordering(490) 00:14:35.308 fused_ordering(491) 00:14:35.308 fused_ordering(492) 00:14:35.308 fused_ordering(493) 00:14:35.308 fused_ordering(494) 00:14:35.308 fused_ordering(495) 00:14:35.308 fused_ordering(496) 00:14:35.308 fused_ordering(497) 00:14:35.308 fused_ordering(498) 00:14:35.308 fused_ordering(499) 00:14:35.308 fused_ordering(500) 00:14:35.308 fused_ordering(501) 00:14:35.308 fused_ordering(502) 00:14:35.308 fused_ordering(503) 00:14:35.308 fused_ordering(504) 00:14:35.308 fused_ordering(505) 00:14:35.308 fused_ordering(506) 00:14:35.308 fused_ordering(507) 00:14:35.308 fused_ordering(508) 00:14:35.308 fused_ordering(509) 00:14:35.308 fused_ordering(510) 00:14:35.308 fused_ordering(511) 00:14:35.308 fused_ordering(512) 00:14:35.308 fused_ordering(513) 00:14:35.308 fused_ordering(514) 00:14:35.308 fused_ordering(515) 00:14:35.308 fused_ordering(516) 00:14:35.308 fused_ordering(517) 00:14:35.308 fused_ordering(518) 00:14:35.308 fused_ordering(519) 00:14:35.308 fused_ordering(520) 00:14:35.308 fused_ordering(521) 00:14:35.308 fused_ordering(522) 00:14:35.308 fused_ordering(523) 00:14:35.308 fused_ordering(524) 00:14:35.308 fused_ordering(525) 00:14:35.308 fused_ordering(526) 00:14:35.308 fused_ordering(527) 00:14:35.308 fused_ordering(528) 00:14:35.308 fused_ordering(529) 00:14:35.308 fused_ordering(530) 00:14:35.308 fused_ordering(531) 00:14:35.308 fused_ordering(532) 00:14:35.308 fused_ordering(533) 00:14:35.308 fused_ordering(534) 00:14:35.308 fused_ordering(535) 00:14:35.308 fused_ordering(536) 00:14:35.308 fused_ordering(537) 00:14:35.308 fused_ordering(538) 00:14:35.308 fused_ordering(539) 00:14:35.308 fused_ordering(540) 00:14:35.308 fused_ordering(541) 00:14:35.308 fused_ordering(542) 00:14:35.308 fused_ordering(543) 00:14:35.308 fused_ordering(544) 00:14:35.308 fused_ordering(545) 00:14:35.308 fused_ordering(546) 00:14:35.308 fused_ordering(547) 00:14:35.308 fused_ordering(548) 00:14:35.308 fused_ordering(549) 00:14:35.308 fused_ordering(550) 00:14:35.308 fused_ordering(551) 00:14:35.308 fused_ordering(552) 00:14:35.308 fused_ordering(553) 00:14:35.308 fused_ordering(554) 00:14:35.308 fused_ordering(555) 00:14:35.308 fused_ordering(556) 00:14:35.308 fused_ordering(557) 00:14:35.308 fused_ordering(558) 00:14:35.308 fused_ordering(559) 00:14:35.308 fused_ordering(560) 00:14:35.308 fused_ordering(561) 00:14:35.308 fused_ordering(562) 00:14:35.308 fused_ordering(563) 00:14:35.308 fused_ordering(564) 00:14:35.308 fused_ordering(565) 00:14:35.308 fused_ordering(566) 00:14:35.308 fused_ordering(567) 00:14:35.308 fused_ordering(568) 00:14:35.308 fused_ordering(569) 00:14:35.308 fused_ordering(570) 00:14:35.308 fused_ordering(571) 00:14:35.308 fused_ordering(572) 00:14:35.308 fused_ordering(573) 00:14:35.308 fused_ordering(574) 00:14:35.308 fused_ordering(575) 00:14:35.308 fused_ordering(576) 00:14:35.308 fused_ordering(577) 00:14:35.308 fused_ordering(578) 00:14:35.308 fused_ordering(579) 00:14:35.308 fused_ordering(580) 00:14:35.308 fused_ordering(581) 00:14:35.308 fused_ordering(582) 00:14:35.308 fused_ordering(583) 00:14:35.308 fused_ordering(584) 00:14:35.308 fused_ordering(585) 00:14:35.308 fused_ordering(586) 00:14:35.308 fused_ordering(587) 00:14:35.308 fused_ordering(588) 00:14:35.308 fused_ordering(589) 00:14:35.308 fused_ordering(590) 00:14:35.308 fused_ordering(591) 00:14:35.308 fused_ordering(592) 00:14:35.308 fused_ordering(593) 00:14:35.308 fused_ordering(594) 00:14:35.308 fused_ordering(595) 00:14:35.308 fused_ordering(596) 00:14:35.308 fused_ordering(597) 00:14:35.308 fused_ordering(598) 00:14:35.308 fused_ordering(599) 00:14:35.308 fused_ordering(600) 00:14:35.308 fused_ordering(601) 00:14:35.308 fused_ordering(602) 00:14:35.308 fused_ordering(603) 00:14:35.308 fused_ordering(604) 00:14:35.308 fused_ordering(605) 00:14:35.308 fused_ordering(606) 00:14:35.308 fused_ordering(607) 00:14:35.308 fused_ordering(608) 00:14:35.308 fused_ordering(609) 00:14:35.308 fused_ordering(610) 00:14:35.308 fused_ordering(611) 00:14:35.308 fused_ordering(612) 00:14:35.308 fused_ordering(613) 00:14:35.308 fused_ordering(614) 00:14:35.308 fused_ordering(615) 00:14:35.874 fused_ordering(616) 00:14:35.874 fused_ordering(617) 00:14:35.874 fused_ordering(618) 00:14:35.874 fused_ordering(619) 00:14:35.874 fused_ordering(620) 00:14:35.874 fused_ordering(621) 00:14:35.874 fused_ordering(622) 00:14:35.874 fused_ordering(623) 00:14:35.874 fused_ordering(624) 00:14:35.874 fused_ordering(625) 00:14:35.874 fused_ordering(626) 00:14:35.874 fused_ordering(627) 00:14:35.874 fused_ordering(628) 00:14:35.874 fused_ordering(629) 00:14:35.874 fused_ordering(630) 00:14:35.874 fused_ordering(631) 00:14:35.874 fused_ordering(632) 00:14:35.874 fused_ordering(633) 00:14:35.874 fused_ordering(634) 00:14:35.874 fused_ordering(635) 00:14:35.874 fused_ordering(636) 00:14:35.874 fused_ordering(637) 00:14:35.874 fused_ordering(638) 00:14:35.874 fused_ordering(639) 00:14:35.874 fused_ordering(640) 00:14:35.874 fused_ordering(641) 00:14:35.874 fused_ordering(642) 00:14:35.874 fused_ordering(643) 00:14:35.874 fused_ordering(644) 00:14:35.874 fused_ordering(645) 00:14:35.874 fused_ordering(646) 00:14:35.874 fused_ordering(647) 00:14:35.874 fused_ordering(648) 00:14:35.874 fused_ordering(649) 00:14:35.874 fused_ordering(650) 00:14:35.874 fused_ordering(651) 00:14:35.874 fused_ordering(652) 00:14:35.874 fused_ordering(653) 00:14:35.874 fused_ordering(654) 00:14:35.874 fused_ordering(655) 00:14:35.874 fused_ordering(656) 00:14:35.874 fused_ordering(657) 00:14:35.874 fused_ordering(658) 00:14:35.874 fused_ordering(659) 00:14:35.874 fused_ordering(660) 00:14:35.874 fused_ordering(661) 00:14:35.874 fused_ordering(662) 00:14:35.874 fused_ordering(663) 00:14:35.874 fused_ordering(664) 00:14:35.874 fused_ordering(665) 00:14:35.874 fused_ordering(666) 00:14:35.874 fused_ordering(667) 00:14:35.874 fused_ordering(668) 00:14:35.874 fused_ordering(669) 00:14:35.874 fused_ordering(670) 00:14:35.874 fused_ordering(671) 00:14:35.874 fused_ordering(672) 00:14:35.874 fused_ordering(673) 00:14:35.874 fused_ordering(674) 00:14:35.874 fused_ordering(675) 00:14:35.874 fused_ordering(676) 00:14:35.874 fused_ordering(677) 00:14:35.874 fused_ordering(678) 00:14:35.874 fused_ordering(679) 00:14:35.874 fused_ordering(680) 00:14:35.874 fused_ordering(681) 00:14:35.874 fused_ordering(682) 00:14:35.874 fused_ordering(683) 00:14:35.874 fused_ordering(684) 00:14:35.874 fused_ordering(685) 00:14:35.874 fused_ordering(686) 00:14:35.874 fused_ordering(687) 00:14:35.874 fused_ordering(688) 00:14:35.874 fused_ordering(689) 00:14:35.874 fused_ordering(690) 00:14:35.874 fused_ordering(691) 00:14:35.874 fused_ordering(692) 00:14:35.874 fused_ordering(693) 00:14:35.874 fused_ordering(694) 00:14:35.874 fused_ordering(695) 00:14:35.874 fused_ordering(696) 00:14:35.874 fused_ordering(697) 00:14:35.874 fused_ordering(698) 00:14:35.874 fused_ordering(699) 00:14:35.874 fused_ordering(700) 00:14:35.874 fused_ordering(701) 00:14:35.874 fused_ordering(702) 00:14:35.874 fused_ordering(703) 00:14:35.874 fused_ordering(704) 00:14:35.874 fused_ordering(705) 00:14:35.874 fused_ordering(706) 00:14:35.874 fused_ordering(707) 00:14:35.874 fused_ordering(708) 00:14:35.874 fused_ordering(709) 00:14:35.874 fused_ordering(710) 00:14:35.874 fused_ordering(711) 00:14:35.875 fused_ordering(712) 00:14:35.875 fused_ordering(713) 00:14:35.875 fused_ordering(714) 00:14:35.875 fused_ordering(715) 00:14:35.875 fused_ordering(716) 00:14:35.875 fused_ordering(717) 00:14:35.875 fused_ordering(718) 00:14:35.875 fused_ordering(719) 00:14:35.875 fused_ordering(720) 00:14:35.875 fused_ordering(721) 00:14:35.875 fused_ordering(722) 00:14:35.875 fused_ordering(723) 00:14:35.875 fused_ordering(724) 00:14:35.875 fused_ordering(725) 00:14:35.875 fused_ordering(726) 00:14:35.875 fused_ordering(727) 00:14:35.875 fused_ordering(728) 00:14:35.875 fused_ordering(729) 00:14:35.875 fused_ordering(730) 00:14:35.875 fused_ordering(731) 00:14:35.875 fused_ordering(732) 00:14:35.875 fused_ordering(733) 00:14:35.875 fused_ordering(734) 00:14:35.875 fused_ordering(735) 00:14:35.875 fused_ordering(736) 00:14:35.875 fused_ordering(737) 00:14:35.875 fused_ordering(738) 00:14:35.875 fused_ordering(739) 00:14:35.875 fused_ordering(740) 00:14:35.875 fused_ordering(741) 00:14:35.875 fused_ordering(742) 00:14:35.875 fused_ordering(743) 00:14:35.875 fused_ordering(744) 00:14:35.875 fused_ordering(745) 00:14:35.875 fused_ordering(746) 00:14:35.875 fused_ordering(747) 00:14:35.875 fused_ordering(748) 00:14:35.875 fused_ordering(749) 00:14:35.875 fused_ordering(750) 00:14:35.875 fused_ordering(751) 00:14:35.875 fused_ordering(752) 00:14:35.875 fused_ordering(753) 00:14:35.875 fused_ordering(754) 00:14:35.875 fused_ordering(755) 00:14:35.875 fused_ordering(756) 00:14:35.875 fused_ordering(757) 00:14:35.875 fused_ordering(758) 00:14:35.875 fused_ordering(759) 00:14:35.875 fused_ordering(760) 00:14:35.875 fused_ordering(761) 00:14:35.875 fused_ordering(762) 00:14:35.875 fused_ordering(763) 00:14:35.875 fused_ordering(764) 00:14:35.875 fused_ordering(765) 00:14:35.875 fused_ordering(766) 00:14:35.875 fused_ordering(767) 00:14:35.875 fused_ordering(768) 00:14:35.875 fused_ordering(769) 00:14:35.875 fused_ordering(770) 00:14:35.875 fused_ordering(771) 00:14:35.875 fused_ordering(772) 00:14:35.875 fused_ordering(773) 00:14:35.875 fused_ordering(774) 00:14:35.875 fused_ordering(775) 00:14:35.875 fused_ordering(776) 00:14:35.875 fused_ordering(777) 00:14:35.875 fused_ordering(778) 00:14:35.875 fused_ordering(779) 00:14:35.875 fused_ordering(780) 00:14:35.875 fused_ordering(781) 00:14:35.875 fused_ordering(782) 00:14:35.875 fused_ordering(783) 00:14:35.875 fused_ordering(784) 00:14:35.875 fused_ordering(785) 00:14:35.875 fused_ordering(786) 00:14:35.875 fused_ordering(787) 00:14:35.875 fused_ordering(788) 00:14:35.875 fused_ordering(789) 00:14:35.875 fused_ordering(790) 00:14:35.875 fused_ordering(791) 00:14:35.875 fused_ordering(792) 00:14:35.875 fused_ordering(793) 00:14:35.875 fused_ordering(794) 00:14:35.875 fused_ordering(795) 00:14:35.875 fused_ordering(796) 00:14:35.875 fused_ordering(797) 00:14:35.875 fused_ordering(798) 00:14:35.875 fused_ordering(799) 00:14:35.875 fused_ordering(800) 00:14:35.875 fused_ordering(801) 00:14:35.875 fused_ordering(802) 00:14:35.875 fused_ordering(803) 00:14:35.875 fused_ordering(804) 00:14:35.875 fused_ordering(805) 00:14:35.875 fused_ordering(806) 00:14:35.875 fused_ordering(807) 00:14:35.875 fused_ordering(808) 00:14:35.875 fused_ordering(809) 00:14:35.875 fused_ordering(810) 00:14:35.875 fused_ordering(811) 00:14:35.875 fused_ordering(812) 00:14:35.875 fused_ordering(813) 00:14:35.875 fused_ordering(814) 00:14:35.875 fused_ordering(815) 00:14:35.875 fused_ordering(816) 00:14:35.875 fused_ordering(817) 00:14:35.875 fused_ordering(818) 00:14:35.875 fused_ordering(819) 00:14:35.875 fused_ordering(820) 00:14:36.441 fused_ordering(821) 00:14:36.441 fused_ordering(822) 00:14:36.441 fused_ordering(823) 00:14:36.441 fused_ordering(824) 00:14:36.441 fused_ordering(825) 00:14:36.441 fused_ordering(826) 00:14:36.441 fused_ordering(827) 00:14:36.441 fused_ordering(828) 00:14:36.441 fused_ordering(829) 00:14:36.441 fused_ordering(830) 00:14:36.441 fused_ordering(831) 00:14:36.441 fused_ordering(832) 00:14:36.441 fused_ordering(833) 00:14:36.441 fused_ordering(834) 00:14:36.441 fused_ordering(835) 00:14:36.441 fused_ordering(836) 00:14:36.441 fused_ordering(837) 00:14:36.441 fused_ordering(838) 00:14:36.441 fused_ordering(839) 00:14:36.441 fused_ordering(840) 00:14:36.441 fused_ordering(841) 00:14:36.441 fused_ordering(842) 00:14:36.441 fused_ordering(843) 00:14:36.441 fused_ordering(844) 00:14:36.441 fused_ordering(845) 00:14:36.441 fused_ordering(846) 00:14:36.441 fused_ordering(847) 00:14:36.441 fused_ordering(848) 00:14:36.441 fused_ordering(849) 00:14:36.441 fused_ordering(850) 00:14:36.441 fused_ordering(851) 00:14:36.441 fused_ordering(852) 00:14:36.441 fused_ordering(853) 00:14:36.441 fused_ordering(854) 00:14:36.441 fused_ordering(855) 00:14:36.441 fused_ordering(856) 00:14:36.441 fused_ordering(857) 00:14:36.441 fused_ordering(858) 00:14:36.441 fused_ordering(859) 00:14:36.441 fused_ordering(860) 00:14:36.441 fused_ordering(861) 00:14:36.441 fused_ordering(862) 00:14:36.441 fused_ordering(863) 00:14:36.441 fused_ordering(864) 00:14:36.441 fused_ordering(865) 00:14:36.441 fused_ordering(866) 00:14:36.441 fused_ordering(867) 00:14:36.441 fused_ordering(868) 00:14:36.441 fused_ordering(869) 00:14:36.441 fused_ordering(870) 00:14:36.441 fused_ordering(871) 00:14:36.441 fused_ordering(872) 00:14:36.441 fused_ordering(873) 00:14:36.441 fused_ordering(874) 00:14:36.441 fused_ordering(875) 00:14:36.441 fused_ordering(876) 00:14:36.441 fused_ordering(877) 00:14:36.441 fused_ordering(878) 00:14:36.441 fused_ordering(879) 00:14:36.441 fused_ordering(880) 00:14:36.441 fused_ordering(881) 00:14:36.441 fused_ordering(882) 00:14:36.441 fused_ordering(883) 00:14:36.441 fused_ordering(884) 00:14:36.441 fused_ordering(885) 00:14:36.441 fused_ordering(886) 00:14:36.441 fused_ordering(887) 00:14:36.441 fused_ordering(888) 00:14:36.441 fused_ordering(889) 00:14:36.441 fused_ordering(890) 00:14:36.441 fused_ordering(891) 00:14:36.441 fused_ordering(892) 00:14:36.441 fused_ordering(893) 00:14:36.441 fused_ordering(894) 00:14:36.441 fused_ordering(895) 00:14:36.441 fused_ordering(896) 00:14:36.441 fused_ordering(897) 00:14:36.441 fused_ordering(898) 00:14:36.441 fused_ordering(899) 00:14:36.441 fused_ordering(900) 00:14:36.441 fused_ordering(901) 00:14:36.441 fused_ordering(902) 00:14:36.441 fused_ordering(903) 00:14:36.441 fused_ordering(904) 00:14:36.441 fused_ordering(905) 00:14:36.441 fused_ordering(906) 00:14:36.441 fused_ordering(907) 00:14:36.441 fused_ordering(908) 00:14:36.441 fused_ordering(909) 00:14:36.441 fused_ordering(910) 00:14:36.441 fused_ordering(911) 00:14:36.441 fused_ordering(912) 00:14:36.441 fused_ordering(913) 00:14:36.441 fused_ordering(914) 00:14:36.441 fused_ordering(915) 00:14:36.441 fused_ordering(916) 00:14:36.441 fused_ordering(917) 00:14:36.441 fused_ordering(918) 00:14:36.441 fused_ordering(919) 00:14:36.441 fused_ordering(920) 00:14:36.441 fused_ordering(921) 00:14:36.441 fused_ordering(922) 00:14:36.441 fused_ordering(923) 00:14:36.441 fused_ordering(924) 00:14:36.441 fused_ordering(925) 00:14:36.441 fused_ordering(926) 00:14:36.441 fused_ordering(927) 00:14:36.441 fused_ordering(928) 00:14:36.441 fused_ordering(929) 00:14:36.441 fused_ordering(930) 00:14:36.441 fused_ordering(931) 00:14:36.441 fused_ordering(932) 00:14:36.441 fused_ordering(933) 00:14:36.441 fused_ordering(934) 00:14:36.441 fused_ordering(935) 00:14:36.441 fused_ordering(936) 00:14:36.441 fused_ordering(937) 00:14:36.441 fused_ordering(938) 00:14:36.441 fused_ordering(939) 00:14:36.441 fused_ordering(940) 00:14:36.441 fused_ordering(941) 00:14:36.441 fused_ordering(942) 00:14:36.441 fused_ordering(943) 00:14:36.441 fused_ordering(944) 00:14:36.441 fused_ordering(945) 00:14:36.441 fused_ordering(946) 00:14:36.441 fused_ordering(947) 00:14:36.441 fused_ordering(948) 00:14:36.441 fused_ordering(949) 00:14:36.441 fused_ordering(950) 00:14:36.441 fused_ordering(951) 00:14:36.442 fused_ordering(952) 00:14:36.442 fused_ordering(953) 00:14:36.442 fused_ordering(954) 00:14:36.442 fused_ordering(955) 00:14:36.442 fused_ordering(956) 00:14:36.442 fused_ordering(957) 00:14:36.442 fused_ordering(958) 00:14:36.442 fused_ordering(959) 00:14:36.442 fused_ordering(960) 00:14:36.442 fused_ordering(961) 00:14:36.442 fused_ordering(962) 00:14:36.442 fused_ordering(963) 00:14:36.442 fused_ordering(964) 00:14:36.442 fused_ordering(965) 00:14:36.442 fused_ordering(966) 00:14:36.442 fused_ordering(967) 00:14:36.442 fused_ordering(968) 00:14:36.442 fused_ordering(969) 00:14:36.442 fused_ordering(970) 00:14:36.442 fused_ordering(971) 00:14:36.442 fused_ordering(972) 00:14:36.442 fused_ordering(973) 00:14:36.442 fused_ordering(974) 00:14:36.442 fused_ordering(975) 00:14:36.442 fused_ordering(976) 00:14:36.442 fused_ordering(977) 00:14:36.442 fused_ordering(978) 00:14:36.442 fused_ordering(979) 00:14:36.442 fused_ordering(980) 00:14:36.442 fused_ordering(981) 00:14:36.442 fused_ordering(982) 00:14:36.442 fused_ordering(983) 00:14:36.442 fused_ordering(984) 00:14:36.442 fused_ordering(985) 00:14:36.442 fused_ordering(986) 00:14:36.442 fused_ordering(987) 00:14:36.442 fused_ordering(988) 00:14:36.442 fused_ordering(989) 00:14:36.442 fused_ordering(990) 00:14:36.442 fused_ordering(991) 00:14:36.442 fused_ordering(992) 00:14:36.442 fused_ordering(993) 00:14:36.442 fused_ordering(994) 00:14:36.442 fused_ordering(995) 00:14:36.442 fused_ordering(996) 00:14:36.442 fused_ordering(997) 00:14:36.442 fused_ordering(998) 00:14:36.442 fused_ordering(999) 00:14:36.442 fused_ordering(1000) 00:14:36.442 fused_ordering(1001) 00:14:36.442 fused_ordering(1002) 00:14:36.442 fused_ordering(1003) 00:14:36.442 fused_ordering(1004) 00:14:36.442 fused_ordering(1005) 00:14:36.442 fused_ordering(1006) 00:14:36.442 fused_ordering(1007) 00:14:36.442 fused_ordering(1008) 00:14:36.442 fused_ordering(1009) 00:14:36.442 fused_ordering(1010) 00:14:36.442 fused_ordering(1011) 00:14:36.442 fused_ordering(1012) 00:14:36.442 fused_ordering(1013) 00:14:36.442 fused_ordering(1014) 00:14:36.442 fused_ordering(1015) 00:14:36.442 fused_ordering(1016) 00:14:36.442 fused_ordering(1017) 00:14:36.442 fused_ordering(1018) 00:14:36.442 fused_ordering(1019) 00:14:36.442 fused_ordering(1020) 00:14:36.442 fused_ordering(1021) 00:14:36.442 fused_ordering(1022) 00:14:36.442 fused_ordering(1023) 00:14:36.442 01:57:10 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:14:36.442 01:57:10 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:14:36.442 01:57:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:36.442 01:57:10 -- nvmf/common.sh@116 -- # sync 00:14:36.442 01:57:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:36.442 01:57:10 -- nvmf/common.sh@119 -- # set +e 00:14:36.442 01:57:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:36.442 01:57:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:36.442 rmmod nvme_tcp 00:14:36.442 rmmod nvme_fabrics 00:14:36.442 rmmod nvme_keyring 00:14:36.442 01:57:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:36.442 01:57:10 -- nvmf/common.sh@123 -- # set -e 00:14:36.442 01:57:10 -- nvmf/common.sh@124 -- # return 0 00:14:36.442 01:57:10 -- nvmf/common.sh@477 -- # '[' -n 1170288 ']' 00:14:36.442 01:57:10 -- nvmf/common.sh@478 -- # killprocess 1170288 00:14:36.442 01:57:10 -- common/autotest_common.sh@936 -- # '[' -z 1170288 ']' 00:14:36.442 01:57:10 -- common/autotest_common.sh@940 -- # kill -0 1170288 00:14:36.442 01:57:10 -- common/autotest_common.sh@941 -- # uname 00:14:36.442 01:57:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:36.442 01:57:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1170288 00:14:36.442 01:57:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:36.442 01:57:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:36.442 01:57:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1170288' 00:14:36.442 killing process with pid 1170288 00:14:36.442 01:57:10 -- common/autotest_common.sh@955 -- # kill 1170288 00:14:36.442 01:57:10 -- common/autotest_common.sh@960 -- # wait 1170288 00:14:36.701 01:57:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:36.701 01:57:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:36.701 01:57:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:36.701 01:57:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:36.701 01:57:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:36.701 01:57:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:36.701 01:57:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:36.701 01:57:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:39.238 01:57:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:39.238 00:14:39.238 real 0m8.207s 00:14:39.238 user 0m6.017s 00:14:39.238 sys 0m3.255s 00:14:39.238 01:57:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:39.238 01:57:13 -- common/autotest_common.sh@10 -- # set +x 00:14:39.238 ************************************ 00:14:39.238 END TEST nvmf_fused_ordering 00:14:39.238 ************************************ 00:14:39.238 01:57:13 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:39.238 01:57:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:39.238 01:57:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:39.238 01:57:13 -- common/autotest_common.sh@10 -- # set +x 00:14:39.238 ************************************ 00:14:39.238 START TEST nvmf_delete_subsystem 00:14:39.238 ************************************ 00:14:39.238 01:57:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:39.238 * Looking for test storage... 00:14:39.238 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:39.238 01:57:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:39.238 01:57:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:39.238 01:57:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:39.238 01:57:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:39.238 01:57:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:39.238 01:57:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:39.238 01:57:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:39.238 01:57:13 -- scripts/common.sh@335 -- # IFS=.-: 00:14:39.238 01:57:13 -- scripts/common.sh@335 -- # read -ra ver1 00:14:39.238 01:57:13 -- scripts/common.sh@336 -- # IFS=.-: 00:14:39.238 01:57:13 -- scripts/common.sh@336 -- # read -ra ver2 00:14:39.238 01:57:13 -- scripts/common.sh@337 -- # local 'op=<' 00:14:39.238 01:57:13 -- scripts/common.sh@339 -- # ver1_l=2 00:14:39.238 01:57:13 -- scripts/common.sh@340 -- # ver2_l=1 00:14:39.238 01:57:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:39.238 01:57:13 -- scripts/common.sh@343 -- # case "$op" in 00:14:39.238 01:57:13 -- scripts/common.sh@344 -- # : 1 00:14:39.238 01:57:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:39.238 01:57:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:39.238 01:57:13 -- scripts/common.sh@364 -- # decimal 1 00:14:39.238 01:57:13 -- scripts/common.sh@352 -- # local d=1 00:14:39.239 01:57:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:39.239 01:57:13 -- scripts/common.sh@354 -- # echo 1 00:14:39.239 01:57:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:39.239 01:57:13 -- scripts/common.sh@365 -- # decimal 2 00:14:39.239 01:57:13 -- scripts/common.sh@352 -- # local d=2 00:14:39.239 01:57:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:39.239 01:57:13 -- scripts/common.sh@354 -- # echo 2 00:14:39.239 01:57:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:39.239 01:57:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:39.239 01:57:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:39.239 01:57:13 -- scripts/common.sh@367 -- # return 0 00:14:39.239 01:57:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:39.239 01:57:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:39.239 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:39.239 --rc genhtml_branch_coverage=1 00:14:39.239 --rc genhtml_function_coverage=1 00:14:39.239 --rc genhtml_legend=1 00:14:39.239 --rc geninfo_all_blocks=1 00:14:39.239 --rc geninfo_unexecuted_blocks=1 00:14:39.239 00:14:39.239 ' 00:14:39.239 01:57:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:39.239 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:39.239 --rc genhtml_branch_coverage=1 00:14:39.239 --rc genhtml_function_coverage=1 00:14:39.239 --rc genhtml_legend=1 00:14:39.239 --rc geninfo_all_blocks=1 00:14:39.239 --rc geninfo_unexecuted_blocks=1 00:14:39.239 00:14:39.239 ' 00:14:39.239 01:57:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:39.239 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:39.239 --rc genhtml_branch_coverage=1 00:14:39.239 --rc genhtml_function_coverage=1 00:14:39.239 --rc genhtml_legend=1 00:14:39.239 --rc geninfo_all_blocks=1 00:14:39.239 --rc geninfo_unexecuted_blocks=1 00:14:39.239 00:14:39.239 ' 00:14:39.239 01:57:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:39.239 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:39.239 --rc genhtml_branch_coverage=1 00:14:39.239 --rc genhtml_function_coverage=1 00:14:39.239 --rc genhtml_legend=1 00:14:39.239 --rc geninfo_all_blocks=1 00:14:39.239 --rc geninfo_unexecuted_blocks=1 00:14:39.239 00:14:39.239 ' 00:14:39.239 01:57:13 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:39.239 01:57:13 -- nvmf/common.sh@7 -- # uname -s 00:14:39.239 01:57:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:39.239 01:57:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:39.239 01:57:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:39.239 01:57:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:39.239 01:57:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:39.239 01:57:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:39.239 01:57:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:39.239 01:57:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:39.239 01:57:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:39.239 01:57:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:39.239 01:57:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:39.239 01:57:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:39.239 01:57:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:39.239 01:57:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:39.239 01:57:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:39.239 01:57:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:39.239 01:57:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:39.239 01:57:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:39.239 01:57:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:39.239 01:57:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:39.239 01:57:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:39.239 01:57:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:39.239 01:57:13 -- paths/export.sh@5 -- # export PATH 00:14:39.239 01:57:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:39.239 01:57:13 -- nvmf/common.sh@46 -- # : 0 00:14:39.239 01:57:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:39.239 01:57:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:39.239 01:57:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:39.239 01:57:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:39.239 01:57:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:39.239 01:57:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:39.239 01:57:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:39.239 01:57:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:39.239 01:57:13 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:14:39.239 01:57:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:39.239 01:57:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:39.239 01:57:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:39.239 01:57:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:39.239 01:57:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:39.239 01:57:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:39.239 01:57:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:39.239 01:57:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:39.239 01:57:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:39.239 01:57:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:39.239 01:57:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:39.239 01:57:13 -- common/autotest_common.sh@10 -- # set +x 00:14:41.144 01:57:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:41.144 01:57:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:41.144 01:57:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:41.144 01:57:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:41.144 01:57:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:41.144 01:57:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:41.144 01:57:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:41.144 01:57:15 -- nvmf/common.sh@294 -- # net_devs=() 00:14:41.144 01:57:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:41.144 01:57:15 -- nvmf/common.sh@295 -- # e810=() 00:14:41.144 01:57:15 -- nvmf/common.sh@295 -- # local -ga e810 00:14:41.144 01:57:15 -- nvmf/common.sh@296 -- # x722=() 00:14:41.144 01:57:15 -- nvmf/common.sh@296 -- # local -ga x722 00:14:41.144 01:57:15 -- nvmf/common.sh@297 -- # mlx=() 00:14:41.144 01:57:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:41.144 01:57:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:41.144 01:57:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:41.144 01:57:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:41.144 01:57:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:41.144 01:57:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:41.144 01:57:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:41.144 01:57:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:41.144 01:57:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:41.144 01:57:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:41.144 01:57:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:41.144 01:57:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:41.144 01:57:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:41.144 01:57:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:41.144 01:57:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:41.144 01:57:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:41.144 01:57:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:41.144 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:41.144 01:57:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:41.144 01:57:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:41.144 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:41.144 01:57:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:41.144 01:57:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:41.144 01:57:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:41.144 01:57:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:41.144 01:57:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:41.144 01:57:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:41.144 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:41.144 01:57:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:41.144 01:57:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:41.144 01:57:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:41.144 01:57:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:41.144 01:57:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:41.144 01:57:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:41.144 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:41.144 01:57:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:41.144 01:57:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:41.144 01:57:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:41.144 01:57:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:41.144 01:57:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:41.144 01:57:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:41.144 01:57:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:41.144 01:57:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:41.144 01:57:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:41.145 01:57:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:41.145 01:57:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:41.145 01:57:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:41.145 01:57:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:41.145 01:57:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:41.145 01:57:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:41.145 01:57:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:41.145 01:57:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:41.145 01:57:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:41.145 01:57:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:41.145 01:57:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:41.145 01:57:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:41.145 01:57:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:41.145 01:57:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:41.145 01:57:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:41.145 01:57:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:41.145 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:41.145 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:14:41.145 00:14:41.145 --- 10.0.0.2 ping statistics --- 00:14:41.145 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:41.145 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:14:41.145 01:57:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:41.145 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:41.145 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.169 ms 00:14:41.145 00:14:41.145 --- 10.0.0.1 ping statistics --- 00:14:41.145 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:41.145 rtt min/avg/max/mdev = 0.169/0.169/0.169/0.000 ms 00:14:41.145 01:57:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:41.145 01:57:15 -- nvmf/common.sh@410 -- # return 0 00:14:41.145 01:57:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:41.145 01:57:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:41.145 01:57:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:41.145 01:57:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:41.145 01:57:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:41.145 01:57:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:41.145 01:57:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:41.145 01:57:15 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:14:41.145 01:57:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:41.145 01:57:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:41.145 01:57:15 -- common/autotest_common.sh@10 -- # set +x 00:14:41.145 01:57:15 -- nvmf/common.sh@469 -- # nvmfpid=1173177 00:14:41.145 01:57:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:41.145 01:57:15 -- nvmf/common.sh@470 -- # waitforlisten 1173177 00:14:41.145 01:57:15 -- common/autotest_common.sh@829 -- # '[' -z 1173177 ']' 00:14:41.145 01:57:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:41.145 01:57:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:41.145 01:57:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:41.145 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:41.145 01:57:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:41.145 01:57:15 -- common/autotest_common.sh@10 -- # set +x 00:14:41.404 [2024-11-18 01:57:15.553294] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:41.404 [2024-11-18 01:57:15.553406] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:41.404 EAL: No free 2048 kB hugepages reported on node 1 00:14:41.404 [2024-11-18 01:57:15.622238] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:41.404 [2024-11-18 01:57:15.710180] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:41.404 [2024-11-18 01:57:15.710348] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:41.404 [2024-11-18 01:57:15.710384] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:41.404 [2024-11-18 01:57:15.710397] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:41.404 [2024-11-18 01:57:15.710480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:41.404 [2024-11-18 01:57:15.710486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:42.338 01:57:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:42.338 01:57:16 -- common/autotest_common.sh@862 -- # return 0 00:14:42.338 01:57:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:42.338 01:57:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:42.338 01:57:16 -- common/autotest_common.sh@10 -- # set +x 00:14:42.338 01:57:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:42.338 01:57:16 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:42.338 01:57:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.338 01:57:16 -- common/autotest_common.sh@10 -- # set +x 00:14:42.338 [2024-11-18 01:57:16.532043] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:42.338 01:57:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.338 01:57:16 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:42.338 01:57:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.338 01:57:16 -- common/autotest_common.sh@10 -- # set +x 00:14:42.338 01:57:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.338 01:57:16 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:42.338 01:57:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.338 01:57:16 -- common/autotest_common.sh@10 -- # set +x 00:14:42.338 [2024-11-18 01:57:16.548299] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:42.338 01:57:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.338 01:57:16 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:42.338 01:57:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.338 01:57:16 -- common/autotest_common.sh@10 -- # set +x 00:14:42.338 NULL1 00:14:42.338 01:57:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.338 01:57:16 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:42.338 01:57:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.338 01:57:16 -- common/autotest_common.sh@10 -- # set +x 00:14:42.338 Delay0 00:14:42.338 01:57:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.338 01:57:16 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:42.338 01:57:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.338 01:57:16 -- common/autotest_common.sh@10 -- # set +x 00:14:42.338 01:57:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.338 01:57:16 -- target/delete_subsystem.sh@28 -- # perf_pid=1173334 00:14:42.338 01:57:16 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:42.338 01:57:16 -- target/delete_subsystem.sh@30 -- # sleep 2 00:14:42.338 EAL: No free 2048 kB hugepages reported on node 1 00:14:42.338 [2024-11-18 01:57:16.622922] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:44.239 01:57:18 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:44.239 01:57:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.239 01:57:18 -- common/autotest_common.sh@10 -- # set +x 00:14:44.497 Write completed with error (sct=0, sc=8) 00:14:44.497 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 [2024-11-18 01:57:18.704359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f62a400c350 is same with the state(5) to be set 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 starting I/O failed: -6 00:14:44.498 [2024-11-18 01:57:18.705102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec4240 is same with the state(5) to be set 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Write completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.498 Read completed with error (sct=0, sc=8) 00:14:44.499 Write completed with error (sct=0, sc=8) 00:14:44.499 Write completed with error (sct=0, sc=8) 00:14:44.499 Write completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Write completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Write completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:44.499 Write completed with error (sct=0, sc=8) 00:14:44.499 Write completed with error (sct=0, sc=8) 00:14:44.499 Write completed with error (sct=0, sc=8) 00:14:44.499 Read completed with error (sct=0, sc=8) 00:14:45.432 [2024-11-18 01:57:19.676972] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec59c0 is same with the state(5) to be set 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 [2024-11-18 01:57:19.706114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec39e0 is same with the state(5) to be set 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 [2024-11-18 01:57:19.706316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f90 is same with the state(5) to be set 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 [2024-11-18 01:57:19.706794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f62a400c600 is same with the state(5) to be set 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 Read completed with error (sct=0, sc=8) 00:14:45.432 Write completed with error (sct=0, sc=8) 00:14:45.432 [2024-11-18 01:57:19.706961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f62a400bf20 is same with the state(5) to be set 00:14:45.432 [2024-11-18 01:57:19.707730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xec59c0 (9): Bad file descriptor 00:14:45.432 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:45.432 01:57:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.432 01:57:19 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:45.432 01:57:19 -- target/delete_subsystem.sh@35 -- # kill -0 1173334 00:14:45.432 01:57:19 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:45.432 Initializing NVMe Controllers 00:14:45.432 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:45.432 Controller IO queue size 128, less than required. 00:14:45.432 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:45.432 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:45.432 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:45.432 Initialization complete. Launching workers. 00:14:45.432 ======================================================== 00:14:45.432 Latency(us) 00:14:45.432 Device Information : IOPS MiB/s Average min max 00:14:45.432 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 170.74 0.08 895065.62 403.83 1012288.22 00:14:45.432 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 166.77 0.08 901481.31 535.71 1012896.75 00:14:45.432 ======================================================== 00:14:45.433 Total : 337.50 0.16 898235.72 403.83 1012896.75 00:14:45.433 00:14:45.999 01:57:20 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:45.999 01:57:20 -- target/delete_subsystem.sh@35 -- # kill -0 1173334 00:14:45.999 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1173334) - No such process 00:14:45.999 01:57:20 -- target/delete_subsystem.sh@45 -- # NOT wait 1173334 00:14:45.999 01:57:20 -- common/autotest_common.sh@650 -- # local es=0 00:14:45.999 01:57:20 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 1173334 00:14:45.999 01:57:20 -- common/autotest_common.sh@638 -- # local arg=wait 00:14:45.999 01:57:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:45.999 01:57:20 -- common/autotest_common.sh@642 -- # type -t wait 00:14:45.999 01:57:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:45.999 01:57:20 -- common/autotest_common.sh@653 -- # wait 1173334 00:14:45.999 01:57:20 -- common/autotest_common.sh@653 -- # es=1 00:14:45.999 01:57:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:45.999 01:57:20 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:45.999 01:57:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:45.999 01:57:20 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:45.999 01:57:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.999 01:57:20 -- common/autotest_common.sh@10 -- # set +x 00:14:45.999 01:57:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.999 01:57:20 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:45.999 01:57:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.999 01:57:20 -- common/autotest_common.sh@10 -- # set +x 00:14:45.999 [2024-11-18 01:57:20.232216] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:45.999 01:57:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.999 01:57:20 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:45.999 01:57:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.999 01:57:20 -- common/autotest_common.sh@10 -- # set +x 00:14:45.999 01:57:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.999 01:57:20 -- target/delete_subsystem.sh@54 -- # perf_pid=1173761 00:14:45.999 01:57:20 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:45.999 01:57:20 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:45.999 01:57:20 -- target/delete_subsystem.sh@57 -- # kill -0 1173761 00:14:45.999 01:57:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:45.999 EAL: No free 2048 kB hugepages reported on node 1 00:14:45.999 [2024-11-18 01:57:20.294792] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:46.565 01:57:20 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:46.565 01:57:20 -- target/delete_subsystem.sh@57 -- # kill -0 1173761 00:14:46.565 01:57:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:47.130 01:57:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:47.130 01:57:21 -- target/delete_subsystem.sh@57 -- # kill -0 1173761 00:14:47.130 01:57:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:47.388 01:57:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:47.388 01:57:21 -- target/delete_subsystem.sh@57 -- # kill -0 1173761 00:14:47.388 01:57:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:47.954 01:57:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:47.954 01:57:22 -- target/delete_subsystem.sh@57 -- # kill -0 1173761 00:14:47.954 01:57:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:48.521 01:57:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:48.521 01:57:22 -- target/delete_subsystem.sh@57 -- # kill -0 1173761 00:14:48.521 01:57:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:49.087 01:57:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:49.087 01:57:23 -- target/delete_subsystem.sh@57 -- # kill -0 1173761 00:14:49.087 01:57:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:49.345 Initializing NVMe Controllers 00:14:49.345 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:49.345 Controller IO queue size 128, less than required. 00:14:49.345 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:49.345 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:49.345 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:49.345 Initialization complete. Launching workers. 00:14:49.345 ======================================================== 00:14:49.345 Latency(us) 00:14:49.345 Device Information : IOPS MiB/s Average min max 00:14:49.345 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003312.43 1000149.49 1011240.04 00:14:49.345 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1006804.43 1000181.02 1043332.30 00:14:49.345 ======================================================== 00:14:49.345 Total : 256.00 0.12 1005058.43 1000149.49 1043332.30 00:14:49.345 00:14:49.603 01:57:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:49.603 01:57:23 -- target/delete_subsystem.sh@57 -- # kill -0 1173761 00:14:49.603 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1173761) - No such process 00:14:49.603 01:57:23 -- target/delete_subsystem.sh@67 -- # wait 1173761 00:14:49.603 01:57:23 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:49.603 01:57:23 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:49.603 01:57:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:49.603 01:57:23 -- nvmf/common.sh@116 -- # sync 00:14:49.603 01:57:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:49.603 01:57:23 -- nvmf/common.sh@119 -- # set +e 00:14:49.603 01:57:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:49.603 01:57:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:49.603 rmmod nvme_tcp 00:14:49.603 rmmod nvme_fabrics 00:14:49.603 rmmod nvme_keyring 00:14:49.603 01:57:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:49.603 01:57:23 -- nvmf/common.sh@123 -- # set -e 00:14:49.603 01:57:23 -- nvmf/common.sh@124 -- # return 0 00:14:49.603 01:57:23 -- nvmf/common.sh@477 -- # '[' -n 1173177 ']' 00:14:49.603 01:57:23 -- nvmf/common.sh@478 -- # killprocess 1173177 00:14:49.603 01:57:23 -- common/autotest_common.sh@936 -- # '[' -z 1173177 ']' 00:14:49.603 01:57:23 -- common/autotest_common.sh@940 -- # kill -0 1173177 00:14:49.603 01:57:23 -- common/autotest_common.sh@941 -- # uname 00:14:49.603 01:57:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:49.603 01:57:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1173177 00:14:49.603 01:57:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:49.603 01:57:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:49.603 01:57:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1173177' 00:14:49.603 killing process with pid 1173177 00:14:49.603 01:57:23 -- common/autotest_common.sh@955 -- # kill 1173177 00:14:49.603 01:57:23 -- common/autotest_common.sh@960 -- # wait 1173177 00:14:49.862 01:57:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:49.862 01:57:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:49.862 01:57:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:49.862 01:57:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:49.862 01:57:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:49.862 01:57:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:49.862 01:57:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:49.862 01:57:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:51.767 01:57:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:51.767 00:14:51.767 real 0m12.981s 00:14:51.767 user 0m29.332s 00:14:51.767 sys 0m2.941s 00:14:51.767 01:57:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:51.767 01:57:26 -- common/autotest_common.sh@10 -- # set +x 00:14:51.767 ************************************ 00:14:51.767 END TEST nvmf_delete_subsystem 00:14:51.767 ************************************ 00:14:51.767 01:57:26 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:51.768 01:57:26 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:51.768 01:57:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:51.768 01:57:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:51.768 01:57:26 -- common/autotest_common.sh@10 -- # set +x 00:14:51.768 ************************************ 00:14:51.768 START TEST nvmf_nvme_cli 00:14:51.768 ************************************ 00:14:51.768 01:57:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:52.027 * Looking for test storage... 00:14:52.027 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:52.027 01:57:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:52.027 01:57:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:52.027 01:57:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:52.027 01:57:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:52.027 01:57:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:52.027 01:57:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:52.027 01:57:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:52.027 01:57:26 -- scripts/common.sh@335 -- # IFS=.-: 00:14:52.027 01:57:26 -- scripts/common.sh@335 -- # read -ra ver1 00:14:52.027 01:57:26 -- scripts/common.sh@336 -- # IFS=.-: 00:14:52.027 01:57:26 -- scripts/common.sh@336 -- # read -ra ver2 00:14:52.027 01:57:26 -- scripts/common.sh@337 -- # local 'op=<' 00:14:52.027 01:57:26 -- scripts/common.sh@339 -- # ver1_l=2 00:14:52.027 01:57:26 -- scripts/common.sh@340 -- # ver2_l=1 00:14:52.027 01:57:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:52.027 01:57:26 -- scripts/common.sh@343 -- # case "$op" in 00:14:52.027 01:57:26 -- scripts/common.sh@344 -- # : 1 00:14:52.027 01:57:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:52.027 01:57:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:52.027 01:57:26 -- scripts/common.sh@364 -- # decimal 1 00:14:52.027 01:57:26 -- scripts/common.sh@352 -- # local d=1 00:14:52.027 01:57:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:52.027 01:57:26 -- scripts/common.sh@354 -- # echo 1 00:14:52.027 01:57:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:52.027 01:57:26 -- scripts/common.sh@365 -- # decimal 2 00:14:52.027 01:57:26 -- scripts/common.sh@352 -- # local d=2 00:14:52.027 01:57:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:52.027 01:57:26 -- scripts/common.sh@354 -- # echo 2 00:14:52.027 01:57:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:52.027 01:57:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:52.027 01:57:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:52.027 01:57:26 -- scripts/common.sh@367 -- # return 0 00:14:52.027 01:57:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:52.027 01:57:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:52.027 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.027 --rc genhtml_branch_coverage=1 00:14:52.027 --rc genhtml_function_coverage=1 00:14:52.027 --rc genhtml_legend=1 00:14:52.027 --rc geninfo_all_blocks=1 00:14:52.027 --rc geninfo_unexecuted_blocks=1 00:14:52.027 00:14:52.027 ' 00:14:52.027 01:57:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:52.027 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.027 --rc genhtml_branch_coverage=1 00:14:52.027 --rc genhtml_function_coverage=1 00:14:52.027 --rc genhtml_legend=1 00:14:52.027 --rc geninfo_all_blocks=1 00:14:52.027 --rc geninfo_unexecuted_blocks=1 00:14:52.027 00:14:52.027 ' 00:14:52.027 01:57:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:52.027 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.027 --rc genhtml_branch_coverage=1 00:14:52.027 --rc genhtml_function_coverage=1 00:14:52.027 --rc genhtml_legend=1 00:14:52.027 --rc geninfo_all_blocks=1 00:14:52.027 --rc geninfo_unexecuted_blocks=1 00:14:52.027 00:14:52.027 ' 00:14:52.027 01:57:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:52.027 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.027 --rc genhtml_branch_coverage=1 00:14:52.027 --rc genhtml_function_coverage=1 00:14:52.027 --rc genhtml_legend=1 00:14:52.027 --rc geninfo_all_blocks=1 00:14:52.027 --rc geninfo_unexecuted_blocks=1 00:14:52.027 00:14:52.027 ' 00:14:52.027 01:57:26 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:52.027 01:57:26 -- nvmf/common.sh@7 -- # uname -s 00:14:52.027 01:57:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:52.027 01:57:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:52.027 01:57:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:52.027 01:57:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:52.027 01:57:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:52.027 01:57:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:52.027 01:57:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:52.027 01:57:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:52.027 01:57:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:52.027 01:57:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:52.027 01:57:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:52.027 01:57:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:52.027 01:57:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:52.027 01:57:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:52.027 01:57:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:52.027 01:57:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:52.027 01:57:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:52.027 01:57:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:52.027 01:57:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:52.027 01:57:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.027 01:57:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.027 01:57:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.027 01:57:26 -- paths/export.sh@5 -- # export PATH 00:14:52.028 01:57:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.028 01:57:26 -- nvmf/common.sh@46 -- # : 0 00:14:52.028 01:57:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:52.028 01:57:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:52.028 01:57:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:52.028 01:57:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:52.028 01:57:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:52.028 01:57:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:52.028 01:57:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:52.028 01:57:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:52.028 01:57:26 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:52.028 01:57:26 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:52.028 01:57:26 -- target/nvme_cli.sh@14 -- # devs=() 00:14:52.028 01:57:26 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:52.028 01:57:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:52.028 01:57:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:52.028 01:57:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:52.028 01:57:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:52.028 01:57:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:52.028 01:57:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:52.028 01:57:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:52.028 01:57:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:52.028 01:57:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:52.028 01:57:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:52.028 01:57:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:52.028 01:57:26 -- common/autotest_common.sh@10 -- # set +x 00:14:53.930 01:57:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:53.930 01:57:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:53.930 01:57:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:53.930 01:57:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:53.930 01:57:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:53.930 01:57:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:53.930 01:57:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:53.930 01:57:28 -- nvmf/common.sh@294 -- # net_devs=() 00:14:53.930 01:57:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:53.930 01:57:28 -- nvmf/common.sh@295 -- # e810=() 00:14:53.930 01:57:28 -- nvmf/common.sh@295 -- # local -ga e810 00:14:53.930 01:57:28 -- nvmf/common.sh@296 -- # x722=() 00:14:53.930 01:57:28 -- nvmf/common.sh@296 -- # local -ga x722 00:14:53.930 01:57:28 -- nvmf/common.sh@297 -- # mlx=() 00:14:53.930 01:57:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:53.930 01:57:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:53.930 01:57:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:53.930 01:57:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:53.930 01:57:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:53.930 01:57:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:53.930 01:57:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:53.930 01:57:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:53.930 01:57:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:53.930 01:57:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:53.930 01:57:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:53.930 01:57:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:53.930 01:57:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:53.930 01:57:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:53.930 01:57:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:53.930 01:57:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:53.930 01:57:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:53.930 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:53.930 01:57:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:53.930 01:57:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:53.930 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:53.930 01:57:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:53.930 01:57:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:53.930 01:57:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:53.930 01:57:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:53.930 01:57:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:53.930 01:57:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:53.930 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:53.930 01:57:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:53.930 01:57:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:53.930 01:57:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:53.930 01:57:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:53.930 01:57:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:53.930 01:57:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:53.930 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:53.930 01:57:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:53.930 01:57:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:53.930 01:57:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:53.930 01:57:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:53.930 01:57:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:53.930 01:57:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:53.930 01:57:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:53.930 01:57:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:53.930 01:57:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:53.930 01:57:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:53.930 01:57:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:53.930 01:57:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:53.930 01:57:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:53.930 01:57:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:53.930 01:57:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:53.930 01:57:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:53.930 01:57:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:53.930 01:57:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:54.189 01:57:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:54.189 01:57:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:54.189 01:57:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:54.189 01:57:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:54.189 01:57:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:54.189 01:57:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:54.189 01:57:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:54.189 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:54.189 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.167 ms 00:14:54.189 00:14:54.189 --- 10.0.0.2 ping statistics --- 00:14:54.189 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:54.189 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:14:54.189 01:57:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:54.189 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:54.189 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:14:54.189 00:14:54.189 --- 10.0.0.1 ping statistics --- 00:14:54.189 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:54.189 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:14:54.189 01:57:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:54.189 01:57:28 -- nvmf/common.sh@410 -- # return 0 00:14:54.189 01:57:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:54.189 01:57:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:54.189 01:57:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:54.189 01:57:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:54.189 01:57:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:54.189 01:57:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:54.189 01:57:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:54.189 01:57:28 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:54.189 01:57:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:54.189 01:57:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:54.189 01:57:28 -- common/autotest_common.sh@10 -- # set +x 00:14:54.189 01:57:28 -- nvmf/common.sh@469 -- # nvmfpid=1176236 00:14:54.189 01:57:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:54.189 01:57:28 -- nvmf/common.sh@470 -- # waitforlisten 1176236 00:14:54.189 01:57:28 -- common/autotest_common.sh@829 -- # '[' -z 1176236 ']' 00:14:54.189 01:57:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:54.189 01:57:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:54.189 01:57:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:54.189 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:54.189 01:57:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:54.189 01:57:28 -- common/autotest_common.sh@10 -- # set +x 00:14:54.189 [2024-11-18 01:57:28.490080] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:54.189 [2024-11-18 01:57:28.490164] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:54.189 EAL: No free 2048 kB hugepages reported on node 1 00:14:54.189 [2024-11-18 01:57:28.559032] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:54.448 [2024-11-18 01:57:28.650528] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:54.448 [2024-11-18 01:57:28.650715] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:54.448 [2024-11-18 01:57:28.650734] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:54.448 [2024-11-18 01:57:28.650746] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:54.448 [2024-11-18 01:57:28.650833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:54.448 [2024-11-18 01:57:28.650917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:54.448 [2024-11-18 01:57:28.651010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:54.448 [2024-11-18 01:57:28.651013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:55.380 01:57:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:55.380 01:57:29 -- common/autotest_common.sh@862 -- # return 0 00:14:55.380 01:57:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:55.380 01:57:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:55.380 01:57:29 -- common/autotest_common.sh@10 -- # set +x 00:14:55.380 01:57:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:55.380 01:57:29 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:55.380 01:57:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.380 01:57:29 -- common/autotest_common.sh@10 -- # set +x 00:14:55.380 [2024-11-18 01:57:29.499005] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:55.380 01:57:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.380 01:57:29 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:55.380 01:57:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.380 01:57:29 -- common/autotest_common.sh@10 -- # set +x 00:14:55.380 Malloc0 00:14:55.380 01:57:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.380 01:57:29 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:55.380 01:57:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.380 01:57:29 -- common/autotest_common.sh@10 -- # set +x 00:14:55.380 Malloc1 00:14:55.380 01:57:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.380 01:57:29 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:55.380 01:57:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.380 01:57:29 -- common/autotest_common.sh@10 -- # set +x 00:14:55.380 01:57:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.380 01:57:29 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:55.380 01:57:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.380 01:57:29 -- common/autotest_common.sh@10 -- # set +x 00:14:55.381 01:57:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.381 01:57:29 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:55.381 01:57:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.381 01:57:29 -- common/autotest_common.sh@10 -- # set +x 00:14:55.381 01:57:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.381 01:57:29 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:55.381 01:57:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.381 01:57:29 -- common/autotest_common.sh@10 -- # set +x 00:14:55.381 [2024-11-18 01:57:29.580276] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:55.381 01:57:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.381 01:57:29 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:55.381 01:57:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.381 01:57:29 -- common/autotest_common.sh@10 -- # set +x 00:14:55.381 01:57:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.381 01:57:29 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:55.381 00:14:55.381 Discovery Log Number of Records 2, Generation counter 2 00:14:55.381 =====Discovery Log Entry 0====== 00:14:55.381 trtype: tcp 00:14:55.381 adrfam: ipv4 00:14:55.381 subtype: current discovery subsystem 00:14:55.381 treq: not required 00:14:55.381 portid: 0 00:14:55.381 trsvcid: 4420 00:14:55.381 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:55.381 traddr: 10.0.0.2 00:14:55.381 eflags: explicit discovery connections, duplicate discovery information 00:14:55.381 sectype: none 00:14:55.381 =====Discovery Log Entry 1====== 00:14:55.381 trtype: tcp 00:14:55.381 adrfam: ipv4 00:14:55.381 subtype: nvme subsystem 00:14:55.381 treq: not required 00:14:55.381 portid: 0 00:14:55.381 trsvcid: 4420 00:14:55.381 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:55.381 traddr: 10.0.0.2 00:14:55.381 eflags: none 00:14:55.381 sectype: none 00:14:55.381 01:57:29 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:55.381 01:57:29 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:55.381 01:57:29 -- nvmf/common.sh@510 -- # local dev _ 00:14:55.381 01:57:29 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:55.381 01:57:29 -- nvmf/common.sh@509 -- # nvme list 00:14:55.381 01:57:29 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:55.381 01:57:29 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:55.381 01:57:29 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:55.381 01:57:29 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:55.381 01:57:29 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:55.381 01:57:29 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:56.315 01:57:30 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:56.315 01:57:30 -- common/autotest_common.sh@1187 -- # local i=0 00:14:56.315 01:57:30 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:56.315 01:57:30 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:56.315 01:57:30 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:56.315 01:57:30 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:58.215 01:57:32 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:58.215 01:57:32 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:58.215 01:57:32 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:58.215 01:57:32 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:58.215 01:57:32 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:58.215 01:57:32 -- common/autotest_common.sh@1197 -- # return 0 00:14:58.215 01:57:32 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:58.215 01:57:32 -- nvmf/common.sh@510 -- # local dev _ 00:14:58.215 01:57:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:58.215 01:57:32 -- nvmf/common.sh@509 -- # nvme list 00:14:58.215 01:57:32 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:58.215 01:57:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:58.215 01:57:32 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:58.215 01:57:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:58.215 01:57:32 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:58.215 01:57:32 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:58.215 01:57:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:58.215 01:57:32 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:58.215 01:57:32 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:58.215 01:57:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:58.215 01:57:32 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:58.215 /dev/nvme0n2 ]] 00:14:58.215 01:57:32 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:58.215 01:57:32 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:58.215 01:57:32 -- nvmf/common.sh@510 -- # local dev _ 00:14:58.215 01:57:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:58.215 01:57:32 -- nvmf/common.sh@509 -- # nvme list 00:14:58.215 01:57:32 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:58.215 01:57:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:58.215 01:57:32 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:58.215 01:57:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:58.215 01:57:32 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:58.215 01:57:32 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:58.215 01:57:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:58.215 01:57:32 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:58.215 01:57:32 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:58.215 01:57:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:58.215 01:57:32 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:58.215 01:57:32 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:58.215 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:58.215 01:57:32 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:58.215 01:57:32 -- common/autotest_common.sh@1208 -- # local i=0 00:14:58.215 01:57:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:58.215 01:57:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:58.215 01:57:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:58.215 01:57:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:58.215 01:57:32 -- common/autotest_common.sh@1220 -- # return 0 00:14:58.215 01:57:32 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:58.215 01:57:32 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:58.215 01:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.215 01:57:32 -- common/autotest_common.sh@10 -- # set +x 00:14:58.215 01:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.215 01:57:32 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:58.215 01:57:32 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:58.215 01:57:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:58.215 01:57:32 -- nvmf/common.sh@116 -- # sync 00:14:58.215 01:57:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:58.215 01:57:32 -- nvmf/common.sh@119 -- # set +e 00:14:58.215 01:57:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:58.215 01:57:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:58.215 rmmod nvme_tcp 00:14:58.215 rmmod nvme_fabrics 00:14:58.215 rmmod nvme_keyring 00:14:58.215 01:57:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:58.215 01:57:32 -- nvmf/common.sh@123 -- # set -e 00:14:58.215 01:57:32 -- nvmf/common.sh@124 -- # return 0 00:14:58.215 01:57:32 -- nvmf/common.sh@477 -- # '[' -n 1176236 ']' 00:14:58.215 01:57:32 -- nvmf/common.sh@478 -- # killprocess 1176236 00:14:58.215 01:57:32 -- common/autotest_common.sh@936 -- # '[' -z 1176236 ']' 00:14:58.215 01:57:32 -- common/autotest_common.sh@940 -- # kill -0 1176236 00:14:58.215 01:57:32 -- common/autotest_common.sh@941 -- # uname 00:14:58.215 01:57:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:58.215 01:57:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1176236 00:14:58.215 01:57:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:58.215 01:57:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:58.215 01:57:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1176236' 00:14:58.215 killing process with pid 1176236 00:14:58.215 01:57:32 -- common/autotest_common.sh@955 -- # kill 1176236 00:14:58.215 01:57:32 -- common/autotest_common.sh@960 -- # wait 1176236 00:14:58.783 01:57:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:58.783 01:57:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:58.783 01:57:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:58.783 01:57:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:58.783 01:57:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:58.783 01:57:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:58.783 01:57:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:58.783 01:57:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:00.689 01:57:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:00.689 00:15:00.689 real 0m8.806s 00:15:00.689 user 0m17.659s 00:15:00.689 sys 0m2.226s 00:15:00.689 01:57:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:00.689 01:57:34 -- common/autotest_common.sh@10 -- # set +x 00:15:00.689 ************************************ 00:15:00.689 END TEST nvmf_nvme_cli 00:15:00.689 ************************************ 00:15:00.689 01:57:34 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:00.689 01:57:34 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:00.689 01:57:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:00.689 01:57:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:00.689 01:57:34 -- common/autotest_common.sh@10 -- # set +x 00:15:00.689 ************************************ 00:15:00.689 START TEST nvmf_vfio_user 00:15:00.689 ************************************ 00:15:00.689 01:57:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:00.689 * Looking for test storage... 00:15:00.689 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:00.689 01:57:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:00.689 01:57:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:00.689 01:57:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:00.947 01:57:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:00.947 01:57:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:00.947 01:57:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:00.947 01:57:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:00.947 01:57:35 -- scripts/common.sh@335 -- # IFS=.-: 00:15:00.947 01:57:35 -- scripts/common.sh@335 -- # read -ra ver1 00:15:00.947 01:57:35 -- scripts/common.sh@336 -- # IFS=.-: 00:15:00.947 01:57:35 -- scripts/common.sh@336 -- # read -ra ver2 00:15:00.947 01:57:35 -- scripts/common.sh@337 -- # local 'op=<' 00:15:00.947 01:57:35 -- scripts/common.sh@339 -- # ver1_l=2 00:15:00.947 01:57:35 -- scripts/common.sh@340 -- # ver2_l=1 00:15:00.947 01:57:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:00.947 01:57:35 -- scripts/common.sh@343 -- # case "$op" in 00:15:00.947 01:57:35 -- scripts/common.sh@344 -- # : 1 00:15:00.947 01:57:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:00.947 01:57:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:00.947 01:57:35 -- scripts/common.sh@364 -- # decimal 1 00:15:00.947 01:57:35 -- scripts/common.sh@352 -- # local d=1 00:15:00.947 01:57:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:00.947 01:57:35 -- scripts/common.sh@354 -- # echo 1 00:15:00.947 01:57:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:00.947 01:57:35 -- scripts/common.sh@365 -- # decimal 2 00:15:00.947 01:57:35 -- scripts/common.sh@352 -- # local d=2 00:15:00.947 01:57:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:00.947 01:57:35 -- scripts/common.sh@354 -- # echo 2 00:15:00.947 01:57:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:00.947 01:57:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:00.947 01:57:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:00.947 01:57:35 -- scripts/common.sh@367 -- # return 0 00:15:00.947 01:57:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:00.947 01:57:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:00.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:00.947 --rc genhtml_branch_coverage=1 00:15:00.947 --rc genhtml_function_coverage=1 00:15:00.947 --rc genhtml_legend=1 00:15:00.947 --rc geninfo_all_blocks=1 00:15:00.947 --rc geninfo_unexecuted_blocks=1 00:15:00.947 00:15:00.947 ' 00:15:00.947 01:57:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:00.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:00.947 --rc genhtml_branch_coverage=1 00:15:00.947 --rc genhtml_function_coverage=1 00:15:00.947 --rc genhtml_legend=1 00:15:00.947 --rc geninfo_all_blocks=1 00:15:00.947 --rc geninfo_unexecuted_blocks=1 00:15:00.947 00:15:00.947 ' 00:15:00.947 01:57:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:00.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:00.947 --rc genhtml_branch_coverage=1 00:15:00.947 --rc genhtml_function_coverage=1 00:15:00.947 --rc genhtml_legend=1 00:15:00.947 --rc geninfo_all_blocks=1 00:15:00.947 --rc geninfo_unexecuted_blocks=1 00:15:00.947 00:15:00.947 ' 00:15:00.947 01:57:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:00.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:00.947 --rc genhtml_branch_coverage=1 00:15:00.947 --rc genhtml_function_coverage=1 00:15:00.947 --rc genhtml_legend=1 00:15:00.947 --rc geninfo_all_blocks=1 00:15:00.947 --rc geninfo_unexecuted_blocks=1 00:15:00.947 00:15:00.947 ' 00:15:00.947 01:57:35 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:00.947 01:57:35 -- nvmf/common.sh@7 -- # uname -s 00:15:00.947 01:57:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:00.947 01:57:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:00.947 01:57:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:00.947 01:57:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:00.947 01:57:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:00.947 01:57:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:00.947 01:57:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:00.947 01:57:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:00.947 01:57:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:00.948 01:57:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:00.948 01:57:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:00.948 01:57:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:00.948 01:57:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:00.948 01:57:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:00.948 01:57:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:00.948 01:57:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:00.948 01:57:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:00.948 01:57:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:00.948 01:57:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:00.948 01:57:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.948 01:57:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.948 01:57:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.948 01:57:35 -- paths/export.sh@5 -- # export PATH 00:15:00.948 01:57:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.948 01:57:35 -- nvmf/common.sh@46 -- # : 0 00:15:00.948 01:57:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:00.948 01:57:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:00.948 01:57:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:00.948 01:57:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:00.948 01:57:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:00.948 01:57:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:00.948 01:57:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:00.948 01:57:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1177193 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1177193' 00:15:00.948 Process pid: 1177193 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:00.948 01:57:35 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1177193 00:15:00.948 01:57:35 -- common/autotest_common.sh@829 -- # '[' -z 1177193 ']' 00:15:00.948 01:57:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:00.948 01:57:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:00.948 01:57:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:00.948 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:00.948 01:57:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:00.948 01:57:35 -- common/autotest_common.sh@10 -- # set +x 00:15:00.948 [2024-11-18 01:57:35.173157] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:00.948 [2024-11-18 01:57:35.173253] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:00.948 EAL: No free 2048 kB hugepages reported on node 1 00:15:00.948 [2024-11-18 01:57:35.234316] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:00.948 [2024-11-18 01:57:35.318608] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:00.948 [2024-11-18 01:57:35.318751] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:00.948 [2024-11-18 01:57:35.318769] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:00.948 [2024-11-18 01:57:35.318781] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:00.948 [2024-11-18 01:57:35.318834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:00.948 [2024-11-18 01:57:35.318893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:00.948 [2024-11-18 01:57:35.318958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:00.948 [2024-11-18 01:57:35.318961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:01.881 01:57:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:01.881 01:57:36 -- common/autotest_common.sh@862 -- # return 0 00:15:01.881 01:57:36 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:02.815 01:57:37 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:03.381 01:57:37 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:03.381 01:57:37 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:03.381 01:57:37 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:03.381 01:57:37 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:03.381 01:57:37 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:03.381 Malloc1 00:15:03.639 01:57:37 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:03.897 01:57:38 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:04.154 01:57:38 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:04.413 01:57:38 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:04.413 01:57:38 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:04.413 01:57:38 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:04.671 Malloc2 00:15:04.671 01:57:38 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:04.939 01:57:39 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:04.939 01:57:39 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:05.198 01:57:39 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:05.198 01:57:39 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:05.458 01:57:39 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:05.458 01:57:39 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:05.458 01:57:39 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:05.458 01:57:39 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:05.458 [2024-11-18 01:57:39.615736] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:05.458 [2024-11-18 01:57:39.615771] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1177772 ] 00:15:05.458 EAL: No free 2048 kB hugepages reported on node 1 00:15:05.458 [2024-11-18 01:57:39.648515] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:05.458 [2024-11-18 01:57:39.656718] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:05.458 [2024-11-18 01:57:39.656745] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7ff826771000 00:15:05.458 [2024-11-18 01:57:39.657713] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:05.458 [2024-11-18 01:57:39.658704] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:05.458 [2024-11-18 01:57:39.659724] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:05.458 [2024-11-18 01:57:39.660726] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:05.458 [2024-11-18 01:57:39.661732] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:05.458 [2024-11-18 01:57:39.662738] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:05.458 [2024-11-18 01:57:39.663742] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:05.458 [2024-11-18 01:57:39.664751] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:05.458 [2024-11-18 01:57:39.665758] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:05.458 [2024-11-18 01:57:39.665779] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7ff82546b000 00:15:05.458 [2024-11-18 01:57:39.666999] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:05.458 [2024-11-18 01:57:39.682977] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:05.458 [2024-11-18 01:57:39.683008] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:05.458 [2024-11-18 01:57:39.687904] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:05.458 [2024-11-18 01:57:39.687957] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:05.458 [2024-11-18 01:57:39.688041] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:05.458 [2024-11-18 01:57:39.688072] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:05.458 [2024-11-18 01:57:39.688082] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:05.458 [2024-11-18 01:57:39.688892] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:05.458 [2024-11-18 01:57:39.688911] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:05.459 [2024-11-18 01:57:39.688922] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:05.459 [2024-11-18 01:57:39.689897] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:05.459 [2024-11-18 01:57:39.689914] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:05.459 [2024-11-18 01:57:39.689927] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:05.459 [2024-11-18 01:57:39.690904] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:05.459 [2024-11-18 01:57:39.690922] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:05.459 [2024-11-18 01:57:39.691911] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:05.459 [2024-11-18 01:57:39.691930] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:05.459 [2024-11-18 01:57:39.691938] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:05.459 [2024-11-18 01:57:39.691949] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:05.459 [2024-11-18 01:57:39.692058] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:05.459 [2024-11-18 01:57:39.692065] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:05.459 [2024-11-18 01:57:39.692073] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:05.459 [2024-11-18 01:57:39.692917] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:05.459 [2024-11-18 01:57:39.693919] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:05.459 [2024-11-18 01:57:39.694933] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:05.459 [2024-11-18 01:57:39.695967] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:05.459 [2024-11-18 01:57:39.696939] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:05.459 [2024-11-18 01:57:39.696957] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:05.459 [2024-11-18 01:57:39.696965] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.696988] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:05.459 [2024-11-18 01:57:39.697006] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697027] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:05.459 [2024-11-18 01:57:39.697037] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:05.459 [2024-11-18 01:57:39.697055] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:05.459 [2024-11-18 01:57:39.697119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:05.459 [2024-11-18 01:57:39.697133] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:05.459 [2024-11-18 01:57:39.697141] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:05.459 [2024-11-18 01:57:39.697148] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:05.459 [2024-11-18 01:57:39.697155] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:05.459 [2024-11-18 01:57:39.697162] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:05.459 [2024-11-18 01:57:39.697173] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:05.459 [2024-11-18 01:57:39.697181] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697197] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697212] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:05.459 [2024-11-18 01:57:39.697227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:05.459 [2024-11-18 01:57:39.697246] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:05.459 [2024-11-18 01:57:39.697259] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:05.459 [2024-11-18 01:57:39.697271] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:05.459 [2024-11-18 01:57:39.697282] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:05.459 [2024-11-18 01:57:39.697290] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697306] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697344] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:05.459 [2024-11-18 01:57:39.697357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:05.459 [2024-11-18 01:57:39.697367] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:05.459 [2024-11-18 01:57:39.697375] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697386] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697399] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697413] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:05.459 [2024-11-18 01:57:39.697427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:05.459 [2024-11-18 01:57:39.697489] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697503] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697515] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:05.459 [2024-11-18 01:57:39.697523] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:05.459 [2024-11-18 01:57:39.697533] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:05.459 [2024-11-18 01:57:39.697551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:05.459 [2024-11-18 01:57:39.697575] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:05.459 [2024-11-18 01:57:39.697591] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697605] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697616] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:05.459 [2024-11-18 01:57:39.697639] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:05.459 [2024-11-18 01:57:39.697649] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:05.459 [2024-11-18 01:57:39.697669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:05.459 [2024-11-18 01:57:39.697689] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697703] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697715] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:05.459 [2024-11-18 01:57:39.697723] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:05.459 [2024-11-18 01:57:39.697732] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:05.459 [2024-11-18 01:57:39.697743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:05.459 [2024-11-18 01:57:39.697755] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697766] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697779] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697789] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697797] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:05.459 [2024-11-18 01:57:39.697804] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:05.459 [2024-11-18 01:57:39.697812] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:05.460 [2024-11-18 01:57:39.697819] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:05.460 [2024-11-18 01:57:39.697843] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:05.460 [2024-11-18 01:57:39.697861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:05.460 [2024-11-18 01:57:39.697879] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:05.460 [2024-11-18 01:57:39.697891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:05.460 [2024-11-18 01:57:39.697910] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:05.460 [2024-11-18 01:57:39.697922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:05.460 [2024-11-18 01:57:39.697937] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:05.460 [2024-11-18 01:57:39.697948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:05.460 [2024-11-18 01:57:39.697965] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:05.460 [2024-11-18 01:57:39.697974] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:05.460 [2024-11-18 01:57:39.697979] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:05.460 [2024-11-18 01:57:39.697985] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:05.460 [2024-11-18 01:57:39.697994] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:05.460 [2024-11-18 01:57:39.698005] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:05.460 [2024-11-18 01:57:39.698013] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:05.460 [2024-11-18 01:57:39.698021] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:05.460 [2024-11-18 01:57:39.698032] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:05.460 [2024-11-18 01:57:39.698039] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:05.460 [2024-11-18 01:57:39.698048] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:05.460 [2024-11-18 01:57:39.698059] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:05.460 [2024-11-18 01:57:39.698066] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:05.460 [2024-11-18 01:57:39.698075] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:05.460 [2024-11-18 01:57:39.698086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:05.460 [2024-11-18 01:57:39.698106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:05.460 [2024-11-18 01:57:39.698121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:05.460 [2024-11-18 01:57:39.698132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:05.460 ===================================================== 00:15:05.460 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:05.460 ===================================================== 00:15:05.460 Controller Capabilities/Features 00:15:05.460 ================================ 00:15:05.460 Vendor ID: 4e58 00:15:05.460 Subsystem Vendor ID: 4e58 00:15:05.460 Serial Number: SPDK1 00:15:05.460 Model Number: SPDK bdev Controller 00:15:05.460 Firmware Version: 24.01.1 00:15:05.460 Recommended Arb Burst: 6 00:15:05.460 IEEE OUI Identifier: 8d 6b 50 00:15:05.460 Multi-path I/O 00:15:05.460 May have multiple subsystem ports: Yes 00:15:05.460 May have multiple controllers: Yes 00:15:05.460 Associated with SR-IOV VF: No 00:15:05.460 Max Data Transfer Size: 131072 00:15:05.460 Max Number of Namespaces: 32 00:15:05.460 Max Number of I/O Queues: 127 00:15:05.460 NVMe Specification Version (VS): 1.3 00:15:05.460 NVMe Specification Version (Identify): 1.3 00:15:05.460 Maximum Queue Entries: 256 00:15:05.460 Contiguous Queues Required: Yes 00:15:05.460 Arbitration Mechanisms Supported 00:15:05.460 Weighted Round Robin: Not Supported 00:15:05.460 Vendor Specific: Not Supported 00:15:05.460 Reset Timeout: 15000 ms 00:15:05.460 Doorbell Stride: 4 bytes 00:15:05.460 NVM Subsystem Reset: Not Supported 00:15:05.460 Command Sets Supported 00:15:05.460 NVM Command Set: Supported 00:15:05.460 Boot Partition: Not Supported 00:15:05.460 Memory Page Size Minimum: 4096 bytes 00:15:05.460 Memory Page Size Maximum: 4096 bytes 00:15:05.460 Persistent Memory Region: Not Supported 00:15:05.460 Optional Asynchronous Events Supported 00:15:05.460 Namespace Attribute Notices: Supported 00:15:05.460 Firmware Activation Notices: Not Supported 00:15:05.460 ANA Change Notices: Not Supported 00:15:05.460 PLE Aggregate Log Change Notices: Not Supported 00:15:05.460 LBA Status Info Alert Notices: Not Supported 00:15:05.460 EGE Aggregate Log Change Notices: Not Supported 00:15:05.460 Normal NVM Subsystem Shutdown event: Not Supported 00:15:05.460 Zone Descriptor Change Notices: Not Supported 00:15:05.460 Discovery Log Change Notices: Not Supported 00:15:05.460 Controller Attributes 00:15:05.460 128-bit Host Identifier: Supported 00:15:05.460 Non-Operational Permissive Mode: Not Supported 00:15:05.460 NVM Sets: Not Supported 00:15:05.460 Read Recovery Levels: Not Supported 00:15:05.460 Endurance Groups: Not Supported 00:15:05.460 Predictable Latency Mode: Not Supported 00:15:05.460 Traffic Based Keep ALive: Not Supported 00:15:05.460 Namespace Granularity: Not Supported 00:15:05.460 SQ Associations: Not Supported 00:15:05.460 UUID List: Not Supported 00:15:05.460 Multi-Domain Subsystem: Not Supported 00:15:05.460 Fixed Capacity Management: Not Supported 00:15:05.460 Variable Capacity Management: Not Supported 00:15:05.460 Delete Endurance Group: Not Supported 00:15:05.460 Delete NVM Set: Not Supported 00:15:05.460 Extended LBA Formats Supported: Not Supported 00:15:05.460 Flexible Data Placement Supported: Not Supported 00:15:05.460 00:15:05.460 Controller Memory Buffer Support 00:15:05.460 ================================ 00:15:05.460 Supported: No 00:15:05.460 00:15:05.460 Persistent Memory Region Support 00:15:05.460 ================================ 00:15:05.460 Supported: No 00:15:05.460 00:15:05.460 Admin Command Set Attributes 00:15:05.460 ============================ 00:15:05.460 Security Send/Receive: Not Supported 00:15:05.460 Format NVM: Not Supported 00:15:05.460 Firmware Activate/Download: Not Supported 00:15:05.460 Namespace Management: Not Supported 00:15:05.460 Device Self-Test: Not Supported 00:15:05.460 Directives: Not Supported 00:15:05.460 NVMe-MI: Not Supported 00:15:05.460 Virtualization Management: Not Supported 00:15:05.460 Doorbell Buffer Config: Not Supported 00:15:05.460 Get LBA Status Capability: Not Supported 00:15:05.460 Command & Feature Lockdown Capability: Not Supported 00:15:05.460 Abort Command Limit: 4 00:15:05.460 Async Event Request Limit: 4 00:15:05.460 Number of Firmware Slots: N/A 00:15:05.460 Firmware Slot 1 Read-Only: N/A 00:15:05.460 Firmware Activation Without Reset: N/A 00:15:05.460 Multiple Update Detection Support: N/A 00:15:05.460 Firmware Update Granularity: No Information Provided 00:15:05.460 Per-Namespace SMART Log: No 00:15:05.460 Asymmetric Namespace Access Log Page: Not Supported 00:15:05.460 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:05.460 Command Effects Log Page: Supported 00:15:05.460 Get Log Page Extended Data: Supported 00:15:05.460 Telemetry Log Pages: Not Supported 00:15:05.460 Persistent Event Log Pages: Not Supported 00:15:05.460 Supported Log Pages Log Page: May Support 00:15:05.460 Commands Supported & Effects Log Page: Not Supported 00:15:05.460 Feature Identifiers & Effects Log Page:May Support 00:15:05.460 NVMe-MI Commands & Effects Log Page: May Support 00:15:05.460 Data Area 4 for Telemetry Log: Not Supported 00:15:05.460 Error Log Page Entries Supported: 128 00:15:05.460 Keep Alive: Supported 00:15:05.460 Keep Alive Granularity: 10000 ms 00:15:05.460 00:15:05.460 NVM Command Set Attributes 00:15:05.460 ========================== 00:15:05.460 Submission Queue Entry Size 00:15:05.460 Max: 64 00:15:05.460 Min: 64 00:15:05.460 Completion Queue Entry Size 00:15:05.460 Max: 16 00:15:05.460 Min: 16 00:15:05.460 Number of Namespaces: 32 00:15:05.460 Compare Command: Supported 00:15:05.460 Write Uncorrectable Command: Not Supported 00:15:05.460 Dataset Management Command: Supported 00:15:05.460 Write Zeroes Command: Supported 00:15:05.460 Set Features Save Field: Not Supported 00:15:05.460 Reservations: Not Supported 00:15:05.460 Timestamp: Not Supported 00:15:05.460 Copy: Supported 00:15:05.460 Volatile Write Cache: Present 00:15:05.460 Atomic Write Unit (Normal): 1 00:15:05.460 Atomic Write Unit (PFail): 1 00:15:05.460 Atomic Compare & Write Unit: 1 00:15:05.460 Fused Compare & Write: Supported 00:15:05.461 Scatter-Gather List 00:15:05.461 SGL Command Set: Supported (Dword aligned) 00:15:05.461 SGL Keyed: Not Supported 00:15:05.461 SGL Bit Bucket Descriptor: Not Supported 00:15:05.461 SGL Metadata Pointer: Not Supported 00:15:05.461 Oversized SGL: Not Supported 00:15:05.461 SGL Metadata Address: Not Supported 00:15:05.461 SGL Offset: Not Supported 00:15:05.461 Transport SGL Data Block: Not Supported 00:15:05.461 Replay Protected Memory Block: Not Supported 00:15:05.461 00:15:05.461 Firmware Slot Information 00:15:05.461 ========================= 00:15:05.461 Active slot: 1 00:15:05.461 Slot 1 Firmware Revision: 24.01.1 00:15:05.461 00:15:05.461 00:15:05.461 Commands Supported and Effects 00:15:05.461 ============================== 00:15:05.461 Admin Commands 00:15:05.461 -------------- 00:15:05.461 Get Log Page (02h): Supported 00:15:05.461 Identify (06h): Supported 00:15:05.461 Abort (08h): Supported 00:15:05.461 Set Features (09h): Supported 00:15:05.461 Get Features (0Ah): Supported 00:15:05.461 Asynchronous Event Request (0Ch): Supported 00:15:05.461 Keep Alive (18h): Supported 00:15:05.461 I/O Commands 00:15:05.461 ------------ 00:15:05.461 Flush (00h): Supported LBA-Change 00:15:05.461 Write (01h): Supported LBA-Change 00:15:05.461 Read (02h): Supported 00:15:05.461 Compare (05h): Supported 00:15:05.461 Write Zeroes (08h): Supported LBA-Change 00:15:05.461 Dataset Management (09h): Supported LBA-Change 00:15:05.461 Copy (19h): Supported LBA-Change 00:15:05.461 Unknown (79h): Supported LBA-Change 00:15:05.461 Unknown (7Ah): Supported 00:15:05.461 00:15:05.461 Error Log 00:15:05.461 ========= 00:15:05.461 00:15:05.461 Arbitration 00:15:05.461 =========== 00:15:05.461 Arbitration Burst: 1 00:15:05.461 00:15:05.461 Power Management 00:15:05.461 ================ 00:15:05.461 Number of Power States: 1 00:15:05.461 Current Power State: Power State #0 00:15:05.461 Power State #0: 00:15:05.461 Max Power: 0.00 W 00:15:05.461 Non-Operational State: Operational 00:15:05.461 Entry Latency: Not Reported 00:15:05.461 Exit Latency: Not Reported 00:15:05.461 Relative Read Throughput: 0 00:15:05.461 Relative Read Latency: 0 00:15:05.461 Relative Write Throughput: 0 00:15:05.461 Relative Write Latency: 0 00:15:05.461 Idle Power: Not Reported 00:15:05.461 Active Power: Not Reported 00:15:05.461 Non-Operational Permissive Mode: Not Supported 00:15:05.461 00:15:05.461 Health Information 00:15:05.461 ================== 00:15:05.461 Critical Warnings: 00:15:05.461 Available Spare Space: OK 00:15:05.461 Temperature: OK 00:15:05.461 Device Reliability: OK 00:15:05.461 Read Only: No 00:15:05.461 Volatile Memory Backup: OK 00:15:05.461 Current Temperature: 0 Kelvin[2024-11-18 01:57:39.698265] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:05.461 [2024-11-18 01:57:39.698281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:05.461 [2024-11-18 01:57:39.698342] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:05.461 [2024-11-18 01:57:39.698361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:05.461 [2024-11-18 01:57:39.698372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:05.461 [2024-11-18 01:57:39.698382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:05.461 [2024-11-18 01:57:39.698396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:05.461 [2024-11-18 01:57:39.702325] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:05.461 [2024-11-18 01:57:39.702347] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:05.461 [2024-11-18 01:57:39.703024] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:05.461 [2024-11-18 01:57:39.703037] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:05.461 [2024-11-18 01:57:39.703991] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:05.461 [2024-11-18 01:57:39.704013] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:05.461 [2024-11-18 01:57:39.704065] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:05.461 [2024-11-18 01:57:39.706037] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:05.461 (-273 Celsius) 00:15:05.461 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:05.461 Available Spare: 0% 00:15:05.461 Available Spare Threshold: 0% 00:15:05.461 Life Percentage Used: 0% 00:15:05.461 Data Units Read: 0 00:15:05.461 Data Units Written: 0 00:15:05.461 Host Read Commands: 0 00:15:05.461 Host Write Commands: 0 00:15:05.461 Controller Busy Time: 0 minutes 00:15:05.461 Power Cycles: 0 00:15:05.461 Power On Hours: 0 hours 00:15:05.461 Unsafe Shutdowns: 0 00:15:05.461 Unrecoverable Media Errors: 0 00:15:05.461 Lifetime Error Log Entries: 0 00:15:05.461 Warning Temperature Time: 0 minutes 00:15:05.461 Critical Temperature Time: 0 minutes 00:15:05.461 00:15:05.461 Number of Queues 00:15:05.461 ================ 00:15:05.461 Number of I/O Submission Queues: 127 00:15:05.461 Number of I/O Completion Queues: 127 00:15:05.461 00:15:05.461 Active Namespaces 00:15:05.461 ================= 00:15:05.461 Namespace ID:1 00:15:05.461 Error Recovery Timeout: Unlimited 00:15:05.461 Command Set Identifier: NVM (00h) 00:15:05.461 Deallocate: Supported 00:15:05.461 Deallocated/Unwritten Error: Not Supported 00:15:05.461 Deallocated Read Value: Unknown 00:15:05.461 Deallocate in Write Zeroes: Not Supported 00:15:05.461 Deallocated Guard Field: 0xFFFF 00:15:05.461 Flush: Supported 00:15:05.461 Reservation: Supported 00:15:05.461 Namespace Sharing Capabilities: Multiple Controllers 00:15:05.461 Size (in LBAs): 131072 (0GiB) 00:15:05.461 Capacity (in LBAs): 131072 (0GiB) 00:15:05.461 Utilization (in LBAs): 131072 (0GiB) 00:15:05.461 NGUID: 19E2F8149775449DB9B1B90339E2AC7F 00:15:05.461 UUID: 19e2f814-9775-449d-b9b1-b90339e2ac7f 00:15:05.461 Thin Provisioning: Not Supported 00:15:05.461 Per-NS Atomic Units: Yes 00:15:05.461 Atomic Boundary Size (Normal): 0 00:15:05.461 Atomic Boundary Size (PFail): 0 00:15:05.461 Atomic Boundary Offset: 0 00:15:05.461 Maximum Single Source Range Length: 65535 00:15:05.461 Maximum Copy Length: 65535 00:15:05.461 Maximum Source Range Count: 1 00:15:05.461 NGUID/EUI64 Never Reused: No 00:15:05.461 Namespace Write Protected: No 00:15:05.461 Number of LBA Formats: 1 00:15:05.461 Current LBA Format: LBA Format #00 00:15:05.461 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:05.461 00:15:05.461 01:57:39 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:05.461 EAL: No free 2048 kB hugepages reported on node 1 00:15:10.780 Initializing NVMe Controllers 00:15:10.780 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:10.780 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:10.780 Initialization complete. Launching workers. 00:15:10.780 ======================================================== 00:15:10.780 Latency(us) 00:15:10.780 Device Information : IOPS MiB/s Average min max 00:15:10.780 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 36783.47 143.69 3479.06 1149.90 8479.87 00:15:10.780 ======================================================== 00:15:10.780 Total : 36783.47 143.69 3479.06 1149.90 8479.87 00:15:10.780 00:15:10.780 01:57:45 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:10.780 EAL: No free 2048 kB hugepages reported on node 1 00:15:16.044 Initializing NVMe Controllers 00:15:16.044 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:16.044 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:16.044 Initialization complete. Launching workers. 00:15:16.044 ======================================================== 00:15:16.044 Latency(us) 00:15:16.045 Device Information : IOPS MiB/s Average min max 00:15:16.045 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 15974.40 62.40 8021.23 4984.06 15963.02 00:15:16.045 ======================================================== 00:15:16.045 Total : 15974.40 62.40 8021.23 4984.06 15963.02 00:15:16.045 00:15:16.045 01:57:50 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:16.045 EAL: No free 2048 kB hugepages reported on node 1 00:15:21.312 Initializing NVMe Controllers 00:15:21.312 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:21.312 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:21.312 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:21.312 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:21.312 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:21.312 Initialization complete. Launching workers. 00:15:21.312 Starting thread on core 2 00:15:21.312 Starting thread on core 3 00:15:21.312 Starting thread on core 1 00:15:21.312 01:57:55 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:21.312 EAL: No free 2048 kB hugepages reported on node 1 00:15:24.595 Initializing NVMe Controllers 00:15:24.595 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:24.595 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:24.595 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:24.595 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:24.595 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:24.595 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:24.595 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:24.595 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:24.595 Initialization complete. Launching workers. 00:15:24.595 Starting thread on core 1 with urgent priority queue 00:15:24.595 Starting thread on core 2 with urgent priority queue 00:15:24.595 Starting thread on core 3 with urgent priority queue 00:15:24.595 Starting thread on core 0 with urgent priority queue 00:15:24.595 SPDK bdev Controller (SPDK1 ) core 0: 4299.33 IO/s 23.26 secs/100000 ios 00:15:24.595 SPDK bdev Controller (SPDK1 ) core 1: 4064.00 IO/s 24.61 secs/100000 ios 00:15:24.595 SPDK bdev Controller (SPDK1 ) core 2: 4307.67 IO/s 23.21 secs/100000 ios 00:15:24.595 SPDK bdev Controller (SPDK1 ) core 3: 4314.67 IO/s 23.18 secs/100000 ios 00:15:24.595 ======================================================== 00:15:24.595 00:15:24.595 01:57:58 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:24.595 EAL: No free 2048 kB hugepages reported on node 1 00:15:24.854 Initializing NVMe Controllers 00:15:24.854 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:24.854 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:24.854 Namespace ID: 1 size: 0GB 00:15:24.854 Initialization complete. 00:15:24.854 INFO: using host memory buffer for IO 00:15:24.854 Hello world! 00:15:24.854 01:57:59 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:25.111 EAL: No free 2048 kB hugepages reported on node 1 00:15:26.486 Initializing NVMe Controllers 00:15:26.486 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:26.486 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:26.486 Initialization complete. Launching workers. 00:15:26.486 submit (in ns) avg, min, max = 5691.0, 3451.1, 4032036.7 00:15:26.486 complete (in ns) avg, min, max = 26901.6, 2036.7, 6013565.6 00:15:26.486 00:15:26.486 Submit histogram 00:15:26.486 ================ 00:15:26.486 Range in us Cumulative Count 00:15:26.486 3.437 - 3.461: 0.0443% ( 6) 00:15:26.486 3.461 - 3.484: 0.3541% ( 42) 00:15:26.486 3.484 - 3.508: 1.1066% ( 102) 00:15:26.486 3.508 - 3.532: 3.8952% ( 378) 00:15:26.486 3.532 - 3.556: 9.0077% ( 693) 00:15:26.486 3.556 - 3.579: 16.5474% ( 1022) 00:15:26.486 3.579 - 3.603: 25.2232% ( 1176) 00:15:26.486 3.603 - 3.627: 34.3047% ( 1231) 00:15:26.486 3.627 - 3.650: 43.0764% ( 1189) 00:15:26.486 3.650 - 3.674: 49.8414% ( 917) 00:15:26.486 3.674 - 3.698: 54.8211% ( 675) 00:15:26.486 3.698 - 3.721: 58.7459% ( 532) 00:15:26.486 3.721 - 3.745: 62.1394% ( 460) 00:15:26.486 3.745 - 3.769: 65.8871% ( 508) 00:15:26.486 3.769 - 3.793: 69.7307% ( 521) 00:15:26.486 3.793 - 3.816: 74.0391% ( 584) 00:15:26.486 3.816 - 3.840: 77.9417% ( 529) 00:15:26.486 3.840 - 3.864: 81.8001% ( 523) 00:15:26.486 3.864 - 3.887: 84.5076% ( 367) 00:15:26.486 3.887 - 3.911: 86.5437% ( 276) 00:15:26.486 3.911 - 3.935: 88.3217% ( 241) 00:15:26.486 3.935 - 3.959: 89.5906% ( 172) 00:15:26.486 3.959 - 3.982: 90.7340% ( 155) 00:15:26.486 3.982 - 4.006: 91.6931% ( 130) 00:15:26.486 4.006 - 4.030: 92.5636% ( 118) 00:15:26.486 4.030 - 4.053: 93.5743% ( 137) 00:15:26.486 4.053 - 4.077: 94.3637% ( 107) 00:15:26.486 4.077 - 4.101: 95.0498% ( 93) 00:15:26.486 4.101 - 4.124: 95.4629% ( 56) 00:15:26.486 4.124 - 4.148: 95.8097% ( 47) 00:15:26.486 4.148 - 4.172: 96.0384% ( 31) 00:15:26.486 4.172 - 4.196: 96.2449% ( 28) 00:15:26.486 4.196 - 4.219: 96.3925% ( 20) 00:15:26.486 4.219 - 4.243: 96.5253% ( 18) 00:15:26.486 4.243 - 4.267: 96.6876% ( 22) 00:15:26.486 4.267 - 4.290: 96.7761% ( 12) 00:15:26.486 4.290 - 4.314: 96.8794% ( 14) 00:15:26.486 4.314 - 4.338: 96.9605% ( 11) 00:15:26.486 4.338 - 4.361: 97.0048% ( 6) 00:15:26.486 4.361 - 4.385: 97.0859% ( 11) 00:15:26.486 4.385 - 4.409: 97.1302% ( 6) 00:15:26.486 4.409 - 4.433: 97.1597% ( 4) 00:15:26.486 4.456 - 4.480: 97.2040% ( 6) 00:15:26.486 4.480 - 4.504: 97.2261% ( 3) 00:15:26.486 4.527 - 4.551: 97.2409% ( 2) 00:15:26.486 4.551 - 4.575: 97.2556% ( 2) 00:15:26.486 4.575 - 4.599: 97.2999% ( 6) 00:15:26.486 4.599 - 4.622: 97.3294% ( 4) 00:15:26.486 4.622 - 4.646: 97.3810% ( 7) 00:15:26.486 4.646 - 4.670: 97.4401% ( 8) 00:15:26.486 4.670 - 4.693: 97.4917% ( 7) 00:15:26.486 4.693 - 4.717: 97.5360% ( 6) 00:15:26.486 4.717 - 4.741: 97.5655% ( 4) 00:15:26.486 4.741 - 4.764: 97.6024% ( 5) 00:15:26.486 4.764 - 4.788: 97.6245% ( 3) 00:15:26.486 4.788 - 4.812: 97.6835% ( 8) 00:15:26.486 4.812 - 4.836: 97.7204% ( 5) 00:15:26.486 4.836 - 4.859: 97.7647% ( 6) 00:15:26.486 4.859 - 4.883: 97.8089% ( 6) 00:15:26.486 4.883 - 4.907: 97.8458% ( 5) 00:15:26.486 4.907 - 4.930: 97.8753% ( 4) 00:15:26.486 4.930 - 4.954: 97.9196% ( 6) 00:15:26.486 4.954 - 4.978: 97.9270% ( 1) 00:15:26.486 4.978 - 5.001: 97.9343% ( 1) 00:15:26.486 5.001 - 5.025: 97.9712% ( 5) 00:15:26.486 5.025 - 5.049: 97.9934% ( 3) 00:15:26.486 5.049 - 5.073: 98.0081% ( 2) 00:15:26.486 5.073 - 5.096: 98.0155% ( 1) 00:15:26.486 5.096 - 5.120: 98.0229% ( 1) 00:15:26.486 5.120 - 5.144: 98.0302% ( 1) 00:15:26.486 5.144 - 5.167: 98.0524% ( 3) 00:15:26.486 5.191 - 5.215: 98.0598% ( 1) 00:15:26.486 5.215 - 5.239: 98.0745% ( 2) 00:15:26.486 5.239 - 5.262: 98.0819% ( 1) 00:15:26.486 5.286 - 5.310: 98.0966% ( 2) 00:15:26.486 5.310 - 5.333: 98.1040% ( 1) 00:15:26.486 5.428 - 5.452: 98.1114% ( 1) 00:15:26.486 5.476 - 5.499: 98.1188% ( 1) 00:15:26.486 5.499 - 5.523: 98.1262% ( 1) 00:15:26.486 5.523 - 5.547: 98.1335% ( 1) 00:15:26.486 5.594 - 5.618: 98.1409% ( 1) 00:15:26.486 5.618 - 5.641: 98.1483% ( 1) 00:15:26.486 5.665 - 5.689: 98.1704% ( 3) 00:15:26.486 5.736 - 5.760: 98.1778% ( 1) 00:15:26.486 5.784 - 5.807: 98.1852% ( 1) 00:15:26.486 5.831 - 5.855: 98.1925% ( 1) 00:15:26.486 5.973 - 5.997: 98.1999% ( 1) 00:15:26.486 6.068 - 6.116: 98.2073% ( 1) 00:15:26.486 6.210 - 6.258: 98.2147% ( 1) 00:15:26.486 6.258 - 6.305: 98.2221% ( 1) 00:15:26.486 6.353 - 6.400: 98.2294% ( 1) 00:15:26.486 6.495 - 6.542: 98.2368% ( 1) 00:15:26.486 6.827 - 6.874: 98.2442% ( 1) 00:15:26.486 6.969 - 7.016: 98.2589% ( 2) 00:15:26.486 7.016 - 7.064: 98.2663% ( 1) 00:15:26.486 7.206 - 7.253: 98.2737% ( 1) 00:15:26.486 7.348 - 7.396: 98.2885% ( 2) 00:15:26.486 7.443 - 7.490: 98.3032% ( 2) 00:15:26.486 7.490 - 7.538: 98.3106% ( 1) 00:15:26.486 7.538 - 7.585: 98.3253% ( 2) 00:15:26.486 7.633 - 7.680: 98.3327% ( 1) 00:15:26.486 7.680 - 7.727: 98.3401% ( 1) 00:15:26.486 7.727 - 7.775: 98.3475% ( 1) 00:15:26.486 7.775 - 7.822: 98.3622% ( 2) 00:15:26.486 7.822 - 7.870: 98.3770% ( 2) 00:15:26.486 7.917 - 7.964: 98.3917% ( 2) 00:15:26.486 8.012 - 8.059: 98.3991% ( 1) 00:15:26.486 8.059 - 8.107: 98.4065% ( 1) 00:15:26.486 8.154 - 8.201: 98.4212% ( 2) 00:15:26.486 8.201 - 8.249: 98.4360% ( 2) 00:15:26.486 8.249 - 8.296: 98.4434% ( 1) 00:15:26.486 8.296 - 8.344: 98.4508% ( 1) 00:15:26.486 8.391 - 8.439: 98.4581% ( 1) 00:15:26.486 8.439 - 8.486: 98.4655% ( 1) 00:15:26.486 8.486 - 8.533: 98.4729% ( 1) 00:15:26.486 8.628 - 8.676: 98.4950% ( 3) 00:15:26.486 8.723 - 8.770: 98.5024% ( 1) 00:15:26.486 8.770 - 8.818: 98.5172% ( 2) 00:15:26.486 8.818 - 8.865: 98.5319% ( 2) 00:15:26.486 8.865 - 8.913: 98.5540% ( 3) 00:15:26.486 9.007 - 9.055: 98.5614% ( 1) 00:15:26.486 9.055 - 9.102: 98.5688% ( 1) 00:15:26.486 9.102 - 9.150: 98.5909% ( 3) 00:15:26.486 9.150 - 9.197: 98.5983% ( 1) 00:15:26.486 9.197 - 9.244: 98.6204% ( 3) 00:15:26.487 9.292 - 9.339: 98.6352% ( 2) 00:15:26.487 9.434 - 9.481: 98.6426% ( 1) 00:15:26.487 9.624 - 9.671: 98.6499% ( 1) 00:15:26.487 9.671 - 9.719: 98.6573% ( 1) 00:15:26.487 9.719 - 9.766: 98.6647% ( 1) 00:15:26.487 9.766 - 9.813: 98.6795% ( 2) 00:15:26.487 9.908 - 9.956: 98.6868% ( 1) 00:15:26.487 10.003 - 10.050: 98.6942% ( 1) 00:15:26.487 10.050 - 10.098: 98.7016% ( 1) 00:15:26.487 10.098 - 10.145: 98.7237% ( 3) 00:15:26.487 10.145 - 10.193: 98.7385% ( 2) 00:15:26.487 10.193 - 10.240: 98.7459% ( 1) 00:15:26.487 10.287 - 10.335: 98.7532% ( 1) 00:15:26.487 10.382 - 10.430: 98.7606% ( 1) 00:15:26.487 10.430 - 10.477: 98.7754% ( 2) 00:15:26.487 10.524 - 10.572: 98.7901% ( 2) 00:15:26.487 10.572 - 10.619: 98.7975% ( 1) 00:15:26.487 10.667 - 10.714: 98.8122% ( 2) 00:15:26.487 10.809 - 10.856: 98.8196% ( 1) 00:15:26.487 10.904 - 10.951: 98.8270% ( 1) 00:15:26.487 11.046 - 11.093: 98.8418% ( 2) 00:15:26.487 11.188 - 11.236: 98.8491% ( 1) 00:15:26.487 11.236 - 11.283: 98.8639% ( 2) 00:15:26.487 11.662 - 11.710: 98.8713% ( 1) 00:15:26.487 11.710 - 11.757: 98.8786% ( 1) 00:15:26.487 12.136 - 12.231: 98.8860% ( 1) 00:15:26.487 12.326 - 12.421: 98.9008% ( 2) 00:15:26.487 12.421 - 12.516: 98.9229% ( 3) 00:15:26.487 12.516 - 12.610: 98.9450% ( 3) 00:15:26.487 12.895 - 12.990: 98.9598% ( 2) 00:15:26.487 13.084 - 13.179: 98.9672% ( 1) 00:15:26.487 13.369 - 13.464: 98.9819% ( 2) 00:15:26.487 13.464 - 13.559: 98.9893% ( 1) 00:15:26.487 14.127 - 14.222: 98.9967% ( 1) 00:15:26.487 14.507 - 14.601: 99.0041% ( 1) 00:15:26.487 14.791 - 14.886: 99.0114% ( 1) 00:15:26.487 15.929 - 16.024: 99.0188% ( 1) 00:15:26.487 17.161 - 17.256: 99.0262% ( 1) 00:15:26.487 17.256 - 17.351: 99.0336% ( 1) 00:15:26.487 17.351 - 17.446: 99.0631% ( 4) 00:15:26.487 17.446 - 17.541: 99.0852% ( 3) 00:15:26.487 17.541 - 17.636: 99.1147% ( 4) 00:15:26.487 17.636 - 17.730: 99.1590% ( 6) 00:15:26.487 17.730 - 17.825: 99.1885% ( 4) 00:15:26.487 17.825 - 17.920: 99.2844% ( 13) 00:15:26.487 17.920 - 18.015: 99.3065% ( 3) 00:15:26.487 18.015 - 18.110: 99.3655% ( 8) 00:15:26.487 18.110 - 18.204: 99.3951% ( 4) 00:15:26.487 18.204 - 18.299: 99.4688% ( 10) 00:15:26.487 18.299 - 18.394: 99.5500% ( 11) 00:15:26.487 18.394 - 18.489: 99.6016% ( 7) 00:15:26.487 18.489 - 18.584: 99.6459% ( 6) 00:15:26.487 18.584 - 18.679: 99.6828% ( 5) 00:15:26.487 18.679 - 18.773: 99.7049% ( 3) 00:15:26.487 18.773 - 18.868: 99.7270% ( 3) 00:15:26.487 18.868 - 18.963: 99.7934% ( 9) 00:15:26.487 18.963 - 19.058: 99.8008% ( 1) 00:15:26.487 19.058 - 19.153: 99.8303% ( 4) 00:15:26.487 19.153 - 19.247: 99.8451% ( 2) 00:15:26.487 19.342 - 19.437: 99.8525% ( 1) 00:15:26.487 19.532 - 19.627: 99.8598% ( 1) 00:15:26.487 19.627 - 19.721: 99.8672% ( 1) 00:15:26.487 20.196 - 20.290: 99.8746% ( 1) 00:15:26.487 20.954 - 21.049: 99.8820% ( 1) 00:15:26.487 21.523 - 21.618: 99.8893% ( 1) 00:15:26.487 21.618 - 21.713: 99.8967% ( 1) 00:15:26.487 22.092 - 22.187: 99.9041% ( 1) 00:15:26.487 22.187 - 22.281: 99.9115% ( 1) 00:15:26.487 22.566 - 22.661: 99.9188% ( 1) 00:15:26.487 23.230 - 23.324: 99.9262% ( 1) 00:15:26.487 23.324 - 23.419: 99.9336% ( 1) 00:15:26.487 26.169 - 26.359: 99.9410% ( 1) 00:15:26.487 26.359 - 26.548: 99.9484% ( 1) 00:15:26.487 27.876 - 28.065: 99.9557% ( 1) 00:15:26.487 3980.705 - 4004.978: 99.9779% ( 3) 00:15:26.487 4004.978 - 4029.250: 99.9926% ( 2) 00:15:26.487 4029.250 - 4053.523: 100.0000% ( 1) 00:15:26.487 00:15:26.487 Complete histogram 00:15:26.487 ================== 00:15:26.487 Range in us Cumulative Count 00:15:26.487 2.027 - 2.039: 0.0221% ( 3) 00:15:26.487 2.039 - 2.050: 5.9019% ( 797) 00:15:26.487 2.050 - 2.062: 13.8252% ( 1074) 00:15:26.487 2.062 - 2.074: 15.9793% ( 292) 00:15:26.487 2.074 - 2.086: 41.6451% ( 3479) 00:15:26.487 2.086 - 2.098: 55.6031% ( 1892) 00:15:26.487 2.098 - 2.110: 58.5393% ( 398) 00:15:26.487 2.110 - 2.121: 62.5157% ( 539) 00:15:26.487 2.121 - 2.133: 63.7403% ( 166) 00:15:26.487 2.133 - 2.145: 66.7577% ( 409) 00:15:26.487 2.145 - 2.157: 76.8351% ( 1366) 00:15:26.487 2.157 - 2.169: 80.1918% ( 455) 00:15:26.487 2.169 - 2.181: 81.2689% ( 146) 00:15:26.487 2.181 - 2.193: 84.0871% ( 382) 00:15:26.487 2.193 - 2.204: 85.0609% ( 132) 00:15:26.487 2.204 - 2.216: 86.5585% ( 203) 00:15:26.487 2.216 - 2.228: 91.7890% ( 709) 00:15:26.487 2.228 - 2.240: 93.4784% ( 229) 00:15:26.487 2.240 - 2.252: 94.0317% ( 75) 00:15:26.487 2.252 - 2.264: 94.6072% ( 78) 00:15:26.487 2.264 - 2.276: 94.8432% ( 32) 00:15:26.487 2.276 - 2.287: 95.1457% ( 41) 00:15:26.487 2.287 - 2.299: 95.4998% ( 48) 00:15:26.487 2.299 - 2.311: 95.5588% ( 8) 00:15:26.487 2.311 - 2.323: 95.6400% ( 11) 00:15:26.487 2.323 - 2.335: 95.8244% ( 25) 00:15:26.487 2.335 - 2.347: 95.9941% ( 23) 00:15:26.487 2.347 - 2.359: 96.0900% ( 13) 00:15:26.487 2.359 - 2.370: 96.3039% ( 29) 00:15:26.487 2.370 - 2.382: 96.5326% ( 31) 00:15:26.487 2.382 - 2.394: 96.6728% ( 19) 00:15:26.487 2.394 - 2.406: 96.8351% ( 22) 00:15:26.487 2.406 - 2.418: 97.0638% ( 31) 00:15:26.487 2.418 - 2.430: 97.1892% ( 17) 00:15:26.487 2.430 - 2.441: 97.3515% ( 22) 00:15:26.487 2.441 - 2.453: 97.5286% ( 24) 00:15:26.487 2.453 - 2.465: 97.6245% ( 13) 00:15:26.487 2.465 - 2.477: 97.7056% ( 11) 00:15:26.487 2.477 - 2.489: 97.7868% ( 11) 00:15:26.487 2.489 - 2.501: 97.8827% ( 13) 00:15:26.487 2.501 - 2.513: 98.0081% ( 17) 00:15:26.487 2.513 - 2.524: 98.0376% ( 4) 00:15:26.487 2.524 - 2.536: 98.1262% ( 12) 00:15:26.487 2.536 - 2.548: 98.1852% ( 8) 00:15:26.487 2.548 - 2.560: 98.2294% ( 6) 00:15:26.487 2.560 - 2.572: 98.2958% ( 9) 00:15:26.487 2.572 - 2.584: 98.3253% ( 4) 00:15:26.487 2.584 - 2.596: 98.3401% ( 2) 00:15:26.487 2.596 - 2.607: 98.3696% ( 4) 00:15:26.487 2.607 - 2.619: 98.3844% ( 2) 00:15:26.487 2.631 - 2.643: 98.3917% ( 1) 00:15:26.487 2.667 - 2.679: 98.3991% ( 1) 00:15:26.487 2.714 - 2.726: 98.4065% ( 1) 00:15:26.487 2.738 - 2.750: 98.4139% ( 1) 00:15:26.487 2.809 - 2.821: 98.4212% ( 1) 00:15:26.487 2.821 - 2.833: 98.4286% ( 1) 00:15:26.487 2.904 - 2.916: 98.4360% ( 1) 00:15:26.487 2.963 - 2.975: 98.4434% ( 1) 00:15:26.487 3.081 - 3.105: 98.4508% ( 1) 00:15:26.487 3.129 - 3.153: 98.4581% ( 1) 00:15:26.487 3.247 - 3.271: 98.4655% ( 1) 00:15:26.487 3.271 - 3.295: 98.4729% ( 1) 00:15:26.487 3.319 - 3.342: 98.4803% ( 1) 00:15:26.487 3.342 - 3.366: 98.4876% ( 1) 00:15:26.487 3.366 - 3.390: 98.5098% ( 3) 00:15:26.487 3.390 - 3.413: 98.5245% ( 2) 00:15:26.487 3.437 - 3.461: 98.5319% ( 1) 00:15:26.487 3.461 - 3.484: 98.5467% ( 2) 00:15:26.487 3.484 - 3.508: 98.5688% ( 3) 00:15:26.487 3.508 - 3.532: 98.5762% ( 1) 00:15:26.487 3.532 - 3.556: 98.5835% ( 1) 00:15:26.487 3.579 - 3.603: 98.5983% ( 2) 00:15:26.487 3.627 - 3.650: 98.6057% ( 1) 00:15:26.487 3.650 - 3.674: 98.6204% ( 2) 00:15:26.487 3.674 - 3.698: 98.6278% ( 1) 00:15:26.487 3.769 - 3.793: 98.6352% ( 1) 00:15:26.487 3.935 - 3.959: 98.6499% ( 2) 00:15:26.487 4.314 - 4.338: 98.6573% ( 1) 00:15:26.487 4.361 - 4.385: 98.6647% ( 1) 00:15:26.487 5.262 - 5.286: 98.6721% ( 1) 00:15:26.487 5.594 - 5.618: 98.6795% ( 1) 00:15:26.487 6.068 - 6.116: 98.6868% ( 1) 00:15:26.487 6.210 - 6.258: 98.6942% ( 1) 00:15:26.487 6.353 - 6.400: 98.7016% ( 1) 00:15:26.487 6.447 - 6.495: 98.7090% ( 1) 00:15:26.487 6.590 - 6.637: 98.7163% ( 1) 00:15:26.487 6.921 - 6.969: 98.7237% ( 1) 00:15:26.487 6.969 - 7.016: 98.7311% ( 1) 00:15:26.487 7.016 - 7.064: 98.7385% ( 1) 00:15:26.487 7.822 - 7.870: 98.7459% ( 1) 00:15:26.487 8.344 - 8.391: 98.7532% ( 1) 00:15:26.487 8.770 - 8.818: 98.7606% ( 1) 00:15:26.487 9.055 - 9.102: 98.7680% ( 1) 00:15:26.487 9.481 - 9.529: 98.7827% ( 2) 00:15:26.487 9.813 - 9.861: 98.7901% ( 1) 00:15:26.487 9.861 - 9.908: 98.7975% ( 1) 00:15:26.487 10.287 - 10.335: 98.8049% ( 1) 00:15:26.487 10.335 - 10.382: 98.8122% ( 1) 00:15:26.487 12.136 - 12.231: 98.8196% ( 1) 00:15:26.487 13.559 - 13.653: 98.8270% ( 1) 00:15:26.487 15.265 - 15.360: 98.8344% ( 1) 00:15:26.487 15.360 - 15.455: 98.8418% ( 1) 00:15:26.487 15.550 - 15.644: 98.8491% ( 1) 00:15:26.487 15.739 - 15.834: 98.8639% ( 2) 00:15:26.487 15.834 - 15.929: 98.8786% ( 2) 00:15:26.488 15.929 - 16.024: 98.8934% ( 2) 00:15:26.488 16.024 - 16.119: 98.9155% ( 3) 00:15:26.488 16.119 - 16.213: 98.9450% ( 4) 00:15:26.488 16.213 - 16.308: 98.9893% ( 6) 00:15:26.488 16.308 - 16.403: 99.0041% ( 2) 00:15:26.488 16.403 - 16.498: 99.0557% ( 7) 00:15:26.488 16.498 - 16.593: 99.0926% ( 5) 00:15:26.488 16.593 - 16.687: 99.1368% ( 6) 00:15:26.488 16.687 - 16.782: 99.1516% ( 2) 00:15:26.488 16.782 - 16.877: 99.1664% ( 2) 00:15:26.488 16.877 - 16.972: 99.2106% ( 6) 00:15:26.488 16.972 - 17.067: 99.2475% ( 5) 00:15:26.488 17.067 - 17.161: 99.2696% ( 3) 00:15:26.488 17.161 - 17.256: 99.2770% ( 1) 00:15:26.488 17.256 - 17.351: 99.2992% ( 3) 00:15:26.488 17.351 - 17.446: 99.3065% ( 1) 00:15:26.488 17.636 - 17.730: 99.3213% ( 2) 00:15:26.488 18.015 - 18.110: 99.3287% ( 1) 00:15:26.488 18.110 - 18.204: 99.3360% ( 1) 00:15:26.488 18.299 - 18.394: 99.3434% ( 1) 00:15:26.488 18.394 - 18.489: 99.3508% ( 1) 00:15:26.488 18.584 - 18.679: 99.3582% ( 1) 00:15:26.488 18.868 - 18.963: 99.3655% ( 1) 00:15:26.488 21.333 - 21.428: 99.3729% ( 1) 00:15:26.488 23.704 - 23.799: 99.3803% ( 1) 00:15:26.488 1110.471 - 1116.539: 99.3877% ( 1) 00:15:26.488 1341.061 - 1347.129: 99.3951% ( 1) 00:15:26.488 3980.705 - 4004.978: 99.8377% ( 60) 00:15:26.488 4004.978 - 4029.250: 99.9852% ( 20) 00:15:26.488 5995.330 - 6019.603: 100.0000% ( 2) 00:15:26.488 00:15:26.488 01:58:00 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:26.488 01:58:00 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:26.488 01:58:00 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:26.488 01:58:00 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:26.488 01:58:00 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:26.488 [2024-11-18 01:58:00.813481] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:26.488 [ 00:15:26.488 { 00:15:26.488 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:26.488 "subtype": "Discovery", 00:15:26.488 "listen_addresses": [], 00:15:26.488 "allow_any_host": true, 00:15:26.488 "hosts": [] 00:15:26.488 }, 00:15:26.488 { 00:15:26.488 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:26.488 "subtype": "NVMe", 00:15:26.488 "listen_addresses": [ 00:15:26.488 { 00:15:26.488 "transport": "VFIOUSER", 00:15:26.488 "trtype": "VFIOUSER", 00:15:26.488 "adrfam": "IPv4", 00:15:26.488 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:26.488 "trsvcid": "0" 00:15:26.488 } 00:15:26.488 ], 00:15:26.488 "allow_any_host": true, 00:15:26.488 "hosts": [], 00:15:26.488 "serial_number": "SPDK1", 00:15:26.488 "model_number": "SPDK bdev Controller", 00:15:26.488 "max_namespaces": 32, 00:15:26.488 "min_cntlid": 1, 00:15:26.488 "max_cntlid": 65519, 00:15:26.488 "namespaces": [ 00:15:26.488 { 00:15:26.488 "nsid": 1, 00:15:26.488 "bdev_name": "Malloc1", 00:15:26.488 "name": "Malloc1", 00:15:26.488 "nguid": "19E2F8149775449DB9B1B90339E2AC7F", 00:15:26.488 "uuid": "19e2f814-9775-449d-b9b1-b90339e2ac7f" 00:15:26.488 } 00:15:26.488 ] 00:15:26.488 }, 00:15:26.488 { 00:15:26.488 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:26.488 "subtype": "NVMe", 00:15:26.488 "listen_addresses": [ 00:15:26.488 { 00:15:26.488 "transport": "VFIOUSER", 00:15:26.488 "trtype": "VFIOUSER", 00:15:26.488 "adrfam": "IPv4", 00:15:26.488 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:26.488 "trsvcid": "0" 00:15:26.488 } 00:15:26.488 ], 00:15:26.488 "allow_any_host": true, 00:15:26.488 "hosts": [], 00:15:26.488 "serial_number": "SPDK2", 00:15:26.488 "model_number": "SPDK bdev Controller", 00:15:26.488 "max_namespaces": 32, 00:15:26.488 "min_cntlid": 1, 00:15:26.488 "max_cntlid": 65519, 00:15:26.488 "namespaces": [ 00:15:26.488 { 00:15:26.488 "nsid": 1, 00:15:26.488 "bdev_name": "Malloc2", 00:15:26.488 "name": "Malloc2", 00:15:26.488 "nguid": "1DAE196DA235444F81A7FC42C9B3BB17", 00:15:26.488 "uuid": "1dae196d-a235-444f-81a7-fc42c9b3bb17" 00:15:26.488 } 00:15:26.488 ] 00:15:26.488 } 00:15:26.488 ] 00:15:26.488 01:58:00 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:26.488 01:58:00 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1180253 00:15:26.488 01:58:00 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:26.488 01:58:00 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:26.488 01:58:00 -- common/autotest_common.sh@1254 -- # local i=0 00:15:26.488 01:58:00 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:26.488 01:58:00 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:26.488 01:58:00 -- common/autotest_common.sh@1265 -- # return 0 00:15:26.488 01:58:00 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:26.488 01:58:00 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:26.488 EAL: No free 2048 kB hugepages reported on node 1 00:15:26.747 Malloc3 00:15:26.747 01:58:01 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:27.004 01:58:01 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:27.004 Asynchronous Event Request test 00:15:27.004 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:27.004 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:27.004 Registering asynchronous event callbacks... 00:15:27.004 Starting namespace attribute notice tests for all controllers... 00:15:27.004 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:27.004 aer_cb - Changed Namespace 00:15:27.004 Cleaning up... 00:15:27.262 [ 00:15:27.262 { 00:15:27.262 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:27.262 "subtype": "Discovery", 00:15:27.262 "listen_addresses": [], 00:15:27.262 "allow_any_host": true, 00:15:27.262 "hosts": [] 00:15:27.262 }, 00:15:27.262 { 00:15:27.262 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:27.262 "subtype": "NVMe", 00:15:27.262 "listen_addresses": [ 00:15:27.262 { 00:15:27.262 "transport": "VFIOUSER", 00:15:27.262 "trtype": "VFIOUSER", 00:15:27.262 "adrfam": "IPv4", 00:15:27.262 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:27.262 "trsvcid": "0" 00:15:27.262 } 00:15:27.262 ], 00:15:27.262 "allow_any_host": true, 00:15:27.262 "hosts": [], 00:15:27.262 "serial_number": "SPDK1", 00:15:27.262 "model_number": "SPDK bdev Controller", 00:15:27.262 "max_namespaces": 32, 00:15:27.262 "min_cntlid": 1, 00:15:27.262 "max_cntlid": 65519, 00:15:27.262 "namespaces": [ 00:15:27.262 { 00:15:27.262 "nsid": 1, 00:15:27.262 "bdev_name": "Malloc1", 00:15:27.262 "name": "Malloc1", 00:15:27.262 "nguid": "19E2F8149775449DB9B1B90339E2AC7F", 00:15:27.262 "uuid": "19e2f814-9775-449d-b9b1-b90339e2ac7f" 00:15:27.262 }, 00:15:27.262 { 00:15:27.262 "nsid": 2, 00:15:27.262 "bdev_name": "Malloc3", 00:15:27.262 "name": "Malloc3", 00:15:27.262 "nguid": "E06F66D11C3E4A81B48442DED06FFE0D", 00:15:27.262 "uuid": "e06f66d1-1c3e-4a81-b484-42ded06ffe0d" 00:15:27.262 } 00:15:27.262 ] 00:15:27.262 }, 00:15:27.262 { 00:15:27.262 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:27.262 "subtype": "NVMe", 00:15:27.262 "listen_addresses": [ 00:15:27.262 { 00:15:27.262 "transport": "VFIOUSER", 00:15:27.262 "trtype": "VFIOUSER", 00:15:27.262 "adrfam": "IPv4", 00:15:27.262 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:27.262 "trsvcid": "0" 00:15:27.262 } 00:15:27.262 ], 00:15:27.262 "allow_any_host": true, 00:15:27.262 "hosts": [], 00:15:27.262 "serial_number": "SPDK2", 00:15:27.262 "model_number": "SPDK bdev Controller", 00:15:27.262 "max_namespaces": 32, 00:15:27.262 "min_cntlid": 1, 00:15:27.262 "max_cntlid": 65519, 00:15:27.262 "namespaces": [ 00:15:27.262 { 00:15:27.262 "nsid": 1, 00:15:27.262 "bdev_name": "Malloc2", 00:15:27.262 "name": "Malloc2", 00:15:27.262 "nguid": "1DAE196DA235444F81A7FC42C9B3BB17", 00:15:27.262 "uuid": "1dae196d-a235-444f-81a7-fc42c9b3bb17" 00:15:27.262 } 00:15:27.262 ] 00:15:27.262 } 00:15:27.262 ] 00:15:27.262 01:58:01 -- target/nvmf_vfio_user.sh@44 -- # wait 1180253 00:15:27.262 01:58:01 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:27.262 01:58:01 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:27.262 01:58:01 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:27.262 01:58:01 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:27.262 [2024-11-18 01:58:01.635768] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:27.262 [2024-11-18 01:58:01.635811] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1180386 ] 00:15:27.262 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.523 [2024-11-18 01:58:01.668760] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:27.523 [2024-11-18 01:58:01.676616] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:27.523 [2024-11-18 01:58:01.676652] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7fbade7d3000 00:15:27.523 [2024-11-18 01:58:01.677604] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:27.523 [2024-11-18 01:58:01.678618] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:27.523 [2024-11-18 01:58:01.679625] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:27.523 [2024-11-18 01:58:01.683335] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:27.523 [2024-11-18 01:58:01.683656] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:27.523 [2024-11-18 01:58:01.684662] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:27.523 [2024-11-18 01:58:01.685671] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:27.523 [2024-11-18 01:58:01.686698] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:27.523 [2024-11-18 01:58:01.687690] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:27.523 [2024-11-18 01:58:01.687712] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7fbadd4cd000 00:15:27.523 [2024-11-18 01:58:01.688829] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:27.523 [2024-11-18 01:58:01.706528] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:27.523 [2024-11-18 01:58:01.706564] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:27.523 [2024-11-18 01:58:01.708649] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:27.524 [2024-11-18 01:58:01.708699] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:27.524 [2024-11-18 01:58:01.708781] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:27.524 [2024-11-18 01:58:01.708808] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:27.524 [2024-11-18 01:58:01.708818] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:27.524 [2024-11-18 01:58:01.709655] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:27.524 [2024-11-18 01:58:01.709675] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:27.524 [2024-11-18 01:58:01.709687] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:27.524 [2024-11-18 01:58:01.710667] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:27.524 [2024-11-18 01:58:01.710701] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:27.524 [2024-11-18 01:58:01.710715] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:27.524 [2024-11-18 01:58:01.711684] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:27.524 [2024-11-18 01:58:01.711709] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:27.524 [2024-11-18 01:58:01.712686] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:27.524 [2024-11-18 01:58:01.712705] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:27.524 [2024-11-18 01:58:01.712715] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:27.524 [2024-11-18 01:58:01.712727] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:27.524 [2024-11-18 01:58:01.712836] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:27.524 [2024-11-18 01:58:01.712844] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:27.524 [2024-11-18 01:58:01.712851] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:27.524 [2024-11-18 01:58:01.713694] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:27.524 [2024-11-18 01:58:01.714716] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:27.524 [2024-11-18 01:58:01.715709] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:27.524 [2024-11-18 01:58:01.716736] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:27.524 [2024-11-18 01:58:01.717719] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:27.524 [2024-11-18 01:58:01.717738] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:27.524 [2024-11-18 01:58:01.717747] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.717770] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:27.524 [2024-11-18 01:58:01.717783] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.717803] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:27.524 [2024-11-18 01:58:01.717812] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:27.524 [2024-11-18 01:58:01.717828] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:27.524 [2024-11-18 01:58:01.724339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:27.524 [2024-11-18 01:58:01.724361] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:27.524 [2024-11-18 01:58:01.724370] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:27.524 [2024-11-18 01:58:01.724378] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:27.524 [2024-11-18 01:58:01.724385] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:27.524 [2024-11-18 01:58:01.724398] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:27.524 [2024-11-18 01:58:01.724406] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:27.524 [2024-11-18 01:58:01.724414] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.724430] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.724447] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:27.524 [2024-11-18 01:58:01.732338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:27.524 [2024-11-18 01:58:01.732377] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:27.524 [2024-11-18 01:58:01.732391] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:27.524 [2024-11-18 01:58:01.732403] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:27.524 [2024-11-18 01:58:01.732415] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:27.524 [2024-11-18 01:58:01.732424] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.732439] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.732454] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:27.524 [2024-11-18 01:58:01.739345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:27.524 [2024-11-18 01:58:01.739367] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:27.524 [2024-11-18 01:58:01.739376] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.739388] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.739402] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.739416] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:27.524 [2024-11-18 01:58:01.748326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:27.524 [2024-11-18 01:58:01.748396] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.748412] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.748425] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:27.524 [2024-11-18 01:58:01.748433] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:27.524 [2024-11-18 01:58:01.748443] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:27.524 [2024-11-18 01:58:01.756320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:27.524 [2024-11-18 01:58:01.756353] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:27.524 [2024-11-18 01:58:01.756377] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.756392] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.756405] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:27.524 [2024-11-18 01:58:01.756413] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:27.524 [2024-11-18 01:58:01.756423] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:27.524 [2024-11-18 01:58:01.764324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:27.524 [2024-11-18 01:58:01.764353] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.764370] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.764383] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:27.524 [2024-11-18 01:58:01.764392] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:27.524 [2024-11-18 01:58:01.764402] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:27.524 [2024-11-18 01:58:01.772323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:27.524 [2024-11-18 01:58:01.772345] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.772367] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:27.524 [2024-11-18 01:58:01.772382] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:27.525 [2024-11-18 01:58:01.772393] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:27.525 [2024-11-18 01:58:01.772402] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:27.525 [2024-11-18 01:58:01.772410] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:27.525 [2024-11-18 01:58:01.772417] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:27.525 [2024-11-18 01:58:01.772425] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:27.525 [2024-11-18 01:58:01.772449] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:27.525 [2024-11-18 01:58:01.780322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:27.525 [2024-11-18 01:58:01.780358] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:27.525 [2024-11-18 01:58:01.788328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:27.525 [2024-11-18 01:58:01.788364] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:27.525 [2024-11-18 01:58:01.796325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:27.525 [2024-11-18 01:58:01.796370] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:27.525 [2024-11-18 01:58:01.804335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:27.525 [2024-11-18 01:58:01.804371] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:27.525 [2024-11-18 01:58:01.804381] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:27.525 [2024-11-18 01:58:01.804387] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:27.525 [2024-11-18 01:58:01.804393] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:27.525 [2024-11-18 01:58:01.804402] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:27.525 [2024-11-18 01:58:01.804414] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:27.525 [2024-11-18 01:58:01.804422] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:27.525 [2024-11-18 01:58:01.804430] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:27.525 [2024-11-18 01:58:01.804441] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:27.525 [2024-11-18 01:58:01.804449] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:27.525 [2024-11-18 01:58:01.804458] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:27.525 [2024-11-18 01:58:01.804469] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:27.525 [2024-11-18 01:58:01.804477] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:27.525 [2024-11-18 01:58:01.804486] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:27.525 [2024-11-18 01:58:01.812325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:27.525 [2024-11-18 01:58:01.812353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:27.525 [2024-11-18 01:58:01.812370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:27.525 [2024-11-18 01:58:01.812382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:27.525 ===================================================== 00:15:27.525 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:27.525 ===================================================== 00:15:27.525 Controller Capabilities/Features 00:15:27.525 ================================ 00:15:27.525 Vendor ID: 4e58 00:15:27.525 Subsystem Vendor ID: 4e58 00:15:27.525 Serial Number: SPDK2 00:15:27.525 Model Number: SPDK bdev Controller 00:15:27.525 Firmware Version: 24.01.1 00:15:27.525 Recommended Arb Burst: 6 00:15:27.525 IEEE OUI Identifier: 8d 6b 50 00:15:27.525 Multi-path I/O 00:15:27.525 May have multiple subsystem ports: Yes 00:15:27.525 May have multiple controllers: Yes 00:15:27.525 Associated with SR-IOV VF: No 00:15:27.525 Max Data Transfer Size: 131072 00:15:27.525 Max Number of Namespaces: 32 00:15:27.525 Max Number of I/O Queues: 127 00:15:27.525 NVMe Specification Version (VS): 1.3 00:15:27.525 NVMe Specification Version (Identify): 1.3 00:15:27.525 Maximum Queue Entries: 256 00:15:27.525 Contiguous Queues Required: Yes 00:15:27.525 Arbitration Mechanisms Supported 00:15:27.525 Weighted Round Robin: Not Supported 00:15:27.525 Vendor Specific: Not Supported 00:15:27.525 Reset Timeout: 15000 ms 00:15:27.525 Doorbell Stride: 4 bytes 00:15:27.525 NVM Subsystem Reset: Not Supported 00:15:27.525 Command Sets Supported 00:15:27.525 NVM Command Set: Supported 00:15:27.525 Boot Partition: Not Supported 00:15:27.525 Memory Page Size Minimum: 4096 bytes 00:15:27.525 Memory Page Size Maximum: 4096 bytes 00:15:27.525 Persistent Memory Region: Not Supported 00:15:27.525 Optional Asynchronous Events Supported 00:15:27.525 Namespace Attribute Notices: Supported 00:15:27.525 Firmware Activation Notices: Not Supported 00:15:27.525 ANA Change Notices: Not Supported 00:15:27.525 PLE Aggregate Log Change Notices: Not Supported 00:15:27.525 LBA Status Info Alert Notices: Not Supported 00:15:27.525 EGE Aggregate Log Change Notices: Not Supported 00:15:27.525 Normal NVM Subsystem Shutdown event: Not Supported 00:15:27.525 Zone Descriptor Change Notices: Not Supported 00:15:27.525 Discovery Log Change Notices: Not Supported 00:15:27.525 Controller Attributes 00:15:27.525 128-bit Host Identifier: Supported 00:15:27.525 Non-Operational Permissive Mode: Not Supported 00:15:27.525 NVM Sets: Not Supported 00:15:27.525 Read Recovery Levels: Not Supported 00:15:27.525 Endurance Groups: Not Supported 00:15:27.525 Predictable Latency Mode: Not Supported 00:15:27.525 Traffic Based Keep ALive: Not Supported 00:15:27.525 Namespace Granularity: Not Supported 00:15:27.525 SQ Associations: Not Supported 00:15:27.525 UUID List: Not Supported 00:15:27.525 Multi-Domain Subsystem: Not Supported 00:15:27.525 Fixed Capacity Management: Not Supported 00:15:27.525 Variable Capacity Management: Not Supported 00:15:27.525 Delete Endurance Group: Not Supported 00:15:27.525 Delete NVM Set: Not Supported 00:15:27.525 Extended LBA Formats Supported: Not Supported 00:15:27.525 Flexible Data Placement Supported: Not Supported 00:15:27.525 00:15:27.525 Controller Memory Buffer Support 00:15:27.525 ================================ 00:15:27.525 Supported: No 00:15:27.525 00:15:27.525 Persistent Memory Region Support 00:15:27.525 ================================ 00:15:27.525 Supported: No 00:15:27.525 00:15:27.525 Admin Command Set Attributes 00:15:27.525 ============================ 00:15:27.525 Security Send/Receive: Not Supported 00:15:27.525 Format NVM: Not Supported 00:15:27.525 Firmware Activate/Download: Not Supported 00:15:27.525 Namespace Management: Not Supported 00:15:27.525 Device Self-Test: Not Supported 00:15:27.525 Directives: Not Supported 00:15:27.525 NVMe-MI: Not Supported 00:15:27.525 Virtualization Management: Not Supported 00:15:27.525 Doorbell Buffer Config: Not Supported 00:15:27.525 Get LBA Status Capability: Not Supported 00:15:27.525 Command & Feature Lockdown Capability: Not Supported 00:15:27.525 Abort Command Limit: 4 00:15:27.525 Async Event Request Limit: 4 00:15:27.525 Number of Firmware Slots: N/A 00:15:27.525 Firmware Slot 1 Read-Only: N/A 00:15:27.525 Firmware Activation Without Reset: N/A 00:15:27.525 Multiple Update Detection Support: N/A 00:15:27.525 Firmware Update Granularity: No Information Provided 00:15:27.525 Per-Namespace SMART Log: No 00:15:27.525 Asymmetric Namespace Access Log Page: Not Supported 00:15:27.525 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:27.525 Command Effects Log Page: Supported 00:15:27.525 Get Log Page Extended Data: Supported 00:15:27.525 Telemetry Log Pages: Not Supported 00:15:27.525 Persistent Event Log Pages: Not Supported 00:15:27.525 Supported Log Pages Log Page: May Support 00:15:27.525 Commands Supported & Effects Log Page: Not Supported 00:15:27.525 Feature Identifiers & Effects Log Page:May Support 00:15:27.525 NVMe-MI Commands & Effects Log Page: May Support 00:15:27.525 Data Area 4 for Telemetry Log: Not Supported 00:15:27.525 Error Log Page Entries Supported: 128 00:15:27.525 Keep Alive: Supported 00:15:27.525 Keep Alive Granularity: 10000 ms 00:15:27.525 00:15:27.525 NVM Command Set Attributes 00:15:27.525 ========================== 00:15:27.525 Submission Queue Entry Size 00:15:27.525 Max: 64 00:15:27.525 Min: 64 00:15:27.525 Completion Queue Entry Size 00:15:27.525 Max: 16 00:15:27.525 Min: 16 00:15:27.525 Number of Namespaces: 32 00:15:27.525 Compare Command: Supported 00:15:27.525 Write Uncorrectable Command: Not Supported 00:15:27.525 Dataset Management Command: Supported 00:15:27.525 Write Zeroes Command: Supported 00:15:27.526 Set Features Save Field: Not Supported 00:15:27.526 Reservations: Not Supported 00:15:27.526 Timestamp: Not Supported 00:15:27.526 Copy: Supported 00:15:27.526 Volatile Write Cache: Present 00:15:27.526 Atomic Write Unit (Normal): 1 00:15:27.526 Atomic Write Unit (PFail): 1 00:15:27.526 Atomic Compare & Write Unit: 1 00:15:27.526 Fused Compare & Write: Supported 00:15:27.526 Scatter-Gather List 00:15:27.526 SGL Command Set: Supported (Dword aligned) 00:15:27.526 SGL Keyed: Not Supported 00:15:27.526 SGL Bit Bucket Descriptor: Not Supported 00:15:27.526 SGL Metadata Pointer: Not Supported 00:15:27.526 Oversized SGL: Not Supported 00:15:27.526 SGL Metadata Address: Not Supported 00:15:27.526 SGL Offset: Not Supported 00:15:27.526 Transport SGL Data Block: Not Supported 00:15:27.526 Replay Protected Memory Block: Not Supported 00:15:27.526 00:15:27.526 Firmware Slot Information 00:15:27.526 ========================= 00:15:27.526 Active slot: 1 00:15:27.526 Slot 1 Firmware Revision: 24.01.1 00:15:27.526 00:15:27.526 00:15:27.526 Commands Supported and Effects 00:15:27.526 ============================== 00:15:27.526 Admin Commands 00:15:27.526 -------------- 00:15:27.526 Get Log Page (02h): Supported 00:15:27.526 Identify (06h): Supported 00:15:27.526 Abort (08h): Supported 00:15:27.526 Set Features (09h): Supported 00:15:27.526 Get Features (0Ah): Supported 00:15:27.526 Asynchronous Event Request (0Ch): Supported 00:15:27.526 Keep Alive (18h): Supported 00:15:27.526 I/O Commands 00:15:27.526 ------------ 00:15:27.526 Flush (00h): Supported LBA-Change 00:15:27.526 Write (01h): Supported LBA-Change 00:15:27.526 Read (02h): Supported 00:15:27.526 Compare (05h): Supported 00:15:27.526 Write Zeroes (08h): Supported LBA-Change 00:15:27.526 Dataset Management (09h): Supported LBA-Change 00:15:27.526 Copy (19h): Supported LBA-Change 00:15:27.526 Unknown (79h): Supported LBA-Change 00:15:27.526 Unknown (7Ah): Supported 00:15:27.526 00:15:27.526 Error Log 00:15:27.526 ========= 00:15:27.526 00:15:27.526 Arbitration 00:15:27.526 =========== 00:15:27.526 Arbitration Burst: 1 00:15:27.526 00:15:27.526 Power Management 00:15:27.526 ================ 00:15:27.526 Number of Power States: 1 00:15:27.526 Current Power State: Power State #0 00:15:27.526 Power State #0: 00:15:27.526 Max Power: 0.00 W 00:15:27.526 Non-Operational State: Operational 00:15:27.526 Entry Latency: Not Reported 00:15:27.526 Exit Latency: Not Reported 00:15:27.526 Relative Read Throughput: 0 00:15:27.526 Relative Read Latency: 0 00:15:27.526 Relative Write Throughput: 0 00:15:27.526 Relative Write Latency: 0 00:15:27.526 Idle Power: Not Reported 00:15:27.526 Active Power: Not Reported 00:15:27.526 Non-Operational Permissive Mode: Not Supported 00:15:27.526 00:15:27.526 Health Information 00:15:27.526 ================== 00:15:27.526 Critical Warnings: 00:15:27.526 Available Spare Space: OK 00:15:27.526 Temperature: OK 00:15:27.526 Device Reliability: OK 00:15:27.526 Read Only: No 00:15:27.526 Volatile Memory Backup: OK 00:15:27.526 Current Temperature: 0 Kelvin[2024-11-18 01:58:01.812507] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:27.526 [2024-11-18 01:58:01.820326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:27.526 [2024-11-18 01:58:01.820370] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:27.526 [2024-11-18 01:58:01.820388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:27.526 [2024-11-18 01:58:01.820399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:27.526 [2024-11-18 01:58:01.820414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:27.526 [2024-11-18 01:58:01.820425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:27.526 [2024-11-18 01:58:01.820510] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:27.526 [2024-11-18 01:58:01.820531] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:27.526 [2024-11-18 01:58:01.821558] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:27.526 [2024-11-18 01:58:01.821574] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:27.526 [2024-11-18 01:58:01.822525] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:27.526 [2024-11-18 01:58:01.822548] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:27.526 [2024-11-18 01:58:01.822599] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:27.526 [2024-11-18 01:58:01.823817] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:27.526 (-273 Celsius) 00:15:27.526 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:27.526 Available Spare: 0% 00:15:27.526 Available Spare Threshold: 0% 00:15:27.526 Life Percentage Used: 0% 00:15:27.526 Data Units Read: 0 00:15:27.526 Data Units Written: 0 00:15:27.526 Host Read Commands: 0 00:15:27.526 Host Write Commands: 0 00:15:27.526 Controller Busy Time: 0 minutes 00:15:27.526 Power Cycles: 0 00:15:27.526 Power On Hours: 0 hours 00:15:27.526 Unsafe Shutdowns: 0 00:15:27.526 Unrecoverable Media Errors: 0 00:15:27.526 Lifetime Error Log Entries: 0 00:15:27.526 Warning Temperature Time: 0 minutes 00:15:27.526 Critical Temperature Time: 0 minutes 00:15:27.526 00:15:27.526 Number of Queues 00:15:27.526 ================ 00:15:27.526 Number of I/O Submission Queues: 127 00:15:27.526 Number of I/O Completion Queues: 127 00:15:27.526 00:15:27.526 Active Namespaces 00:15:27.526 ================= 00:15:27.526 Namespace ID:1 00:15:27.526 Error Recovery Timeout: Unlimited 00:15:27.526 Command Set Identifier: NVM (00h) 00:15:27.526 Deallocate: Supported 00:15:27.526 Deallocated/Unwritten Error: Not Supported 00:15:27.526 Deallocated Read Value: Unknown 00:15:27.526 Deallocate in Write Zeroes: Not Supported 00:15:27.526 Deallocated Guard Field: 0xFFFF 00:15:27.526 Flush: Supported 00:15:27.526 Reservation: Supported 00:15:27.526 Namespace Sharing Capabilities: Multiple Controllers 00:15:27.526 Size (in LBAs): 131072 (0GiB) 00:15:27.526 Capacity (in LBAs): 131072 (0GiB) 00:15:27.526 Utilization (in LBAs): 131072 (0GiB) 00:15:27.526 NGUID: 1DAE196DA235444F81A7FC42C9B3BB17 00:15:27.526 UUID: 1dae196d-a235-444f-81a7-fc42c9b3bb17 00:15:27.526 Thin Provisioning: Not Supported 00:15:27.526 Per-NS Atomic Units: Yes 00:15:27.526 Atomic Boundary Size (Normal): 0 00:15:27.526 Atomic Boundary Size (PFail): 0 00:15:27.526 Atomic Boundary Offset: 0 00:15:27.526 Maximum Single Source Range Length: 65535 00:15:27.526 Maximum Copy Length: 65535 00:15:27.526 Maximum Source Range Count: 1 00:15:27.526 NGUID/EUI64 Never Reused: No 00:15:27.526 Namespace Write Protected: No 00:15:27.526 Number of LBA Formats: 1 00:15:27.526 Current LBA Format: LBA Format #00 00:15:27.526 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:27.526 00:15:27.526 01:58:01 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:27.526 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.088 Initializing NVMe Controllers 00:15:34.088 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:34.088 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:34.088 Initialization complete. Launching workers. 00:15:34.088 ======================================================== 00:15:34.088 Latency(us) 00:15:34.088 Device Information : IOPS MiB/s Average min max 00:15:34.088 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 37833.09 147.79 3382.79 1120.08 7402.24 00:15:34.088 ======================================================== 00:15:34.088 Total : 37833.09 147.79 3382.79 1120.08 7402.24 00:15:34.088 00:15:34.088 01:58:07 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:34.088 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.271 Initializing NVMe Controllers 00:15:38.271 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:38.271 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:38.271 Initialization complete. Launching workers. 00:15:38.271 ======================================================== 00:15:38.271 Latency(us) 00:15:38.271 Device Information : IOPS MiB/s Average min max 00:15:38.271 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36179.22 141.33 3537.15 1135.12 8547.99 00:15:38.271 ======================================================== 00:15:38.271 Total : 36179.22 141.33 3537.15 1135.12 8547.99 00:15:38.271 00:15:38.271 01:58:12 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:38.271 EAL: No free 2048 kB hugepages reported on node 1 00:15:43.536 Initializing NVMe Controllers 00:15:43.536 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:43.536 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:43.536 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:15:43.536 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:15:43.536 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:15:43.536 Initialization complete. Launching workers. 00:15:43.536 Starting thread on core 2 00:15:43.536 Starting thread on core 3 00:15:43.536 Starting thread on core 1 00:15:43.536 01:58:17 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:15:43.536 EAL: No free 2048 kB hugepages reported on node 1 00:15:46.824 Initializing NVMe Controllers 00:15:46.824 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:46.824 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:46.824 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:15:46.824 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:15:46.824 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:15:46.824 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:15:46.824 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:46.824 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:46.824 Initialization complete. Launching workers. 00:15:46.824 Starting thread on core 1 with urgent priority queue 00:15:46.824 Starting thread on core 2 with urgent priority queue 00:15:46.824 Starting thread on core 3 with urgent priority queue 00:15:46.824 Starting thread on core 0 with urgent priority queue 00:15:46.824 SPDK bdev Controller (SPDK2 ) core 0: 4755.67 IO/s 21.03 secs/100000 ios 00:15:46.824 SPDK bdev Controller (SPDK2 ) core 1: 4717.67 IO/s 21.20 secs/100000 ios 00:15:46.824 SPDK bdev Controller (SPDK2 ) core 2: 5105.67 IO/s 19.59 secs/100000 ios 00:15:46.824 SPDK bdev Controller (SPDK2 ) core 3: 4626.33 IO/s 21.62 secs/100000 ios 00:15:46.824 ======================================================== 00:15:46.824 00:15:46.824 01:58:21 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:46.824 EAL: No free 2048 kB hugepages reported on node 1 00:15:47.081 Initializing NVMe Controllers 00:15:47.081 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:47.081 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:47.081 Namespace ID: 1 size: 0GB 00:15:47.081 Initialization complete. 00:15:47.081 INFO: using host memory buffer for IO 00:15:47.081 Hello world! 00:15:47.081 01:58:21 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:47.338 EAL: No free 2048 kB hugepages reported on node 1 00:15:48.707 Initializing NVMe Controllers 00:15:48.707 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:48.707 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:48.707 Initialization complete. Launching workers. 00:15:48.707 submit (in ns) avg, min, max = 8060.3, 3442.2, 4016065.6 00:15:48.707 complete (in ns) avg, min, max = 25011.1, 2044.4, 4134914.4 00:15:48.707 00:15:48.707 Submit histogram 00:15:48.707 ================ 00:15:48.707 Range in us Cumulative Count 00:15:48.707 3.437 - 3.461: 0.3330% ( 45) 00:15:48.707 3.461 - 3.484: 0.9767% ( 87) 00:15:48.707 3.484 - 3.508: 3.1817% ( 298) 00:15:48.707 3.508 - 3.532: 7.4436% ( 576) 00:15:48.707 3.532 - 3.556: 14.5246% ( 957) 00:15:48.707 3.556 - 3.579: 22.2863% ( 1049) 00:15:48.707 3.579 - 3.603: 30.2331% ( 1074) 00:15:48.707 3.603 - 3.627: 37.2475% ( 948) 00:15:48.707 3.627 - 3.650: 45.3792% ( 1099) 00:15:48.707 3.650 - 3.674: 51.3873% ( 812) 00:15:48.707 3.674 - 3.698: 56.5372% ( 696) 00:15:48.707 3.698 - 3.721: 60.6363% ( 554) 00:15:48.707 3.721 - 3.745: 63.5220% ( 390) 00:15:48.707 3.745 - 3.769: 67.6730% ( 561) 00:15:48.707 3.769 - 3.793: 71.8313% ( 562) 00:15:48.707 3.793 - 3.816: 75.7455% ( 529) 00:15:48.707 3.816 - 3.840: 79.3193% ( 483) 00:15:48.707 3.840 - 3.864: 82.5897% ( 442) 00:15:48.707 3.864 - 3.887: 85.3644% ( 375) 00:15:48.707 3.887 - 3.911: 87.3326% ( 266) 00:15:48.707 3.911 - 3.935: 89.2712% ( 262) 00:15:48.707 3.935 - 3.959: 90.4772% ( 163) 00:15:48.707 3.959 - 3.982: 91.4465% ( 131) 00:15:48.707 3.982 - 4.006: 92.5268% ( 146) 00:15:48.707 4.006 - 4.030: 93.4591% ( 126) 00:15:48.707 4.030 - 4.053: 94.2286% ( 104) 00:15:48.707 4.053 - 4.077: 95.0129% ( 106) 00:15:48.707 4.077 - 4.101: 95.4347% ( 57) 00:15:48.707 4.101 - 4.124: 95.8195% ( 52) 00:15:48.707 4.124 - 4.148: 96.0636% ( 33) 00:15:48.707 4.148 - 4.172: 96.2412% ( 24) 00:15:48.707 4.172 - 4.196: 96.4336% ( 26) 00:15:48.707 4.196 - 4.219: 96.5668% ( 18) 00:15:48.707 4.219 - 4.243: 96.7148% ( 20) 00:15:48.707 4.243 - 4.267: 96.8331% ( 16) 00:15:48.708 4.267 - 4.290: 96.9219% ( 12) 00:15:48.708 4.290 - 4.314: 96.9811% ( 8) 00:15:48.708 4.314 - 4.338: 97.0255% ( 6) 00:15:48.708 4.338 - 4.361: 97.0921% ( 9) 00:15:48.708 4.361 - 4.385: 97.1143% ( 3) 00:15:48.708 4.385 - 4.409: 97.1439% ( 4) 00:15:48.708 4.409 - 4.433: 97.1513% ( 1) 00:15:48.708 4.480 - 4.504: 97.1735% ( 3) 00:15:48.708 4.504 - 4.527: 97.1883% ( 2) 00:15:48.708 4.527 - 4.551: 97.2031% ( 2) 00:15:48.708 4.575 - 4.599: 97.2105% ( 1) 00:15:48.708 4.599 - 4.622: 97.2179% ( 1) 00:15:48.708 4.646 - 4.670: 97.2401% ( 3) 00:15:48.708 4.670 - 4.693: 97.2623% ( 3) 00:15:48.708 4.693 - 4.717: 97.2919% ( 4) 00:15:48.708 4.717 - 4.741: 97.3363% ( 6) 00:15:48.708 4.741 - 4.764: 97.3733% ( 5) 00:15:48.708 4.764 - 4.788: 97.4473% ( 10) 00:15:48.708 4.788 - 4.812: 97.5287% ( 11) 00:15:48.708 4.812 - 4.836: 97.5731% ( 6) 00:15:48.708 4.836 - 4.859: 97.6101% ( 5) 00:15:48.708 4.859 - 4.883: 97.6545% ( 6) 00:15:48.708 4.883 - 4.907: 97.6915% ( 5) 00:15:48.708 4.907 - 4.930: 97.7284% ( 5) 00:15:48.708 4.930 - 4.954: 97.7654% ( 5) 00:15:48.708 4.954 - 4.978: 97.8098% ( 6) 00:15:48.708 4.978 - 5.001: 97.8394% ( 4) 00:15:48.708 5.001 - 5.025: 97.8542% ( 2) 00:15:48.708 5.025 - 5.049: 97.8838% ( 4) 00:15:48.708 5.049 - 5.073: 97.9060% ( 3) 00:15:48.708 5.073 - 5.096: 97.9356% ( 4) 00:15:48.708 5.096 - 5.120: 97.9430% ( 1) 00:15:48.708 5.120 - 5.144: 97.9726% ( 4) 00:15:48.708 5.144 - 5.167: 97.9800% ( 1) 00:15:48.708 5.167 - 5.191: 98.0022% ( 3) 00:15:48.708 5.239 - 5.262: 98.0096% ( 1) 00:15:48.708 5.262 - 5.286: 98.0170% ( 1) 00:15:48.708 5.404 - 5.428: 98.0244% ( 1) 00:15:48.708 5.452 - 5.476: 98.0318% ( 1) 00:15:48.708 5.499 - 5.523: 98.0466% ( 2) 00:15:48.708 5.570 - 5.594: 98.0614% ( 2) 00:15:48.708 5.641 - 5.665: 98.0688% ( 1) 00:15:48.708 5.713 - 5.736: 98.0762% ( 1) 00:15:48.708 6.044 - 6.068: 98.0910% ( 2) 00:15:48.708 6.400 - 6.447: 98.0984% ( 1) 00:15:48.708 6.447 - 6.495: 98.1058% ( 1) 00:15:48.708 6.542 - 6.590: 98.1132% ( 1) 00:15:48.708 6.637 - 6.684: 98.1206% ( 1) 00:15:48.708 6.921 - 6.969: 98.1280% ( 1) 00:15:48.708 6.969 - 7.016: 98.1428% ( 2) 00:15:48.708 7.016 - 7.064: 98.1502% ( 1) 00:15:48.708 7.301 - 7.348: 98.1576% ( 1) 00:15:48.708 7.348 - 7.396: 98.1650% ( 1) 00:15:48.708 7.396 - 7.443: 98.1724% ( 1) 00:15:48.708 7.443 - 7.490: 98.1872% ( 2) 00:15:48.708 7.490 - 7.538: 98.1946% ( 1) 00:15:48.708 7.585 - 7.633: 98.2020% ( 1) 00:15:48.708 7.727 - 7.775: 98.2168% ( 2) 00:15:48.708 7.775 - 7.822: 98.2242% ( 1) 00:15:48.708 7.822 - 7.870: 98.2316% ( 1) 00:15:48.708 7.870 - 7.917: 98.2464% ( 2) 00:15:48.708 7.964 - 8.012: 98.2612% ( 2) 00:15:48.708 8.107 - 8.154: 98.2686% ( 1) 00:15:48.708 8.201 - 8.249: 98.2834% ( 2) 00:15:48.708 8.249 - 8.296: 98.2982% ( 2) 00:15:48.708 8.296 - 8.344: 98.3056% ( 1) 00:15:48.708 8.344 - 8.391: 98.3130% ( 1) 00:15:48.708 8.391 - 8.439: 98.3204% ( 1) 00:15:48.708 8.439 - 8.486: 98.3426% ( 3) 00:15:48.708 8.486 - 8.533: 98.3648% ( 3) 00:15:48.708 8.533 - 8.581: 98.3722% ( 1) 00:15:48.708 8.581 - 8.628: 98.3796% ( 1) 00:15:48.708 8.676 - 8.723: 98.3870% ( 1) 00:15:48.708 8.770 - 8.818: 98.3944% ( 1) 00:15:48.708 8.818 - 8.865: 98.4092% ( 2) 00:15:48.708 8.960 - 9.007: 98.4240% ( 2) 00:15:48.708 9.055 - 9.102: 98.4388% ( 2) 00:15:48.708 9.197 - 9.244: 98.4536% ( 2) 00:15:48.708 9.244 - 9.292: 98.4610% ( 1) 00:15:48.708 9.292 - 9.339: 98.4832% ( 3) 00:15:48.708 9.339 - 9.387: 98.4906% ( 1) 00:15:48.708 9.387 - 9.434: 98.4980% ( 1) 00:15:48.708 9.481 - 9.529: 98.5128% ( 2) 00:15:48.708 9.529 - 9.576: 98.5424% ( 4) 00:15:48.708 9.576 - 9.624: 98.5572% ( 2) 00:15:48.708 9.624 - 9.671: 98.5646% ( 1) 00:15:48.708 9.813 - 9.861: 98.5794% ( 2) 00:15:48.708 9.956 - 10.003: 98.5868% ( 1) 00:15:48.708 10.050 - 10.098: 98.5942% ( 1) 00:15:48.708 10.193 - 10.240: 98.6016% ( 1) 00:15:48.708 10.335 - 10.382: 98.6090% ( 1) 00:15:48.708 10.477 - 10.524: 98.6164% ( 1) 00:15:48.708 10.524 - 10.572: 98.6238% ( 1) 00:15:48.708 10.619 - 10.667: 98.6385% ( 2) 00:15:48.708 10.667 - 10.714: 98.6459% ( 1) 00:15:48.708 10.714 - 10.761: 98.6533% ( 1) 00:15:48.708 10.761 - 10.809: 98.6607% ( 1) 00:15:48.708 10.951 - 10.999: 98.6681% ( 1) 00:15:48.708 10.999 - 11.046: 98.6755% ( 1) 00:15:48.708 11.093 - 11.141: 98.6829% ( 1) 00:15:48.708 11.236 - 11.283: 98.6903% ( 1) 00:15:48.708 11.330 - 11.378: 98.6977% ( 1) 00:15:48.708 11.378 - 11.425: 98.7051% ( 1) 00:15:48.708 11.425 - 11.473: 98.7125% ( 1) 00:15:48.708 11.662 - 11.710: 98.7199% ( 1) 00:15:48.708 11.899 - 11.947: 98.7273% ( 1) 00:15:48.708 11.947 - 11.994: 98.7347% ( 1) 00:15:48.708 12.136 - 12.231: 98.7421% ( 1) 00:15:48.708 12.326 - 12.421: 98.7495% ( 1) 00:15:48.708 12.421 - 12.516: 98.7717% ( 3) 00:15:48.708 12.516 - 12.610: 98.7791% ( 1) 00:15:48.708 12.610 - 12.705: 98.7939% ( 2) 00:15:48.708 12.895 - 12.990: 98.8013% ( 1) 00:15:48.708 12.990 - 13.084: 98.8161% ( 2) 00:15:48.708 13.179 - 13.274: 98.8235% ( 1) 00:15:48.708 13.464 - 13.559: 98.8309% ( 1) 00:15:48.708 13.653 - 13.748: 98.8383% ( 1) 00:15:48.708 13.748 - 13.843: 98.8457% ( 1) 00:15:48.708 14.127 - 14.222: 98.8605% ( 2) 00:15:48.708 14.222 - 14.317: 98.8753% ( 2) 00:15:48.708 14.317 - 14.412: 98.8901% ( 2) 00:15:48.708 14.507 - 14.601: 98.8975% ( 1) 00:15:48.708 14.696 - 14.791: 98.9049% ( 1) 00:15:48.708 14.886 - 14.981: 98.9197% ( 2) 00:15:48.708 15.076 - 15.170: 98.9345% ( 2) 00:15:48.708 15.170 - 15.265: 98.9419% ( 1) 00:15:48.708 16.877 - 16.972: 98.9493% ( 1) 00:15:48.708 17.067 - 17.161: 98.9715% ( 3) 00:15:48.708 17.161 - 17.256: 98.9863% ( 2) 00:15:48.708 17.256 - 17.351: 99.0159% ( 4) 00:15:48.708 17.351 - 17.446: 99.0455% ( 4) 00:15:48.708 17.446 - 17.541: 99.0751% ( 4) 00:15:48.708 17.541 - 17.636: 99.0899% ( 2) 00:15:48.708 17.636 - 17.730: 99.1343% ( 6) 00:15:48.708 17.730 - 17.825: 99.1861% ( 7) 00:15:48.708 17.825 - 17.920: 99.2231% ( 5) 00:15:48.708 17.920 - 18.015: 99.2897% ( 9) 00:15:48.708 18.015 - 18.110: 99.3711% ( 11) 00:15:48.708 18.110 - 18.204: 99.4451% ( 10) 00:15:48.708 18.204 - 18.299: 99.4747% ( 4) 00:15:48.708 18.299 - 18.394: 99.5117% ( 5) 00:15:48.708 18.394 - 18.489: 99.5708% ( 8) 00:15:48.708 18.489 - 18.584: 99.6152% ( 6) 00:15:48.708 18.584 - 18.679: 99.6300% ( 2) 00:15:48.708 18.679 - 18.773: 99.6448% ( 2) 00:15:48.708 18.773 - 18.868: 99.6744% ( 4) 00:15:48.708 18.868 - 18.963: 99.7040% ( 4) 00:15:48.708 18.963 - 19.058: 99.7188% ( 2) 00:15:48.708 19.153 - 19.247: 99.7484% ( 4) 00:15:48.708 19.437 - 19.532: 99.7558% ( 1) 00:15:48.708 19.532 - 19.627: 99.7632% ( 1) 00:15:48.708 19.627 - 19.721: 99.7780% ( 2) 00:15:48.708 20.575 - 20.670: 99.7854% ( 1) 00:15:48.708 21.333 - 21.428: 99.7928% ( 1) 00:15:48.708 21.713 - 21.807: 99.8002% ( 1) 00:15:48.708 22.661 - 22.756: 99.8076% ( 1) 00:15:48.708 22.850 - 22.945: 99.8150% ( 1) 00:15:48.708 23.419 - 23.514: 99.8224% ( 1) 00:15:48.708 24.273 - 24.462: 99.8372% ( 2) 00:15:48.708 24.462 - 24.652: 99.8446% ( 1) 00:15:48.708 25.600 - 25.790: 99.8520% ( 1) 00:15:48.708 27.876 - 28.065: 99.8594% ( 1) 00:15:48.708 29.772 - 29.961: 99.8668% ( 1) 00:15:48.708 30.720 - 30.910: 99.8742% ( 1) 00:15:48.708 32.806 - 32.996: 99.8816% ( 1) 00:15:48.708 33.375 - 33.564: 99.8890% ( 1) 00:15:48.708 34.513 - 34.702: 99.8964% ( 1) 00:15:48.708 3980.705 - 4004.978: 99.9778% ( 11) 00:15:48.708 4004.978 - 4029.250: 100.0000% ( 3) 00:15:48.708 00:15:48.708 Complete histogram 00:15:48.708 ================== 00:15:48.708 Range in us Cumulative Count 00:15:48.708 2.039 - 2.050: 0.5475% ( 74) 00:15:48.708 2.050 - 2.062: 9.7373% ( 1242) 00:15:48.708 2.062 - 2.074: 14.0067% ( 577) 00:15:48.708 2.074 - 2.086: 22.0570% ( 1088) 00:15:48.708 2.086 - 2.098: 49.4192% ( 3698) 00:15:48.708 2.098 - 2.110: 56.9293% ( 1015) 00:15:48.708 2.110 - 2.121: 59.9778% ( 412) 00:15:48.708 2.121 - 2.133: 63.1225% ( 425) 00:15:48.708 2.133 - 2.145: 64.0696% ( 128) 00:15:48.708 2.145 - 2.157: 70.1147% ( 817) 00:15:48.708 2.157 - 2.169: 78.8679% ( 1183) 00:15:48.708 2.169 - 2.181: 81.0655% ( 297) 00:15:48.708 2.181 - 2.193: 83.3666% ( 311) 00:15:48.708 2.193 - 2.204: 85.3570% ( 269) 00:15:48.708 2.204 - 2.216: 86.0821% ( 98) 00:15:48.708 2.216 - 2.228: 89.1676% ( 417) 00:15:48.708 2.228 - 2.240: 92.8672% ( 500) 00:15:48.708 2.240 - 2.252: 93.9845% ( 151) 00:15:48.708 2.252 - 2.264: 94.6356% ( 88) 00:15:48.708 2.264 - 2.276: 95.1239% ( 66) 00:15:48.708 2.276 - 2.287: 95.4125% ( 39) 00:15:48.708 2.287 - 2.299: 95.8343% ( 57) 00:15:48.708 2.299 - 2.311: 95.9526% ( 16) 00:15:48.708 2.311 - 2.323: 95.9822% ( 4) 00:15:48.708 2.323 - 2.335: 96.1598% ( 24) 00:15:48.708 2.335 - 2.347: 96.3078% ( 20) 00:15:48.708 2.347 - 2.359: 96.4928% ( 25) 00:15:48.708 2.359 - 2.370: 96.7666% ( 37) 00:15:48.708 2.370 - 2.382: 97.0477% ( 38) 00:15:48.708 2.382 - 2.394: 97.2993% ( 34) 00:15:48.708 2.394 - 2.406: 97.4917% ( 26) 00:15:48.708 2.406 - 2.418: 97.5953% ( 14) 00:15:48.708 2.418 - 2.430: 97.7802% ( 25) 00:15:48.708 2.430 - 2.441: 97.8912% ( 15) 00:15:48.708 2.441 - 2.453: 97.9948% ( 14) 00:15:48.708 2.453 - 2.465: 98.0540% ( 8) 00:15:48.708 2.465 - 2.477: 98.1354% ( 11) 00:15:48.708 2.477 - 2.489: 98.2390% ( 14) 00:15:48.708 2.489 - 2.501: 98.2982% ( 8) 00:15:48.708 2.501 - 2.513: 98.3352% ( 5) 00:15:48.708 2.513 - 2.524: 98.3796% ( 6) 00:15:48.708 2.524 - 2.536: 98.4092% ( 4) 00:15:48.708 2.536 - 2.548: 98.4314% ( 3) 00:15:48.708 2.548 - 2.560: 98.4462% ( 2) 00:15:48.708 2.572 - 2.584: 98.4536% ( 1) 00:15:48.708 2.584 - 2.596: 98.4610% ( 1) 00:15:48.708 2.596 - 2.607: 98.4684% ( 1) 00:15:48.708 2.619 - 2.631: 98.4758% ( 1) 00:15:48.708 3.247 - 3.271: 98.4832% ( 1) 00:15:48.708 3.342 - 3.366: 98.4906% ( 1) 00:15:48.708 3.390 - 3.413: 98.4980% ( 1) 00:15:48.708 3.413 - 3.437: 98.5054% ( 1) 00:15:48.708 3.437 - 3.461: 98.5424% ( 5) 00:15:48.708 3.461 - 3.484: 98.5498% ( 1) 00:15:48.708 3.484 - 3.508: 98.5646% ( 2) 00:15:48.708 3.508 - 3.532: 98.5720% ( 1) 00:15:48.708 3.532 - 3.556: 98.5942% ( 3) 00:15:48.708 3.627 - 3.650: 98.6090% ( 2) 00:15:48.708 3.650 - 3.674: 98.6238% ( 2) 00:15:48.708 3.674 - 3.698: 98.6385% ( 2) 00:15:48.708 3.698 - 3.721: 98.6533% ( 2) 00:15:48.708 3.745 - 3.769: 98.6607% ( 1) 00:15:48.708 3.793 - 3.816: 98.6755% ( 2) 00:15:48.708 3.816 - 3.840: 98.6829% ( 1) 00:15:48.708 3.840 - 3.864: 98.6977% ( 2) 00:15:48.708 3.935 - 3.959: 98.7051% ( 1) 00:15:48.708 5.665 - 5.689: 98.7125% ( 1) 00:15:48.708 5.784 - 5.807: 98.7199% ( 1) 00:15:48.708 5.997 - 6.021: 98.7273% ( 1) 00:15:48.708 6.021 - 6.044: 98.7421% ( 2) 00:15:48.708 6.305 - 6.353: 98.7495% ( 1) 00:15:48.708 6.400 - 6.447: 98.7569% ( 1) 00:15:48.708 6.637 - 6.684: 98.7717% ( 2) 00:15:48.708 6.684 - 6.732: 98.7791% ( 1) 00:15:48.708 6.732 - 6.779: 98.7865% ( 1) 00:15:48.708 6.827 - 6.874: 98.7939% ( 1) 00:15:48.708 6.969 - 7.016: 98.8013% ( 1) 00:15:48.708 7.064 - 7.111: 98.8087% ( 1) 00:15:48.708 7.111 - 7.159: 98.8161% ( 1) 00:15:48.708 7.301 - 7.348: 98.8235% ( 1) 00:15:48.708 7.538 - 7.585: 98.8309% ( 1) 00:15:48.708 7.680 - 7.727: 98.8383% ( 1) 00:15:48.708 8.107 - 8.154: 98.8457% ( 1) 00:15:48.708 8.344 - 8.391: 98.8531% ( 1) 00:15:48.708 9.007 - 9.055: 98.8605% ( 1) 00:15:48.708 10.193 - 10.240: 98.8679% ( 1) 00:15:48.708 13.559 - 13.653: 98.8753% ( 1) 00:15:48.708 15.455 - 15.550: 98.8901% ( 2) 00:15:48.708 15.739 - 15.834: 98.9123% ( 3) 00:15:48.708 15.834 - 15.929: 98.9419% ( 4) 00:15:48.708 15.929 - 16.024: 98.9715% ( 4) 00:15:48.708 16.024 - 16.119: 99.0011% ( 4) 00:15:48.708 16.119 - 16.213: 99.0529% ( 7) 00:15:48.708 16.213 - 16.308: 99.0825% ( 4) 00:15:48.708 16.308 - 16.403: 99.1195% ( 5) 00:15:48.708 16.403 - 16.498: 99.1491% ( 4) 00:15:48.708 16.498 - 16.593: 99.1935% ( 6) 00:15:48.708 16.593 - 16.687: 99.2231% ( 4) 00:15:48.708 16.687 - 16.782: 99.2601% ( 5) 00:15:48.708 16.782 - 16.877: 99.2823% ( 3) 00:15:48.708 16.877 - 16.972: 99.3415% ( 8) 00:15:48.708 16.972 - 17.067: 99.3563% ( 2) 00:15:48.708 17.161 - 17.256: 99.3711% ( 2) 00:15:48.708 17.256 - 17.351: 99.3859% ( 2) 00:15:48.708 17.541 - 17.636: 99.3933% ( 1) 00:15:48.708 17.636 - 17.730: 99.4007% ( 1) 00:15:48.708 17.825 - 17.920: 99.4081% ( 1) 00:15:48.708 18.015 - 18.110: 99.4155% ( 1) 00:15:48.708 18.204 - 18.299: 99.4229% ( 1) 00:15:48.708 24.652 - 24.841: 99.4303% ( 1) 00:15:48.708 3883.615 - 3907.887: 99.4377% ( 1) 00:15:48.708 3980.705 - 4004.978: 99.9334% ( 67) 00:15:48.708 4004.978 - 4029.250: 99.9926% ( 8) 00:15:48.708 4126.341 - 4150.613: 100.0000% ( 1) 00:15:48.708 00:15:48.708 01:58:22 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:15:48.708 01:58:22 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:48.708 01:58:22 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:15:48.708 01:58:22 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:15:48.708 01:58:22 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:48.966 [ 00:15:48.966 { 00:15:48.966 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:48.966 "subtype": "Discovery", 00:15:48.966 "listen_addresses": [], 00:15:48.966 "allow_any_host": true, 00:15:48.966 "hosts": [] 00:15:48.966 }, 00:15:48.966 { 00:15:48.966 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:48.966 "subtype": "NVMe", 00:15:48.966 "listen_addresses": [ 00:15:48.966 { 00:15:48.966 "transport": "VFIOUSER", 00:15:48.966 "trtype": "VFIOUSER", 00:15:48.966 "adrfam": "IPv4", 00:15:48.966 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:48.966 "trsvcid": "0" 00:15:48.966 } 00:15:48.966 ], 00:15:48.966 "allow_any_host": true, 00:15:48.966 "hosts": [], 00:15:48.966 "serial_number": "SPDK1", 00:15:48.966 "model_number": "SPDK bdev Controller", 00:15:48.966 "max_namespaces": 32, 00:15:48.966 "min_cntlid": 1, 00:15:48.966 "max_cntlid": 65519, 00:15:48.966 "namespaces": [ 00:15:48.966 { 00:15:48.966 "nsid": 1, 00:15:48.966 "bdev_name": "Malloc1", 00:15:48.966 "name": "Malloc1", 00:15:48.966 "nguid": "19E2F8149775449DB9B1B90339E2AC7F", 00:15:48.966 "uuid": "19e2f814-9775-449d-b9b1-b90339e2ac7f" 00:15:48.966 }, 00:15:48.966 { 00:15:48.966 "nsid": 2, 00:15:48.966 "bdev_name": "Malloc3", 00:15:48.966 "name": "Malloc3", 00:15:48.966 "nguid": "E06F66D11C3E4A81B48442DED06FFE0D", 00:15:48.966 "uuid": "e06f66d1-1c3e-4a81-b484-42ded06ffe0d" 00:15:48.966 } 00:15:48.966 ] 00:15:48.966 }, 00:15:48.966 { 00:15:48.966 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:48.966 "subtype": "NVMe", 00:15:48.966 "listen_addresses": [ 00:15:48.966 { 00:15:48.966 "transport": "VFIOUSER", 00:15:48.966 "trtype": "VFIOUSER", 00:15:48.966 "adrfam": "IPv4", 00:15:48.966 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:48.966 "trsvcid": "0" 00:15:48.966 } 00:15:48.966 ], 00:15:48.966 "allow_any_host": true, 00:15:48.966 "hosts": [], 00:15:48.966 "serial_number": "SPDK2", 00:15:48.966 "model_number": "SPDK bdev Controller", 00:15:48.966 "max_namespaces": 32, 00:15:48.966 "min_cntlid": 1, 00:15:48.966 "max_cntlid": 65519, 00:15:48.966 "namespaces": [ 00:15:48.966 { 00:15:48.966 "nsid": 1, 00:15:48.966 "bdev_name": "Malloc2", 00:15:48.966 "name": "Malloc2", 00:15:48.966 "nguid": "1DAE196DA235444F81A7FC42C9B3BB17", 00:15:48.966 "uuid": "1dae196d-a235-444f-81a7-fc42c9b3bb17" 00:15:48.966 } 00:15:48.966 ] 00:15:48.966 } 00:15:48.966 ] 00:15:48.966 01:58:23 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:48.966 01:58:23 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1182981 00:15:48.966 01:58:23 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:15:48.966 01:58:23 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:48.966 01:58:23 -- common/autotest_common.sh@1254 -- # local i=0 00:15:48.966 01:58:23 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:48.966 01:58:23 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:48.966 01:58:23 -- common/autotest_common.sh@1265 -- # return 0 00:15:48.966 01:58:23 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:48.966 01:58:23 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:15:48.966 EAL: No free 2048 kB hugepages reported on node 1 00:15:49.223 Malloc4 00:15:49.223 01:58:23 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:15:49.480 01:58:23 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:49.480 Asynchronous Event Request test 00:15:49.480 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:49.480 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:49.480 Registering asynchronous event callbacks... 00:15:49.481 Starting namespace attribute notice tests for all controllers... 00:15:49.481 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:49.481 aer_cb - Changed Namespace 00:15:49.481 Cleaning up... 00:15:49.738 [ 00:15:49.738 { 00:15:49.738 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:49.738 "subtype": "Discovery", 00:15:49.738 "listen_addresses": [], 00:15:49.738 "allow_any_host": true, 00:15:49.738 "hosts": [] 00:15:49.738 }, 00:15:49.738 { 00:15:49.738 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:49.738 "subtype": "NVMe", 00:15:49.738 "listen_addresses": [ 00:15:49.738 { 00:15:49.738 "transport": "VFIOUSER", 00:15:49.738 "trtype": "VFIOUSER", 00:15:49.738 "adrfam": "IPv4", 00:15:49.738 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:49.738 "trsvcid": "0" 00:15:49.738 } 00:15:49.738 ], 00:15:49.738 "allow_any_host": true, 00:15:49.738 "hosts": [], 00:15:49.738 "serial_number": "SPDK1", 00:15:49.738 "model_number": "SPDK bdev Controller", 00:15:49.738 "max_namespaces": 32, 00:15:49.738 "min_cntlid": 1, 00:15:49.738 "max_cntlid": 65519, 00:15:49.738 "namespaces": [ 00:15:49.738 { 00:15:49.738 "nsid": 1, 00:15:49.738 "bdev_name": "Malloc1", 00:15:49.738 "name": "Malloc1", 00:15:49.738 "nguid": "19E2F8149775449DB9B1B90339E2AC7F", 00:15:49.738 "uuid": "19e2f814-9775-449d-b9b1-b90339e2ac7f" 00:15:49.738 }, 00:15:49.738 { 00:15:49.738 "nsid": 2, 00:15:49.738 "bdev_name": "Malloc3", 00:15:49.738 "name": "Malloc3", 00:15:49.738 "nguid": "E06F66D11C3E4A81B48442DED06FFE0D", 00:15:49.738 "uuid": "e06f66d1-1c3e-4a81-b484-42ded06ffe0d" 00:15:49.738 } 00:15:49.738 ] 00:15:49.738 }, 00:15:49.738 { 00:15:49.738 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:49.738 "subtype": "NVMe", 00:15:49.738 "listen_addresses": [ 00:15:49.738 { 00:15:49.738 "transport": "VFIOUSER", 00:15:49.738 "trtype": "VFIOUSER", 00:15:49.738 "adrfam": "IPv4", 00:15:49.738 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:49.738 "trsvcid": "0" 00:15:49.738 } 00:15:49.738 ], 00:15:49.738 "allow_any_host": true, 00:15:49.738 "hosts": [], 00:15:49.738 "serial_number": "SPDK2", 00:15:49.738 "model_number": "SPDK bdev Controller", 00:15:49.738 "max_namespaces": 32, 00:15:49.738 "min_cntlid": 1, 00:15:49.738 "max_cntlid": 65519, 00:15:49.738 "namespaces": [ 00:15:49.738 { 00:15:49.738 "nsid": 1, 00:15:49.738 "bdev_name": "Malloc2", 00:15:49.738 "name": "Malloc2", 00:15:49.738 "nguid": "1DAE196DA235444F81A7FC42C9B3BB17", 00:15:49.738 "uuid": "1dae196d-a235-444f-81a7-fc42c9b3bb17" 00:15:49.738 }, 00:15:49.738 { 00:15:49.738 "nsid": 2, 00:15:49.738 "bdev_name": "Malloc4", 00:15:49.738 "name": "Malloc4", 00:15:49.738 "nguid": "2D1D60D0F4E54F7B99A1E2BDC67B6001", 00:15:49.738 "uuid": "2d1d60d0-f4e5-4f7b-99a1-e2bdc67b6001" 00:15:49.738 } 00:15:49.738 ] 00:15:49.738 } 00:15:49.738 ] 00:15:49.738 01:58:23 -- target/nvmf_vfio_user.sh@44 -- # wait 1182981 00:15:49.738 01:58:23 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:15:49.738 01:58:23 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1177193 00:15:49.738 01:58:23 -- common/autotest_common.sh@936 -- # '[' -z 1177193 ']' 00:15:49.738 01:58:23 -- common/autotest_common.sh@940 -- # kill -0 1177193 00:15:49.738 01:58:23 -- common/autotest_common.sh@941 -- # uname 00:15:49.738 01:58:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:49.738 01:58:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1177193 00:15:49.738 01:58:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:49.738 01:58:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:49.738 01:58:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1177193' 00:15:49.738 killing process with pid 1177193 00:15:49.738 01:58:23 -- common/autotest_common.sh@955 -- # kill 1177193 00:15:49.738 [2024-11-18 01:58:23.998881] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:15:49.738 01:58:23 -- common/autotest_common.sh@960 -- # wait 1177193 00:15:49.996 01:58:24 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:15:49.996 01:58:24 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:15:49.996 01:58:24 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:15:49.996 01:58:24 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:15:49.996 01:58:24 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:15:49.996 01:58:24 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1183130 00:15:49.997 01:58:24 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:15:49.997 01:58:24 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1183130' 00:15:49.997 Process pid: 1183130 00:15:49.997 01:58:24 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:49.997 01:58:24 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1183130 00:15:49.997 01:58:24 -- common/autotest_common.sh@829 -- # '[' -z 1183130 ']' 00:15:49.997 01:58:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:49.997 01:58:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:49.997 01:58:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:49.997 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:49.997 01:58:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:49.997 01:58:24 -- common/autotest_common.sh@10 -- # set +x 00:15:49.997 [2024-11-18 01:58:24.377052] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:15:49.997 [2024-11-18 01:58:24.378069] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:49.997 [2024-11-18 01:58:24.378139] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:50.255 EAL: No free 2048 kB hugepages reported on node 1 00:15:50.255 [2024-11-18 01:58:24.440253] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:50.255 [2024-11-18 01:58:24.528724] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:50.255 [2024-11-18 01:58:24.528869] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:50.255 [2024-11-18 01:58:24.528888] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:50.255 [2024-11-18 01:58:24.528901] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:50.255 [2024-11-18 01:58:24.528980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:50.255 [2024-11-18 01:58:24.529025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:50.255 [2024-11-18 01:58:24.529028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:50.255 [2024-11-18 01:58:24.529000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:50.255 [2024-11-18 01:58:24.624631] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:15:50.255 [2024-11-18 01:58:24.624893] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:15:50.255 [2024-11-18 01:58:24.625178] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:15:50.255 [2024-11-18 01:58:24.625943] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:15:50.255 [2024-11-18 01:58:24.626058] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:15:51.189 01:58:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:51.189 01:58:25 -- common/autotest_common.sh@862 -- # return 0 00:15:51.189 01:58:25 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:52.122 01:58:26 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:15:52.381 01:58:26 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:52.381 01:58:26 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:52.381 01:58:26 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:52.381 01:58:26 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:52.381 01:58:26 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:52.651 Malloc1 00:15:52.651 01:58:26 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:52.910 01:58:27 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:53.168 01:58:27 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:53.427 01:58:27 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:53.427 01:58:27 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:53.427 01:58:27 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:53.686 Malloc2 00:15:53.686 01:58:28 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:53.947 01:58:28 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:54.205 01:58:28 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:54.463 01:58:28 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:15:54.463 01:58:28 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1183130 00:15:54.463 01:58:28 -- common/autotest_common.sh@936 -- # '[' -z 1183130 ']' 00:15:54.463 01:58:28 -- common/autotest_common.sh@940 -- # kill -0 1183130 00:15:54.463 01:58:28 -- common/autotest_common.sh@941 -- # uname 00:15:54.463 01:58:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:54.463 01:58:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1183130 00:15:54.463 01:58:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:54.463 01:58:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:54.463 01:58:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1183130' 00:15:54.463 killing process with pid 1183130 00:15:54.463 01:58:28 -- common/autotest_common.sh@955 -- # kill 1183130 00:15:54.463 01:58:28 -- common/autotest_common.sh@960 -- # wait 1183130 00:15:54.722 01:58:29 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:15:54.722 01:58:29 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:15:54.722 00:15:54.722 real 0m54.136s 00:15:54.722 user 3m34.066s 00:15:54.722 sys 0m4.456s 00:15:54.722 01:58:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:54.722 01:58:29 -- common/autotest_common.sh@10 -- # set +x 00:15:54.722 ************************************ 00:15:54.722 END TEST nvmf_vfio_user 00:15:54.722 ************************************ 00:15:54.722 01:58:29 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:15:54.722 01:58:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:54.722 01:58:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:54.722 01:58:29 -- common/autotest_common.sh@10 -- # set +x 00:15:54.981 ************************************ 00:15:54.981 START TEST nvmf_vfio_user_nvme_compliance 00:15:54.981 ************************************ 00:15:54.981 01:58:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:15:54.981 * Looking for test storage... 00:15:54.981 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:15:54.981 01:58:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:54.981 01:58:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:54.981 01:58:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:54.981 01:58:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:54.981 01:58:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:54.981 01:58:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:54.981 01:58:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:54.981 01:58:29 -- scripts/common.sh@335 -- # IFS=.-: 00:15:54.981 01:58:29 -- scripts/common.sh@335 -- # read -ra ver1 00:15:54.981 01:58:29 -- scripts/common.sh@336 -- # IFS=.-: 00:15:54.981 01:58:29 -- scripts/common.sh@336 -- # read -ra ver2 00:15:54.981 01:58:29 -- scripts/common.sh@337 -- # local 'op=<' 00:15:54.981 01:58:29 -- scripts/common.sh@339 -- # ver1_l=2 00:15:54.981 01:58:29 -- scripts/common.sh@340 -- # ver2_l=1 00:15:54.981 01:58:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:54.981 01:58:29 -- scripts/common.sh@343 -- # case "$op" in 00:15:54.981 01:58:29 -- scripts/common.sh@344 -- # : 1 00:15:54.981 01:58:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:54.981 01:58:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:54.981 01:58:29 -- scripts/common.sh@364 -- # decimal 1 00:15:54.981 01:58:29 -- scripts/common.sh@352 -- # local d=1 00:15:54.981 01:58:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:54.981 01:58:29 -- scripts/common.sh@354 -- # echo 1 00:15:54.981 01:58:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:54.981 01:58:29 -- scripts/common.sh@365 -- # decimal 2 00:15:54.981 01:58:29 -- scripts/common.sh@352 -- # local d=2 00:15:54.981 01:58:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:54.981 01:58:29 -- scripts/common.sh@354 -- # echo 2 00:15:54.981 01:58:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:54.981 01:58:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:54.981 01:58:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:54.981 01:58:29 -- scripts/common.sh@367 -- # return 0 00:15:54.981 01:58:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:54.981 01:58:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:54.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:54.981 --rc genhtml_branch_coverage=1 00:15:54.981 --rc genhtml_function_coverage=1 00:15:54.981 --rc genhtml_legend=1 00:15:54.981 --rc geninfo_all_blocks=1 00:15:54.981 --rc geninfo_unexecuted_blocks=1 00:15:54.981 00:15:54.981 ' 00:15:54.981 01:58:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:54.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:54.981 --rc genhtml_branch_coverage=1 00:15:54.981 --rc genhtml_function_coverage=1 00:15:54.981 --rc genhtml_legend=1 00:15:54.981 --rc geninfo_all_blocks=1 00:15:54.981 --rc geninfo_unexecuted_blocks=1 00:15:54.981 00:15:54.981 ' 00:15:54.981 01:58:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:54.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:54.981 --rc genhtml_branch_coverage=1 00:15:54.981 --rc genhtml_function_coverage=1 00:15:54.981 --rc genhtml_legend=1 00:15:54.981 --rc geninfo_all_blocks=1 00:15:54.981 --rc geninfo_unexecuted_blocks=1 00:15:54.981 00:15:54.981 ' 00:15:54.981 01:58:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:54.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:54.981 --rc genhtml_branch_coverage=1 00:15:54.981 --rc genhtml_function_coverage=1 00:15:54.981 --rc genhtml_legend=1 00:15:54.981 --rc geninfo_all_blocks=1 00:15:54.981 --rc geninfo_unexecuted_blocks=1 00:15:54.981 00:15:54.981 ' 00:15:54.981 01:58:29 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:54.981 01:58:29 -- nvmf/common.sh@7 -- # uname -s 00:15:54.981 01:58:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:54.981 01:58:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:54.981 01:58:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:54.981 01:58:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:54.981 01:58:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:54.981 01:58:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:54.981 01:58:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:54.981 01:58:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:54.981 01:58:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:54.981 01:58:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:54.981 01:58:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:54.981 01:58:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:54.981 01:58:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:54.981 01:58:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:54.981 01:58:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:54.981 01:58:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:54.981 01:58:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:54.981 01:58:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:54.981 01:58:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:54.981 01:58:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:54.981 01:58:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:54.981 01:58:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:54.981 01:58:29 -- paths/export.sh@5 -- # export PATH 00:15:54.981 01:58:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:54.981 01:58:29 -- nvmf/common.sh@46 -- # : 0 00:15:54.981 01:58:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:54.981 01:58:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:54.981 01:58:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:54.981 01:58:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:54.981 01:58:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:54.981 01:58:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:54.981 01:58:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:54.981 01:58:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:54.981 01:58:29 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:54.981 01:58:29 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:54.981 01:58:29 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:15:54.981 01:58:29 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:15:54.981 01:58:29 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:15:54.981 01:58:29 -- compliance/compliance.sh@20 -- # nvmfpid=1183760 00:15:54.981 01:58:29 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:15:54.981 01:58:29 -- compliance/compliance.sh@21 -- # echo 'Process pid: 1183760' 00:15:54.981 Process pid: 1183760 00:15:54.981 01:58:29 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:54.981 01:58:29 -- compliance/compliance.sh@24 -- # waitforlisten 1183760 00:15:54.981 01:58:29 -- common/autotest_common.sh@829 -- # '[' -z 1183760 ']' 00:15:54.981 01:58:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:54.981 01:58:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:54.981 01:58:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:54.981 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:54.981 01:58:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:54.981 01:58:29 -- common/autotest_common.sh@10 -- # set +x 00:15:54.981 [2024-11-18 01:58:29.326957] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:54.981 [2024-11-18 01:58:29.327047] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:54.981 EAL: No free 2048 kB hugepages reported on node 1 00:15:55.264 [2024-11-18 01:58:29.392058] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:55.264 [2024-11-18 01:58:29.478769] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:55.264 [2024-11-18 01:58:29.478902] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:55.264 [2024-11-18 01:58:29.478919] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:55.264 [2024-11-18 01:58:29.478930] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:55.264 [2024-11-18 01:58:29.478997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:55.264 [2024-11-18 01:58:29.479049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:55.264 [2024-11-18 01:58:29.479052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:56.217 01:58:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:56.217 01:58:30 -- common/autotest_common.sh@862 -- # return 0 00:15:56.217 01:58:30 -- compliance/compliance.sh@26 -- # sleep 1 00:15:57.153 01:58:31 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:15:57.153 01:58:31 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:15:57.153 01:58:31 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:15:57.153 01:58:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.153 01:58:31 -- common/autotest_common.sh@10 -- # set +x 00:15:57.153 01:58:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.153 01:58:31 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:15:57.153 01:58:31 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:15:57.153 01:58:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.153 01:58:31 -- common/autotest_common.sh@10 -- # set +x 00:15:57.153 malloc0 00:15:57.153 01:58:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.153 01:58:31 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:15:57.153 01:58:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.153 01:58:31 -- common/autotest_common.sh@10 -- # set +x 00:15:57.153 01:58:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.153 01:58:31 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:15:57.153 01:58:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.153 01:58:31 -- common/autotest_common.sh@10 -- # set +x 00:15:57.153 01:58:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.153 01:58:31 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:15:57.153 01:58:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.153 01:58:31 -- common/autotest_common.sh@10 -- # set +x 00:15:57.153 01:58:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.153 01:58:31 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:15:57.153 EAL: No free 2048 kB hugepages reported on node 1 00:15:57.153 00:15:57.153 00:15:57.153 CUnit - A unit testing framework for C - Version 2.1-3 00:15:57.153 http://cunit.sourceforge.net/ 00:15:57.153 00:15:57.153 00:15:57.153 Suite: nvme_compliance 00:15:57.412 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-18 01:58:31.573253] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:15:57.412 [2024-11-18 01:58:31.573295] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:15:57.412 [2024-11-18 01:58:31.573332] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:15:57.412 passed 00:15:57.412 Test: admin_identify_ctrlr_verify_fused ...passed 00:15:57.412 Test: admin_identify_ns ...[2024-11-18 01:58:31.814343] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:15:57.671 [2024-11-18 01:58:31.822327] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:15:57.671 passed 00:15:57.671 Test: admin_get_features_mandatory_features ...passed 00:15:57.671 Test: admin_get_features_optional_features ...passed 00:15:57.929 Test: admin_set_features_number_of_queues ...passed 00:15:57.929 Test: admin_get_log_page_mandatory_logs ...passed 00:15:58.187 Test: admin_get_log_page_with_lpo ...[2024-11-18 01:58:32.444341] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:15:58.187 passed 00:15:58.187 Test: fabric_property_get ...passed 00:15:58.444 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-18 01:58:32.630038] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:15:58.444 passed 00:15:58.444 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-18 01:58:32.799321] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:15:58.444 [2024-11-18 01:58:32.815325] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:15:58.701 passed 00:15:58.701 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-18 01:58:32.906570] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:15:58.701 passed 00:15:58.701 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-18 01:58:33.069319] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:15:58.701 [2024-11-18 01:58:33.093320] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:15:58.960 passed 00:15:58.960 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-18 01:58:33.183657] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:15:58.960 [2024-11-18 01:58:33.183710] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:15:58.960 passed 00:15:58.960 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-18 01:58:33.358335] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:15:59.218 [2024-11-18 01:58:33.366323] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:15:59.218 [2024-11-18 01:58:33.374319] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:15:59.218 [2024-11-18 01:58:33.382320] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:15:59.218 passed 00:15:59.218 Test: admin_create_io_sq_verify_pc ...[2024-11-18 01:58:33.512335] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:15:59.218 passed 00:16:00.591 Test: admin_create_io_qp_max_qps ...[2024-11-18 01:58:34.720341] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:00.849 passed 00:16:01.107 Test: admin_create_io_sq_shared_cq ...[2024-11-18 01:58:35.325335] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:01.107 passed 00:16:01.107 00:16:01.107 Run Summary: Type Total Ran Passed Failed Inactive 00:16:01.107 suites 1 1 n/a 0 0 00:16:01.107 tests 18 18 18 0 0 00:16:01.107 asserts 360 360 360 0 n/a 00:16:01.107 00:16:01.107 Elapsed time = 1.573 seconds 00:16:01.107 01:58:35 -- compliance/compliance.sh@42 -- # killprocess 1183760 00:16:01.107 01:58:35 -- common/autotest_common.sh@936 -- # '[' -z 1183760 ']' 00:16:01.107 01:58:35 -- common/autotest_common.sh@940 -- # kill -0 1183760 00:16:01.107 01:58:35 -- common/autotest_common.sh@941 -- # uname 00:16:01.107 01:58:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:01.107 01:58:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1183760 00:16:01.107 01:58:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:01.107 01:58:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:01.107 01:58:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1183760' 00:16:01.107 killing process with pid 1183760 00:16:01.107 01:58:35 -- common/autotest_common.sh@955 -- # kill 1183760 00:16:01.107 01:58:35 -- common/autotest_common.sh@960 -- # wait 1183760 00:16:01.366 01:58:35 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:01.366 01:58:35 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:01.366 00:16:01.366 real 0m6.566s 00:16:01.366 user 0m18.664s 00:16:01.366 sys 0m0.618s 00:16:01.366 01:58:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:01.366 01:58:35 -- common/autotest_common.sh@10 -- # set +x 00:16:01.366 ************************************ 00:16:01.366 END TEST nvmf_vfio_user_nvme_compliance 00:16:01.366 ************************************ 00:16:01.366 01:58:35 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:01.366 01:58:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:01.366 01:58:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:01.366 01:58:35 -- common/autotest_common.sh@10 -- # set +x 00:16:01.366 ************************************ 00:16:01.366 START TEST nvmf_vfio_user_fuzz 00:16:01.366 ************************************ 00:16:01.366 01:58:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:01.366 * Looking for test storage... 00:16:01.625 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:01.625 01:58:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:01.625 01:58:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:01.625 01:58:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:01.625 01:58:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:01.625 01:58:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:01.625 01:58:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:01.625 01:58:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:01.625 01:58:35 -- scripts/common.sh@335 -- # IFS=.-: 00:16:01.625 01:58:35 -- scripts/common.sh@335 -- # read -ra ver1 00:16:01.625 01:58:35 -- scripts/common.sh@336 -- # IFS=.-: 00:16:01.625 01:58:35 -- scripts/common.sh@336 -- # read -ra ver2 00:16:01.625 01:58:35 -- scripts/common.sh@337 -- # local 'op=<' 00:16:01.625 01:58:35 -- scripts/common.sh@339 -- # ver1_l=2 00:16:01.625 01:58:35 -- scripts/common.sh@340 -- # ver2_l=1 00:16:01.625 01:58:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:01.625 01:58:35 -- scripts/common.sh@343 -- # case "$op" in 00:16:01.625 01:58:35 -- scripts/common.sh@344 -- # : 1 00:16:01.625 01:58:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:01.625 01:58:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:01.625 01:58:35 -- scripts/common.sh@364 -- # decimal 1 00:16:01.625 01:58:35 -- scripts/common.sh@352 -- # local d=1 00:16:01.625 01:58:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:01.625 01:58:35 -- scripts/common.sh@354 -- # echo 1 00:16:01.625 01:58:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:01.625 01:58:35 -- scripts/common.sh@365 -- # decimal 2 00:16:01.625 01:58:35 -- scripts/common.sh@352 -- # local d=2 00:16:01.625 01:58:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:01.625 01:58:35 -- scripts/common.sh@354 -- # echo 2 00:16:01.625 01:58:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:01.625 01:58:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:01.625 01:58:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:01.625 01:58:35 -- scripts/common.sh@367 -- # return 0 00:16:01.625 01:58:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:01.625 01:58:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:01.625 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:01.625 --rc genhtml_branch_coverage=1 00:16:01.625 --rc genhtml_function_coverage=1 00:16:01.625 --rc genhtml_legend=1 00:16:01.625 --rc geninfo_all_blocks=1 00:16:01.625 --rc geninfo_unexecuted_blocks=1 00:16:01.625 00:16:01.625 ' 00:16:01.625 01:58:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:01.625 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:01.625 --rc genhtml_branch_coverage=1 00:16:01.625 --rc genhtml_function_coverage=1 00:16:01.625 --rc genhtml_legend=1 00:16:01.625 --rc geninfo_all_blocks=1 00:16:01.625 --rc geninfo_unexecuted_blocks=1 00:16:01.625 00:16:01.625 ' 00:16:01.625 01:58:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:01.625 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:01.625 --rc genhtml_branch_coverage=1 00:16:01.625 --rc genhtml_function_coverage=1 00:16:01.625 --rc genhtml_legend=1 00:16:01.625 --rc geninfo_all_blocks=1 00:16:01.625 --rc geninfo_unexecuted_blocks=1 00:16:01.625 00:16:01.625 ' 00:16:01.625 01:58:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:01.625 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:01.625 --rc genhtml_branch_coverage=1 00:16:01.625 --rc genhtml_function_coverage=1 00:16:01.625 --rc genhtml_legend=1 00:16:01.625 --rc geninfo_all_blocks=1 00:16:01.625 --rc geninfo_unexecuted_blocks=1 00:16:01.625 00:16:01.625 ' 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:01.626 01:58:35 -- nvmf/common.sh@7 -- # uname -s 00:16:01.626 01:58:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:01.626 01:58:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:01.626 01:58:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:01.626 01:58:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:01.626 01:58:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:01.626 01:58:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:01.626 01:58:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:01.626 01:58:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:01.626 01:58:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:01.626 01:58:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:01.626 01:58:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:01.626 01:58:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:01.626 01:58:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:01.626 01:58:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:01.626 01:58:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:01.626 01:58:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:01.626 01:58:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:01.626 01:58:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:01.626 01:58:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:01.626 01:58:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:01.626 01:58:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:01.626 01:58:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:01.626 01:58:35 -- paths/export.sh@5 -- # export PATH 00:16:01.626 01:58:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:01.626 01:58:35 -- nvmf/common.sh@46 -- # : 0 00:16:01.626 01:58:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:01.626 01:58:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:01.626 01:58:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:01.626 01:58:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:01.626 01:58:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:01.626 01:58:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:01.626 01:58:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:01.626 01:58:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=1184647 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 1184647' 00:16:01.626 Process pid: 1184647 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:01.626 01:58:35 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 1184647 00:16:01.626 01:58:35 -- common/autotest_common.sh@829 -- # '[' -z 1184647 ']' 00:16:01.626 01:58:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:01.626 01:58:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:01.626 01:58:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:01.626 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:01.626 01:58:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:01.626 01:58:35 -- common/autotest_common.sh@10 -- # set +x 00:16:02.560 01:58:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:02.560 01:58:36 -- common/autotest_common.sh@862 -- # return 0 00:16:02.560 01:58:36 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:03.493 01:58:37 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:03.493 01:58:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:03.493 01:58:37 -- common/autotest_common.sh@10 -- # set +x 00:16:03.751 01:58:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:03.751 01:58:37 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:03.751 01:58:37 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:03.751 01:58:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:03.751 01:58:37 -- common/autotest_common.sh@10 -- # set +x 00:16:03.751 malloc0 00:16:03.751 01:58:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:03.751 01:58:37 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:03.751 01:58:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:03.751 01:58:37 -- common/autotest_common.sh@10 -- # set +x 00:16:03.751 01:58:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:03.751 01:58:37 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:03.751 01:58:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:03.751 01:58:37 -- common/autotest_common.sh@10 -- # set +x 00:16:03.751 01:58:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:03.751 01:58:37 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:03.751 01:58:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:03.751 01:58:37 -- common/autotest_common.sh@10 -- # set +x 00:16:03.751 01:58:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:03.751 01:58:37 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:03.751 01:58:37 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:16:35.828 Fuzzing completed. Shutting down the fuzz application 00:16:35.828 00:16:35.828 Dumping successful admin opcodes: 00:16:35.828 8, 9, 10, 24, 00:16:35.828 Dumping successful io opcodes: 00:16:35.828 0, 00:16:35.828 NS: 0x200003a1ef00 I/O qp, Total commands completed: 643854, total successful commands: 2501, random_seed: 3826334144 00:16:35.828 NS: 0x200003a1ef00 admin qp, Total commands completed: 160442, total successful commands: 1297, random_seed: 535016384 00:16:35.828 01:59:08 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:16:35.828 01:59:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.828 01:59:08 -- common/autotest_common.sh@10 -- # set +x 00:16:35.828 01:59:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.828 01:59:08 -- target/vfio_user_fuzz.sh@46 -- # killprocess 1184647 00:16:35.828 01:59:08 -- common/autotest_common.sh@936 -- # '[' -z 1184647 ']' 00:16:35.828 01:59:08 -- common/autotest_common.sh@940 -- # kill -0 1184647 00:16:35.828 01:59:08 -- common/autotest_common.sh@941 -- # uname 00:16:35.828 01:59:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:35.828 01:59:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1184647 00:16:35.828 01:59:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:35.828 01:59:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:35.828 01:59:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1184647' 00:16:35.828 killing process with pid 1184647 00:16:35.828 01:59:08 -- common/autotest_common.sh@955 -- # kill 1184647 00:16:35.828 01:59:08 -- common/autotest_common.sh@960 -- # wait 1184647 00:16:35.828 01:59:08 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:16:35.828 01:59:08 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:16:35.828 00:16:35.828 real 0m33.052s 00:16:35.828 user 0m37.106s 00:16:35.828 sys 0m22.168s 00:16:35.828 01:59:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:35.828 01:59:08 -- common/autotest_common.sh@10 -- # set +x 00:16:35.828 ************************************ 00:16:35.828 END TEST nvmf_vfio_user_fuzz 00:16:35.828 ************************************ 00:16:35.828 01:59:08 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:35.828 01:59:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:35.828 01:59:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:35.828 01:59:08 -- common/autotest_common.sh@10 -- # set +x 00:16:35.828 ************************************ 00:16:35.828 START TEST nvmf_host_management 00:16:35.828 ************************************ 00:16:35.829 01:59:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:35.829 * Looking for test storage... 00:16:35.829 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:35.829 01:59:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:35.829 01:59:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:35.829 01:59:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:35.829 01:59:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:35.829 01:59:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:35.829 01:59:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:35.829 01:59:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:35.829 01:59:08 -- scripts/common.sh@335 -- # IFS=.-: 00:16:35.829 01:59:08 -- scripts/common.sh@335 -- # read -ra ver1 00:16:35.829 01:59:08 -- scripts/common.sh@336 -- # IFS=.-: 00:16:35.829 01:59:08 -- scripts/common.sh@336 -- # read -ra ver2 00:16:35.829 01:59:08 -- scripts/common.sh@337 -- # local 'op=<' 00:16:35.829 01:59:08 -- scripts/common.sh@339 -- # ver1_l=2 00:16:35.829 01:59:08 -- scripts/common.sh@340 -- # ver2_l=1 00:16:35.829 01:59:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:35.829 01:59:08 -- scripts/common.sh@343 -- # case "$op" in 00:16:35.829 01:59:08 -- scripts/common.sh@344 -- # : 1 00:16:35.829 01:59:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:35.829 01:59:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:35.829 01:59:08 -- scripts/common.sh@364 -- # decimal 1 00:16:35.829 01:59:08 -- scripts/common.sh@352 -- # local d=1 00:16:35.829 01:59:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:35.829 01:59:08 -- scripts/common.sh@354 -- # echo 1 00:16:35.829 01:59:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:35.829 01:59:08 -- scripts/common.sh@365 -- # decimal 2 00:16:35.829 01:59:08 -- scripts/common.sh@352 -- # local d=2 00:16:35.829 01:59:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:35.829 01:59:08 -- scripts/common.sh@354 -- # echo 2 00:16:35.829 01:59:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:35.829 01:59:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:35.829 01:59:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:35.829 01:59:08 -- scripts/common.sh@367 -- # return 0 00:16:35.829 01:59:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:35.829 01:59:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:35.829 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:35.829 --rc genhtml_branch_coverage=1 00:16:35.829 --rc genhtml_function_coverage=1 00:16:35.829 --rc genhtml_legend=1 00:16:35.829 --rc geninfo_all_blocks=1 00:16:35.829 --rc geninfo_unexecuted_blocks=1 00:16:35.829 00:16:35.829 ' 00:16:35.829 01:59:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:35.829 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:35.829 --rc genhtml_branch_coverage=1 00:16:35.829 --rc genhtml_function_coverage=1 00:16:35.829 --rc genhtml_legend=1 00:16:35.829 --rc geninfo_all_blocks=1 00:16:35.829 --rc geninfo_unexecuted_blocks=1 00:16:35.829 00:16:35.829 ' 00:16:35.829 01:59:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:35.829 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:35.829 --rc genhtml_branch_coverage=1 00:16:35.829 --rc genhtml_function_coverage=1 00:16:35.829 --rc genhtml_legend=1 00:16:35.829 --rc geninfo_all_blocks=1 00:16:35.829 --rc geninfo_unexecuted_blocks=1 00:16:35.829 00:16:35.829 ' 00:16:35.829 01:59:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:35.829 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:35.829 --rc genhtml_branch_coverage=1 00:16:35.829 --rc genhtml_function_coverage=1 00:16:35.829 --rc genhtml_legend=1 00:16:35.829 --rc geninfo_all_blocks=1 00:16:35.829 --rc geninfo_unexecuted_blocks=1 00:16:35.829 00:16:35.829 ' 00:16:35.829 01:59:08 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:35.829 01:59:08 -- nvmf/common.sh@7 -- # uname -s 00:16:35.829 01:59:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:35.829 01:59:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:35.829 01:59:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:35.829 01:59:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:35.829 01:59:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:35.829 01:59:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:35.829 01:59:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:35.829 01:59:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:35.829 01:59:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:35.829 01:59:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:35.829 01:59:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:35.829 01:59:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:35.829 01:59:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:35.829 01:59:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:35.829 01:59:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:35.829 01:59:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:35.829 01:59:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:35.829 01:59:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:35.829 01:59:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:35.829 01:59:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.829 01:59:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.829 01:59:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.829 01:59:08 -- paths/export.sh@5 -- # export PATH 00:16:35.829 01:59:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.829 01:59:08 -- nvmf/common.sh@46 -- # : 0 00:16:35.829 01:59:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:35.829 01:59:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:35.829 01:59:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:35.829 01:59:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:35.829 01:59:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:35.829 01:59:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:35.829 01:59:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:35.829 01:59:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:35.829 01:59:08 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:35.829 01:59:08 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:35.829 01:59:08 -- target/host_management.sh@104 -- # nvmftestinit 00:16:35.829 01:59:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:35.829 01:59:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:35.829 01:59:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:35.829 01:59:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:35.829 01:59:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:35.829 01:59:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:35.829 01:59:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:35.829 01:59:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:35.829 01:59:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:35.829 01:59:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:35.829 01:59:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:35.829 01:59:08 -- common/autotest_common.sh@10 -- # set +x 00:16:36.764 01:59:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:36.764 01:59:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:36.764 01:59:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:36.764 01:59:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:36.764 01:59:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:36.764 01:59:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:36.764 01:59:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:36.764 01:59:10 -- nvmf/common.sh@294 -- # net_devs=() 00:16:36.764 01:59:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:36.764 01:59:10 -- nvmf/common.sh@295 -- # e810=() 00:16:36.764 01:59:10 -- nvmf/common.sh@295 -- # local -ga e810 00:16:36.764 01:59:10 -- nvmf/common.sh@296 -- # x722=() 00:16:36.764 01:59:10 -- nvmf/common.sh@296 -- # local -ga x722 00:16:36.764 01:59:10 -- nvmf/common.sh@297 -- # mlx=() 00:16:36.764 01:59:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:36.764 01:59:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:36.764 01:59:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:36.764 01:59:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:36.764 01:59:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:36.764 01:59:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:36.764 01:59:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:36.764 01:59:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:36.764 01:59:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:36.764 01:59:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:36.764 01:59:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:36.764 01:59:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:36.764 01:59:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:36.764 01:59:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:36.764 01:59:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:36.764 01:59:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:36.764 01:59:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:36.764 01:59:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:36.764 01:59:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:36.764 01:59:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:36.764 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:36.764 01:59:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:36.764 01:59:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:36.764 01:59:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:36.764 01:59:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:36.764 01:59:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:36.764 01:59:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:36.764 01:59:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:36.764 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:36.764 01:59:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:36.764 01:59:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:36.765 01:59:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:36.765 01:59:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:36.765 01:59:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:36.765 01:59:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:36.765 01:59:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:36.765 01:59:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:36.765 01:59:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:36.765 01:59:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:36.765 01:59:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:36.765 01:59:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:36.765 01:59:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:36.765 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:36.765 01:59:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:36.765 01:59:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:36.765 01:59:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:36.765 01:59:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:36.765 01:59:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:36.765 01:59:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:36.765 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:36.765 01:59:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:36.765 01:59:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:36.765 01:59:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:36.765 01:59:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:36.765 01:59:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:36.765 01:59:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:36.765 01:59:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:36.765 01:59:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:36.765 01:59:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:36.765 01:59:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:36.765 01:59:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:36.765 01:59:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:36.765 01:59:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:36.765 01:59:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:36.765 01:59:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:36.765 01:59:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:36.765 01:59:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:36.765 01:59:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:36.765 01:59:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:36.765 01:59:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:36.765 01:59:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:36.765 01:59:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:36.765 01:59:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:36.765 01:59:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:36.765 01:59:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:36.765 01:59:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:36.765 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:36.765 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.312 ms 00:16:36.765 00:16:36.765 --- 10.0.0.2 ping statistics --- 00:16:36.765 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:36.765 rtt min/avg/max/mdev = 0.312/0.312/0.312/0.000 ms 00:16:36.765 01:59:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:36.765 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:36.765 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:16:36.765 00:16:36.765 --- 10.0.0.1 ping statistics --- 00:16:36.765 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:36.765 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:16:36.765 01:59:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:36.765 01:59:11 -- nvmf/common.sh@410 -- # return 0 00:16:36.765 01:59:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:36.765 01:59:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:36.765 01:59:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:36.765 01:59:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:36.765 01:59:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:36.765 01:59:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:36.765 01:59:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:36.765 01:59:11 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:16:36.765 01:59:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:16:36.765 01:59:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:36.765 01:59:11 -- common/autotest_common.sh@10 -- # set +x 00:16:36.765 ************************************ 00:16:36.765 START TEST nvmf_host_management 00:16:36.765 ************************************ 00:16:36.765 01:59:11 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:16:36.765 01:59:11 -- target/host_management.sh@69 -- # starttarget 00:16:36.765 01:59:11 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:16:36.765 01:59:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:36.765 01:59:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:36.765 01:59:11 -- common/autotest_common.sh@10 -- # set +x 00:16:36.765 01:59:11 -- nvmf/common.sh@469 -- # nvmfpid=1190237 00:16:36.765 01:59:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:16:36.765 01:59:11 -- nvmf/common.sh@470 -- # waitforlisten 1190237 00:16:36.765 01:59:11 -- common/autotest_common.sh@829 -- # '[' -z 1190237 ']' 00:16:36.765 01:59:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:36.765 01:59:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:36.765 01:59:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:36.765 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:36.765 01:59:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:36.765 01:59:11 -- common/autotest_common.sh@10 -- # set +x 00:16:37.023 [2024-11-18 01:59:11.198110] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:37.024 [2024-11-18 01:59:11.198183] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:37.024 EAL: No free 2048 kB hugepages reported on node 1 00:16:37.024 [2024-11-18 01:59:11.264511] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:37.024 [2024-11-18 01:59:11.353717] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:37.024 [2024-11-18 01:59:11.353865] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:37.024 [2024-11-18 01:59:11.353881] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:37.024 [2024-11-18 01:59:11.353894] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:37.024 [2024-11-18 01:59:11.357340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:37.024 [2024-11-18 01:59:11.357400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:37.024 [2024-11-18 01:59:11.357464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:37.024 [2024-11-18 01:59:11.357467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:37.958 01:59:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:37.958 01:59:12 -- common/autotest_common.sh@862 -- # return 0 00:16:37.958 01:59:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:37.958 01:59:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:37.958 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:16:37.958 01:59:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:37.958 01:59:12 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:37.958 01:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:37.958 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:16:37.958 [2024-11-18 01:59:12.231100] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:37.958 01:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:37.958 01:59:12 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:16:37.958 01:59:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:37.958 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:16:37.958 01:59:12 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:37.958 01:59:12 -- target/host_management.sh@23 -- # cat 00:16:37.958 01:59:12 -- target/host_management.sh@30 -- # rpc_cmd 00:16:37.958 01:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:37.958 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:16:37.958 Malloc0 00:16:37.958 [2024-11-18 01:59:12.290366] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:37.958 01:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:37.958 01:59:12 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:16:37.958 01:59:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:37.958 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:16:37.958 01:59:12 -- target/host_management.sh@73 -- # perfpid=1190418 00:16:37.958 01:59:12 -- target/host_management.sh@74 -- # waitforlisten 1190418 /var/tmp/bdevperf.sock 00:16:37.958 01:59:12 -- common/autotest_common.sh@829 -- # '[' -z 1190418 ']' 00:16:37.958 01:59:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:37.958 01:59:12 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:16:37.958 01:59:12 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:16:37.958 01:59:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:37.958 01:59:12 -- nvmf/common.sh@520 -- # config=() 00:16:37.958 01:59:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:37.958 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:37.958 01:59:12 -- nvmf/common.sh@520 -- # local subsystem config 00:16:37.958 01:59:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:37.958 01:59:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:37.958 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:16:37.958 01:59:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:37.958 { 00:16:37.958 "params": { 00:16:37.958 "name": "Nvme$subsystem", 00:16:37.958 "trtype": "$TEST_TRANSPORT", 00:16:37.958 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:37.958 "adrfam": "ipv4", 00:16:37.958 "trsvcid": "$NVMF_PORT", 00:16:37.958 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:37.958 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:37.958 "hdgst": ${hdgst:-false}, 00:16:37.958 "ddgst": ${ddgst:-false} 00:16:37.958 }, 00:16:37.958 "method": "bdev_nvme_attach_controller" 00:16:37.958 } 00:16:37.958 EOF 00:16:37.958 )") 00:16:37.958 01:59:12 -- nvmf/common.sh@542 -- # cat 00:16:37.958 01:59:12 -- nvmf/common.sh@544 -- # jq . 00:16:37.958 01:59:12 -- nvmf/common.sh@545 -- # IFS=, 00:16:37.958 01:59:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:37.958 "params": { 00:16:37.958 "name": "Nvme0", 00:16:37.958 "trtype": "tcp", 00:16:37.958 "traddr": "10.0.0.2", 00:16:37.958 "adrfam": "ipv4", 00:16:37.958 "trsvcid": "4420", 00:16:37.958 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:37.958 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:37.958 "hdgst": false, 00:16:37.958 "ddgst": false 00:16:37.958 }, 00:16:37.958 "method": "bdev_nvme_attach_controller" 00:16:37.958 }' 00:16:37.958 [2024-11-18 01:59:12.358821] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:37.958 [2024-11-18 01:59:12.358913] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1190418 ] 00:16:38.217 EAL: No free 2048 kB hugepages reported on node 1 00:16:38.217 [2024-11-18 01:59:12.421369] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:38.217 [2024-11-18 01:59:12.508031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:38.475 Running I/O for 10 seconds... 00:16:39.056 01:59:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:39.056 01:59:13 -- common/autotest_common.sh@862 -- # return 0 00:16:39.056 01:59:13 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:16:39.056 01:59:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.056 01:59:13 -- common/autotest_common.sh@10 -- # set +x 00:16:39.056 01:59:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.056 01:59:13 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:39.056 01:59:13 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:16:39.056 01:59:13 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:16:39.056 01:59:13 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:16:39.056 01:59:13 -- target/host_management.sh@52 -- # local ret=1 00:16:39.056 01:59:13 -- target/host_management.sh@53 -- # local i 00:16:39.056 01:59:13 -- target/host_management.sh@54 -- # (( i = 10 )) 00:16:39.056 01:59:13 -- target/host_management.sh@54 -- # (( i != 0 )) 00:16:39.056 01:59:13 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:16:39.056 01:59:13 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:16:39.056 01:59:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.056 01:59:13 -- common/autotest_common.sh@10 -- # set +x 00:16:39.056 01:59:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.056 01:59:13 -- target/host_management.sh@55 -- # read_io_count=2676 00:16:39.056 01:59:13 -- target/host_management.sh@58 -- # '[' 2676 -ge 100 ']' 00:16:39.056 01:59:13 -- target/host_management.sh@59 -- # ret=0 00:16:39.056 01:59:13 -- target/host_management.sh@60 -- # break 00:16:39.056 01:59:13 -- target/host_management.sh@64 -- # return 0 00:16:39.056 01:59:13 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:39.056 01:59:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.056 01:59:13 -- common/autotest_common.sh@10 -- # set +x 00:16:39.056 [2024-11-18 01:59:13.454337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.056 [2024-11-18 01:59:13.454641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.454989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x268dad0 is same with the state(5) to be set 00:16:39.057 [2024-11-18 01:59:13.455430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:105472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:105600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:99712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:99840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:99968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:100096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:100608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:100736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:105984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:106112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:106240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:106368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:106496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:106624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:100864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:100992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:101504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.455978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.057 [2024-11-18 01:59:13.455994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:101760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.057 [2024-11-18 01:59:13.456008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:101888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:102144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:106752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:106880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:107008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:107136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:107264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:107392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:107520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:107648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:107776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:107904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:108032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:102272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:108160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:108288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:108416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:108544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:108672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:108800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:108928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:109056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:109184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:109312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:109440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:109568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:102400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:103168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:103296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:103424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:103680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.456976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:104192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.456990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.457005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:104320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.457020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.457035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:104448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.457053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.457069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:109696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.457084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.457099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:109824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.457114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.457129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:109952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.457144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.457159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:110080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.058 [2024-11-18 01:59:13.457174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.058 [2024-11-18 01:59:13.457189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:110208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.059 [2024-11-18 01:59:13.457203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.317 [2024-11-18 01:59:13.457220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:110336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.317 [2024-11-18 01:59:13.457234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.317 [2024-11-18 01:59:13.457250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:110464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.317 [2024-11-18 01:59:13.457265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.317 [2024-11-18 01:59:13.457280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:104576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.317 [2024-11-18 01:59:13.457295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.317 [2024-11-18 01:59:13.457317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:110592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.317 [2024-11-18 01:59:13.457334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.317 [2024-11-18 01:59:13.457350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:110720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.317 [2024-11-18 01:59:13.457365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.317 [2024-11-18 01:59:13.457381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:110848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.317 [2024-11-18 01:59:13.457395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.317 [2024-11-18 01:59:13.457411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:104960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:39.317 [2024-11-18 01:59:13.457429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.317 [2024-11-18 01:59:13.457522] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe1a630 was disconnected and freed. reset controller. 00:16:39.317 [2024-11-18 01:59:13.457601] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:16:39.317 [2024-11-18 01:59:13.457623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.317 [2024-11-18 01:59:13.457639] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:16:39.317 [2024-11-18 01:59:13.457653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.317 [2024-11-18 01:59:13.457667] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:16:39.317 [2024-11-18 01:59:13.457681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.317 [2024-11-18 01:59:13.457695] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:16:39.317 [2024-11-18 01:59:13.457708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:39.317 [2024-11-18 01:59:13.457721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe201d0 is same with the state(5) to be set 00:16:39.317 01:59:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.317 [2024-11-18 01:59:13.458847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:16:39.317 01:59:13 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:39.317 01:59:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.317 01:59:13 -- common/autotest_common.sh@10 -- # set +x 00:16:39.317 task offset: 105472 on job bdev=Nvme0n1 fails 00:16:39.317 00:16:39.317 Latency(us) 00:16:39.317 [2024-11-18T00:59:13.719Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:39.317 [2024-11-18T00:59:13.719Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:39.317 [2024-11-18T00:59:13.719Z] Job: Nvme0n1 ended in about 0.73 seconds with error 00:16:39.317 Verification LBA range: start 0x0 length 0x400 00:16:39.317 Nvme0n1 : 0.73 3892.22 243.26 87.37 0.00 15852.96 2803.48 24466.77 00:16:39.317 [2024-11-18T00:59:13.719Z] =================================================================================================================== 00:16:39.317 [2024-11-18T00:59:13.719Z] Total : 3892.22 243.26 87.37 0.00 15852.96 2803.48 24466.77 00:16:39.317 [2024-11-18 01:59:13.460778] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:16:39.317 [2024-11-18 01:59:13.460807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe201d0 (9): Bad file descriptor 00:16:39.317 [2024-11-18 01:59:13.465974] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:39.317 01:59:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.317 01:59:13 -- target/host_management.sh@87 -- # sleep 1 00:16:40.252 01:59:14 -- target/host_management.sh@91 -- # kill -9 1190418 00:16:40.252 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (1190418) - No such process 00:16:40.252 01:59:14 -- target/host_management.sh@91 -- # true 00:16:40.252 01:59:14 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:16:40.252 01:59:14 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:16:40.252 01:59:14 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:16:40.252 01:59:14 -- nvmf/common.sh@520 -- # config=() 00:16:40.252 01:59:14 -- nvmf/common.sh@520 -- # local subsystem config 00:16:40.252 01:59:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:40.252 01:59:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:40.252 { 00:16:40.252 "params": { 00:16:40.252 "name": "Nvme$subsystem", 00:16:40.252 "trtype": "$TEST_TRANSPORT", 00:16:40.252 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:40.252 "adrfam": "ipv4", 00:16:40.252 "trsvcid": "$NVMF_PORT", 00:16:40.252 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:40.252 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:40.252 "hdgst": ${hdgst:-false}, 00:16:40.252 "ddgst": ${ddgst:-false} 00:16:40.252 }, 00:16:40.252 "method": "bdev_nvme_attach_controller" 00:16:40.252 } 00:16:40.252 EOF 00:16:40.252 )") 00:16:40.252 01:59:14 -- nvmf/common.sh@542 -- # cat 00:16:40.252 01:59:14 -- nvmf/common.sh@544 -- # jq . 00:16:40.252 01:59:14 -- nvmf/common.sh@545 -- # IFS=, 00:16:40.252 01:59:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:40.252 "params": { 00:16:40.252 "name": "Nvme0", 00:16:40.252 "trtype": "tcp", 00:16:40.252 "traddr": "10.0.0.2", 00:16:40.252 "adrfam": "ipv4", 00:16:40.252 "trsvcid": "4420", 00:16:40.252 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:40.252 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:40.252 "hdgst": false, 00:16:40.252 "ddgst": false 00:16:40.252 }, 00:16:40.252 "method": "bdev_nvme_attach_controller" 00:16:40.252 }' 00:16:40.252 [2024-11-18 01:59:14.513831] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:40.252 [2024-11-18 01:59:14.513907] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1190700 ] 00:16:40.252 EAL: No free 2048 kB hugepages reported on node 1 00:16:40.252 [2024-11-18 01:59:14.573112] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:40.510 [2024-11-18 01:59:14.661276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:40.767 Running I/O for 1 seconds... 00:16:41.701 00:16:41.701 Latency(us) 00:16:41.701 [2024-11-18T00:59:16.103Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:41.701 [2024-11-18T00:59:16.103Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:41.701 Verification LBA range: start 0x0 length 0x400 00:16:41.701 Nvme0n1 : 1.01 3588.95 224.31 0.00 0.00 17544.07 1322.86 26020.22 00:16:41.701 [2024-11-18T00:59:16.103Z] =================================================================================================================== 00:16:41.701 [2024-11-18T00:59:16.103Z] Total : 3588.95 224.31 0.00 0.00 17544.07 1322.86 26020.22 00:16:41.958 01:59:16 -- target/host_management.sh@101 -- # stoptarget 00:16:41.959 01:59:16 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:16:41.959 01:59:16 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:16:41.959 01:59:16 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:41.959 01:59:16 -- target/host_management.sh@40 -- # nvmftestfini 00:16:41.959 01:59:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:41.959 01:59:16 -- nvmf/common.sh@116 -- # sync 00:16:41.959 01:59:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:41.959 01:59:16 -- nvmf/common.sh@119 -- # set +e 00:16:41.959 01:59:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:41.959 01:59:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:41.959 rmmod nvme_tcp 00:16:41.959 rmmod nvme_fabrics 00:16:41.959 rmmod nvme_keyring 00:16:41.959 01:59:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:41.959 01:59:16 -- nvmf/common.sh@123 -- # set -e 00:16:41.959 01:59:16 -- nvmf/common.sh@124 -- # return 0 00:16:41.959 01:59:16 -- nvmf/common.sh@477 -- # '[' -n 1190237 ']' 00:16:41.959 01:59:16 -- nvmf/common.sh@478 -- # killprocess 1190237 00:16:41.959 01:59:16 -- common/autotest_common.sh@936 -- # '[' -z 1190237 ']' 00:16:41.959 01:59:16 -- common/autotest_common.sh@940 -- # kill -0 1190237 00:16:41.959 01:59:16 -- common/autotest_common.sh@941 -- # uname 00:16:41.959 01:59:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:41.959 01:59:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1190237 00:16:41.959 01:59:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:41.959 01:59:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:41.959 01:59:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1190237' 00:16:41.959 killing process with pid 1190237 00:16:41.959 01:59:16 -- common/autotest_common.sh@955 -- # kill 1190237 00:16:41.959 01:59:16 -- common/autotest_common.sh@960 -- # wait 1190237 00:16:42.217 [2024-11-18 01:59:16.553695] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:16:42.217 01:59:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:42.217 01:59:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:42.217 01:59:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:42.217 01:59:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:42.217 01:59:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:42.217 01:59:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:42.217 01:59:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:42.217 01:59:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:44.753 01:59:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:44.753 00:16:44.753 real 0m7.471s 00:16:44.753 user 0m23.451s 00:16:44.753 sys 0m1.481s 00:16:44.753 01:59:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:44.753 01:59:18 -- common/autotest_common.sh@10 -- # set +x 00:16:44.753 ************************************ 00:16:44.753 END TEST nvmf_host_management 00:16:44.753 ************************************ 00:16:44.753 01:59:18 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:16:44.753 00:16:44.753 real 0m9.843s 00:16:44.753 user 0m24.363s 00:16:44.753 sys 0m2.964s 00:16:44.753 01:59:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:44.753 01:59:18 -- common/autotest_common.sh@10 -- # set +x 00:16:44.753 ************************************ 00:16:44.753 END TEST nvmf_host_management 00:16:44.753 ************************************ 00:16:44.753 01:59:18 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:44.753 01:59:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:44.753 01:59:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:44.753 01:59:18 -- common/autotest_common.sh@10 -- # set +x 00:16:44.753 ************************************ 00:16:44.753 START TEST nvmf_lvol 00:16:44.753 ************************************ 00:16:44.753 01:59:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:44.753 * Looking for test storage... 00:16:44.753 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:44.753 01:59:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:44.753 01:59:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:44.753 01:59:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:44.753 01:59:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:44.753 01:59:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:44.753 01:59:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:44.753 01:59:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:44.753 01:59:18 -- scripts/common.sh@335 -- # IFS=.-: 00:16:44.753 01:59:18 -- scripts/common.sh@335 -- # read -ra ver1 00:16:44.753 01:59:18 -- scripts/common.sh@336 -- # IFS=.-: 00:16:44.753 01:59:18 -- scripts/common.sh@336 -- # read -ra ver2 00:16:44.753 01:59:18 -- scripts/common.sh@337 -- # local 'op=<' 00:16:44.753 01:59:18 -- scripts/common.sh@339 -- # ver1_l=2 00:16:44.753 01:59:18 -- scripts/common.sh@340 -- # ver2_l=1 00:16:44.753 01:59:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:44.753 01:59:18 -- scripts/common.sh@343 -- # case "$op" in 00:16:44.753 01:59:18 -- scripts/common.sh@344 -- # : 1 00:16:44.753 01:59:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:44.753 01:59:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:44.753 01:59:18 -- scripts/common.sh@364 -- # decimal 1 00:16:44.753 01:59:18 -- scripts/common.sh@352 -- # local d=1 00:16:44.753 01:59:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:44.753 01:59:18 -- scripts/common.sh@354 -- # echo 1 00:16:44.753 01:59:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:44.753 01:59:18 -- scripts/common.sh@365 -- # decimal 2 00:16:44.754 01:59:18 -- scripts/common.sh@352 -- # local d=2 00:16:44.754 01:59:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:44.754 01:59:18 -- scripts/common.sh@354 -- # echo 2 00:16:44.754 01:59:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:44.754 01:59:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:44.754 01:59:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:44.754 01:59:18 -- scripts/common.sh@367 -- # return 0 00:16:44.754 01:59:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:44.754 01:59:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:44.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:44.754 --rc genhtml_branch_coverage=1 00:16:44.754 --rc genhtml_function_coverage=1 00:16:44.754 --rc genhtml_legend=1 00:16:44.754 --rc geninfo_all_blocks=1 00:16:44.754 --rc geninfo_unexecuted_blocks=1 00:16:44.754 00:16:44.754 ' 00:16:44.754 01:59:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:44.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:44.754 --rc genhtml_branch_coverage=1 00:16:44.754 --rc genhtml_function_coverage=1 00:16:44.754 --rc genhtml_legend=1 00:16:44.754 --rc geninfo_all_blocks=1 00:16:44.754 --rc geninfo_unexecuted_blocks=1 00:16:44.754 00:16:44.754 ' 00:16:44.754 01:59:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:44.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:44.754 --rc genhtml_branch_coverage=1 00:16:44.754 --rc genhtml_function_coverage=1 00:16:44.754 --rc genhtml_legend=1 00:16:44.754 --rc geninfo_all_blocks=1 00:16:44.754 --rc geninfo_unexecuted_blocks=1 00:16:44.754 00:16:44.754 ' 00:16:44.754 01:59:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:44.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:44.754 --rc genhtml_branch_coverage=1 00:16:44.754 --rc genhtml_function_coverage=1 00:16:44.754 --rc genhtml_legend=1 00:16:44.754 --rc geninfo_all_blocks=1 00:16:44.754 --rc geninfo_unexecuted_blocks=1 00:16:44.754 00:16:44.754 ' 00:16:44.754 01:59:18 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:44.754 01:59:18 -- nvmf/common.sh@7 -- # uname -s 00:16:44.754 01:59:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:44.754 01:59:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:44.754 01:59:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:44.754 01:59:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:44.754 01:59:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:44.754 01:59:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:44.754 01:59:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:44.754 01:59:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:44.754 01:59:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:44.754 01:59:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:44.754 01:59:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:44.754 01:59:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:44.754 01:59:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:44.754 01:59:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:44.754 01:59:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:44.754 01:59:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:44.754 01:59:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:44.754 01:59:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:44.754 01:59:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:44.754 01:59:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.754 01:59:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.754 01:59:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.754 01:59:18 -- paths/export.sh@5 -- # export PATH 00:16:44.754 01:59:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.754 01:59:18 -- nvmf/common.sh@46 -- # : 0 00:16:44.754 01:59:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:44.754 01:59:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:44.754 01:59:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:44.754 01:59:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:44.754 01:59:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:44.754 01:59:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:44.754 01:59:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:44.754 01:59:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:44.754 01:59:18 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:44.754 01:59:18 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:44.754 01:59:18 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:16:44.754 01:59:18 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:16:44.754 01:59:18 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:44.754 01:59:18 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:16:44.754 01:59:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:44.754 01:59:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:44.754 01:59:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:44.754 01:59:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:44.754 01:59:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:44.754 01:59:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:44.754 01:59:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:44.754 01:59:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:44.754 01:59:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:44.754 01:59:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:44.754 01:59:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:44.754 01:59:18 -- common/autotest_common.sh@10 -- # set +x 00:16:46.655 01:59:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:46.655 01:59:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:46.655 01:59:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:46.655 01:59:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:46.655 01:59:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:46.655 01:59:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:46.655 01:59:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:46.655 01:59:20 -- nvmf/common.sh@294 -- # net_devs=() 00:16:46.655 01:59:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:46.655 01:59:20 -- nvmf/common.sh@295 -- # e810=() 00:16:46.655 01:59:20 -- nvmf/common.sh@295 -- # local -ga e810 00:16:46.655 01:59:20 -- nvmf/common.sh@296 -- # x722=() 00:16:46.655 01:59:20 -- nvmf/common.sh@296 -- # local -ga x722 00:16:46.655 01:59:20 -- nvmf/common.sh@297 -- # mlx=() 00:16:46.655 01:59:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:46.655 01:59:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:46.655 01:59:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:46.655 01:59:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:46.655 01:59:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:46.655 01:59:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:46.655 01:59:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:46.655 01:59:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:46.655 01:59:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:46.655 01:59:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:46.655 01:59:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:46.655 01:59:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:46.655 01:59:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:46.655 01:59:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:46.655 01:59:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:46.655 01:59:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:46.655 01:59:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:46.655 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:46.655 01:59:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:46.655 01:59:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:46.655 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:46.655 01:59:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:46.655 01:59:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:46.655 01:59:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:46.655 01:59:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:46.655 01:59:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:46.655 01:59:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:46.655 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:46.655 01:59:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:46.655 01:59:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:46.655 01:59:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:46.655 01:59:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:46.655 01:59:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:46.655 01:59:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:46.655 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:46.655 01:59:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:46.655 01:59:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:46.655 01:59:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:46.655 01:59:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:46.655 01:59:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:46.655 01:59:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:46.655 01:59:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:46.655 01:59:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:46.655 01:59:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:46.655 01:59:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:46.655 01:59:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:46.655 01:59:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:46.655 01:59:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:46.655 01:59:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:46.655 01:59:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:46.655 01:59:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:46.655 01:59:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:46.655 01:59:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:46.655 01:59:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:46.655 01:59:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:46.655 01:59:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:46.655 01:59:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:46.655 01:59:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:46.655 01:59:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:46.655 01:59:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:46.655 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:46.656 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:16:46.656 00:16:46.656 --- 10.0.0.2 ping statistics --- 00:16:46.656 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:46.656 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:16:46.656 01:59:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:46.656 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:46.656 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:16:46.656 00:16:46.656 --- 10.0.0.1 ping statistics --- 00:16:46.656 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:46.656 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:16:46.656 01:59:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:46.656 01:59:21 -- nvmf/common.sh@410 -- # return 0 00:16:46.656 01:59:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:46.656 01:59:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:46.656 01:59:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:46.656 01:59:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:46.656 01:59:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:46.656 01:59:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:46.656 01:59:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:46.914 01:59:21 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:16:46.914 01:59:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:46.914 01:59:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:46.914 01:59:21 -- common/autotest_common.sh@10 -- # set +x 00:16:46.914 01:59:21 -- nvmf/common.sh@469 -- # nvmfpid=1192940 00:16:46.914 01:59:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:46.914 01:59:21 -- nvmf/common.sh@470 -- # waitforlisten 1192940 00:16:46.914 01:59:21 -- common/autotest_common.sh@829 -- # '[' -z 1192940 ']' 00:16:46.914 01:59:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:46.914 01:59:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:46.914 01:59:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:46.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:46.914 01:59:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:46.914 01:59:21 -- common/autotest_common.sh@10 -- # set +x 00:16:46.914 [2024-11-18 01:59:21.130943] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:46.914 [2024-11-18 01:59:21.131024] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:46.914 EAL: No free 2048 kB hugepages reported on node 1 00:16:46.914 [2024-11-18 01:59:21.194189] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:46.914 [2024-11-18 01:59:21.278173] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:46.914 [2024-11-18 01:59:21.278337] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:46.914 [2024-11-18 01:59:21.278357] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:46.914 [2024-11-18 01:59:21.278380] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:46.914 [2024-11-18 01:59:21.278433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:46.914 [2024-11-18 01:59:21.278486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:46.914 [2024-11-18 01:59:21.278489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:47.848 01:59:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:47.848 01:59:22 -- common/autotest_common.sh@862 -- # return 0 00:16:47.848 01:59:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:47.848 01:59:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:47.848 01:59:22 -- common/autotest_common.sh@10 -- # set +x 00:16:47.848 01:59:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:47.848 01:59:22 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:48.106 [2024-11-18 01:59:22.363891] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:48.106 01:59:22 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:48.364 01:59:22 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:16:48.364 01:59:22 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:48.622 01:59:22 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:16:48.622 01:59:22 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:16:48.881 01:59:23 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:16:49.139 01:59:23 -- target/nvmf_lvol.sh@29 -- # lvs=210410c6-e635-46f6-bb7f-eb4574273fb5 00:16:49.139 01:59:23 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 210410c6-e635-46f6-bb7f-eb4574273fb5 lvol 20 00:16:49.397 01:59:23 -- target/nvmf_lvol.sh@32 -- # lvol=b683f3cd-3d0d-42ad-ab20-01603fb8b4d5 00:16:49.398 01:59:23 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:16:49.655 01:59:23 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 b683f3cd-3d0d-42ad-ab20-01603fb8b4d5 00:16:49.914 01:59:24 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:16:50.172 [2024-11-18 01:59:24.459520] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:50.172 01:59:24 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:50.430 01:59:24 -- target/nvmf_lvol.sh@42 -- # perf_pid=1193386 00:16:50.430 01:59:24 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:16:50.430 01:59:24 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:16:50.430 EAL: No free 2048 kB hugepages reported on node 1 00:16:51.363 01:59:25 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot b683f3cd-3d0d-42ad-ab20-01603fb8b4d5 MY_SNAPSHOT 00:16:51.621 01:59:26 -- target/nvmf_lvol.sh@47 -- # snapshot=103635f2-8164-4028-9302-62fdfd83a950 00:16:51.621 01:59:26 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize b683f3cd-3d0d-42ad-ab20-01603fb8b4d5 30 00:16:52.187 01:59:26 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 103635f2-8164-4028-9302-62fdfd83a950 MY_CLONE 00:16:52.445 01:59:26 -- target/nvmf_lvol.sh@49 -- # clone=0526761c-c7a1-45e8-92e8-60893cdda636 00:16:52.445 01:59:26 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 0526761c-c7a1-45e8-92e8-60893cdda636 00:16:53.012 01:59:27 -- target/nvmf_lvol.sh@53 -- # wait 1193386 00:17:01.172 Initializing NVMe Controllers 00:17:01.172 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:01.172 Controller IO queue size 128, less than required. 00:17:01.172 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:01.172 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:01.172 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:01.172 Initialization complete. Launching workers. 00:17:01.172 ======================================================== 00:17:01.172 Latency(us) 00:17:01.172 Device Information : IOPS MiB/s Average min max 00:17:01.172 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10920.00 42.66 11724.41 1998.61 120747.24 00:17:01.172 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10813.50 42.24 11840.05 2048.33 67152.51 00:17:01.172 ======================================================== 00:17:01.172 Total : 21733.50 84.90 11781.95 1998.61 120747.24 00:17:01.172 00:17:01.172 01:59:35 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:01.172 01:59:35 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b683f3cd-3d0d-42ad-ab20-01603fb8b4d5 00:17:01.430 01:59:35 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 210410c6-e635-46f6-bb7f-eb4574273fb5 00:17:01.688 01:59:36 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:01.688 01:59:36 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:01.688 01:59:36 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:01.688 01:59:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:01.688 01:59:36 -- nvmf/common.sh@116 -- # sync 00:17:01.688 01:59:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:01.688 01:59:36 -- nvmf/common.sh@119 -- # set +e 00:17:01.688 01:59:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:01.688 01:59:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:01.688 rmmod nvme_tcp 00:17:01.688 rmmod nvme_fabrics 00:17:01.688 rmmod nvme_keyring 00:17:01.947 01:59:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:01.947 01:59:36 -- nvmf/common.sh@123 -- # set -e 00:17:01.947 01:59:36 -- nvmf/common.sh@124 -- # return 0 00:17:01.947 01:59:36 -- nvmf/common.sh@477 -- # '[' -n 1192940 ']' 00:17:01.947 01:59:36 -- nvmf/common.sh@478 -- # killprocess 1192940 00:17:01.947 01:59:36 -- common/autotest_common.sh@936 -- # '[' -z 1192940 ']' 00:17:01.947 01:59:36 -- common/autotest_common.sh@940 -- # kill -0 1192940 00:17:01.947 01:59:36 -- common/autotest_common.sh@941 -- # uname 00:17:01.947 01:59:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:01.947 01:59:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1192940 00:17:01.947 01:59:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:01.947 01:59:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:01.947 01:59:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1192940' 00:17:01.947 killing process with pid 1192940 00:17:01.947 01:59:36 -- common/autotest_common.sh@955 -- # kill 1192940 00:17:01.947 01:59:36 -- common/autotest_common.sh@960 -- # wait 1192940 00:17:02.206 01:59:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:02.206 01:59:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:02.206 01:59:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:02.206 01:59:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:02.206 01:59:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:02.206 01:59:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:02.206 01:59:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:02.206 01:59:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:04.110 01:59:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:04.110 00:17:04.110 real 0m19.777s 00:17:04.110 user 1m7.523s 00:17:04.110 sys 0m5.473s 00:17:04.110 01:59:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:04.110 01:59:38 -- common/autotest_common.sh@10 -- # set +x 00:17:04.110 ************************************ 00:17:04.110 END TEST nvmf_lvol 00:17:04.110 ************************************ 00:17:04.110 01:59:38 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:04.110 01:59:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:04.110 01:59:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:04.110 01:59:38 -- common/autotest_common.sh@10 -- # set +x 00:17:04.110 ************************************ 00:17:04.110 START TEST nvmf_lvs_grow 00:17:04.110 ************************************ 00:17:04.110 01:59:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:04.370 * Looking for test storage... 00:17:04.370 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:04.370 01:59:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:04.370 01:59:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:04.370 01:59:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:04.370 01:59:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:04.370 01:59:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:04.370 01:59:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:04.370 01:59:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:04.370 01:59:38 -- scripts/common.sh@335 -- # IFS=.-: 00:17:04.370 01:59:38 -- scripts/common.sh@335 -- # read -ra ver1 00:17:04.370 01:59:38 -- scripts/common.sh@336 -- # IFS=.-: 00:17:04.370 01:59:38 -- scripts/common.sh@336 -- # read -ra ver2 00:17:04.370 01:59:38 -- scripts/common.sh@337 -- # local 'op=<' 00:17:04.370 01:59:38 -- scripts/common.sh@339 -- # ver1_l=2 00:17:04.370 01:59:38 -- scripts/common.sh@340 -- # ver2_l=1 00:17:04.370 01:59:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:04.370 01:59:38 -- scripts/common.sh@343 -- # case "$op" in 00:17:04.370 01:59:38 -- scripts/common.sh@344 -- # : 1 00:17:04.370 01:59:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:04.370 01:59:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:04.370 01:59:38 -- scripts/common.sh@364 -- # decimal 1 00:17:04.370 01:59:38 -- scripts/common.sh@352 -- # local d=1 00:17:04.370 01:59:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:04.370 01:59:38 -- scripts/common.sh@354 -- # echo 1 00:17:04.370 01:59:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:04.370 01:59:38 -- scripts/common.sh@365 -- # decimal 2 00:17:04.370 01:59:38 -- scripts/common.sh@352 -- # local d=2 00:17:04.370 01:59:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:04.370 01:59:38 -- scripts/common.sh@354 -- # echo 2 00:17:04.370 01:59:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:04.370 01:59:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:04.370 01:59:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:04.370 01:59:38 -- scripts/common.sh@367 -- # return 0 00:17:04.370 01:59:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:04.370 01:59:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:04.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.370 --rc genhtml_branch_coverage=1 00:17:04.370 --rc genhtml_function_coverage=1 00:17:04.370 --rc genhtml_legend=1 00:17:04.370 --rc geninfo_all_blocks=1 00:17:04.370 --rc geninfo_unexecuted_blocks=1 00:17:04.370 00:17:04.370 ' 00:17:04.370 01:59:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:04.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.370 --rc genhtml_branch_coverage=1 00:17:04.370 --rc genhtml_function_coverage=1 00:17:04.370 --rc genhtml_legend=1 00:17:04.370 --rc geninfo_all_blocks=1 00:17:04.370 --rc geninfo_unexecuted_blocks=1 00:17:04.370 00:17:04.370 ' 00:17:04.370 01:59:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:04.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.370 --rc genhtml_branch_coverage=1 00:17:04.370 --rc genhtml_function_coverage=1 00:17:04.370 --rc genhtml_legend=1 00:17:04.370 --rc geninfo_all_blocks=1 00:17:04.370 --rc geninfo_unexecuted_blocks=1 00:17:04.370 00:17:04.370 ' 00:17:04.370 01:59:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:04.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.370 --rc genhtml_branch_coverage=1 00:17:04.370 --rc genhtml_function_coverage=1 00:17:04.370 --rc genhtml_legend=1 00:17:04.370 --rc geninfo_all_blocks=1 00:17:04.370 --rc geninfo_unexecuted_blocks=1 00:17:04.370 00:17:04.370 ' 00:17:04.370 01:59:38 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:04.370 01:59:38 -- nvmf/common.sh@7 -- # uname -s 00:17:04.370 01:59:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:04.370 01:59:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:04.370 01:59:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:04.370 01:59:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:04.370 01:59:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:04.370 01:59:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:04.370 01:59:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:04.370 01:59:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:04.370 01:59:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:04.370 01:59:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:04.370 01:59:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:04.370 01:59:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:04.370 01:59:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:04.370 01:59:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:04.370 01:59:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:04.370 01:59:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:04.370 01:59:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:04.370 01:59:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:04.370 01:59:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:04.370 01:59:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.370 01:59:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.370 01:59:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.370 01:59:38 -- paths/export.sh@5 -- # export PATH 00:17:04.370 01:59:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.370 01:59:38 -- nvmf/common.sh@46 -- # : 0 00:17:04.370 01:59:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:04.370 01:59:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:04.370 01:59:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:04.370 01:59:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:04.370 01:59:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:04.370 01:59:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:04.370 01:59:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:04.370 01:59:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:04.370 01:59:38 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:04.370 01:59:38 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:04.370 01:59:38 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:04.370 01:59:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:04.370 01:59:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:04.370 01:59:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:04.370 01:59:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:04.370 01:59:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:04.370 01:59:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:04.370 01:59:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:04.370 01:59:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:04.370 01:59:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:04.370 01:59:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:04.370 01:59:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:04.370 01:59:38 -- common/autotest_common.sh@10 -- # set +x 00:17:06.900 01:59:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:06.900 01:59:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:06.900 01:59:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:06.900 01:59:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:06.900 01:59:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:06.900 01:59:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:06.900 01:59:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:06.900 01:59:40 -- nvmf/common.sh@294 -- # net_devs=() 00:17:06.900 01:59:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:06.900 01:59:40 -- nvmf/common.sh@295 -- # e810=() 00:17:06.900 01:59:40 -- nvmf/common.sh@295 -- # local -ga e810 00:17:06.900 01:59:40 -- nvmf/common.sh@296 -- # x722=() 00:17:06.900 01:59:40 -- nvmf/common.sh@296 -- # local -ga x722 00:17:06.900 01:59:40 -- nvmf/common.sh@297 -- # mlx=() 00:17:06.900 01:59:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:06.900 01:59:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:06.900 01:59:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:06.900 01:59:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:06.900 01:59:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:06.900 01:59:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:06.900 01:59:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:06.900 01:59:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:06.900 01:59:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:06.900 01:59:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:06.900 01:59:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:06.900 01:59:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:06.900 01:59:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:06.900 01:59:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:06.900 01:59:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:06.900 01:59:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:06.900 01:59:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:06.900 01:59:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:06.900 01:59:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:06.900 01:59:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:06.900 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:06.900 01:59:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:06.900 01:59:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:06.900 01:59:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:06.900 01:59:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:06.900 01:59:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:06.900 01:59:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:06.900 01:59:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:06.900 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:06.901 01:59:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:06.901 01:59:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:06.901 01:59:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:06.901 01:59:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:06.901 01:59:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:06.901 01:59:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:06.901 01:59:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:06.901 01:59:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:06.901 01:59:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:06.901 01:59:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:06.901 01:59:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:06.901 01:59:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:06.901 01:59:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:06.901 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:06.901 01:59:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:06.901 01:59:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:06.901 01:59:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:06.901 01:59:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:06.901 01:59:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:06.901 01:59:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:06.901 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:06.901 01:59:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:06.901 01:59:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:06.901 01:59:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:06.901 01:59:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:06.901 01:59:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:06.901 01:59:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:06.901 01:59:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:06.901 01:59:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:06.901 01:59:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:06.901 01:59:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:06.901 01:59:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:06.901 01:59:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:06.901 01:59:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:06.901 01:59:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:06.901 01:59:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:06.901 01:59:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:06.901 01:59:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:06.901 01:59:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:06.901 01:59:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:06.901 01:59:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:06.901 01:59:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:06.901 01:59:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:06.901 01:59:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:06.901 01:59:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:06.901 01:59:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:06.901 01:59:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:06.901 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:06.901 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:17:06.901 00:17:06.901 --- 10.0.0.2 ping statistics --- 00:17:06.901 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:06.901 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:17:06.901 01:59:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:06.901 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:06.901 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:17:06.901 00:17:06.901 --- 10.0.0.1 ping statistics --- 00:17:06.901 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:06.901 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:17:06.901 01:59:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:06.901 01:59:40 -- nvmf/common.sh@410 -- # return 0 00:17:06.901 01:59:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:06.901 01:59:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:06.901 01:59:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:06.901 01:59:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:06.901 01:59:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:06.901 01:59:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:06.901 01:59:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:06.901 01:59:40 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:06.901 01:59:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:06.901 01:59:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:06.901 01:59:40 -- common/autotest_common.sh@10 -- # set +x 00:17:06.901 01:59:40 -- nvmf/common.sh@469 -- # nvmfpid=1196828 00:17:06.901 01:59:40 -- nvmf/common.sh@470 -- # waitforlisten 1196828 00:17:06.901 01:59:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:06.901 01:59:40 -- common/autotest_common.sh@829 -- # '[' -z 1196828 ']' 00:17:06.901 01:59:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:06.901 01:59:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:06.901 01:59:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:06.901 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:06.901 01:59:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:06.901 01:59:40 -- common/autotest_common.sh@10 -- # set +x 00:17:06.901 [2024-11-18 01:59:41.026170] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:06.901 [2024-11-18 01:59:41.026256] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:06.901 EAL: No free 2048 kB hugepages reported on node 1 00:17:06.901 [2024-11-18 01:59:41.094119] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:06.901 [2024-11-18 01:59:41.181936] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:06.901 [2024-11-18 01:59:41.182112] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:06.901 [2024-11-18 01:59:41.182133] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:06.901 [2024-11-18 01:59:41.182147] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:06.901 [2024-11-18 01:59:41.182176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:07.834 01:59:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:07.834 01:59:42 -- common/autotest_common.sh@862 -- # return 0 00:17:07.834 01:59:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:07.834 01:59:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:07.834 01:59:42 -- common/autotest_common.sh@10 -- # set +x 00:17:07.834 01:59:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:07.834 01:59:42 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:08.092 [2024-11-18 01:59:42.324406] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:08.092 01:59:42 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:08.092 01:59:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:08.092 01:59:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:08.092 01:59:42 -- common/autotest_common.sh@10 -- # set +x 00:17:08.092 ************************************ 00:17:08.092 START TEST lvs_grow_clean 00:17:08.092 ************************************ 00:17:08.092 01:59:42 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:08.092 01:59:42 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:08.092 01:59:42 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:08.092 01:59:42 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:08.092 01:59:42 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:08.092 01:59:42 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:08.092 01:59:42 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:08.092 01:59:42 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:08.092 01:59:42 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:08.092 01:59:42 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:08.350 01:59:42 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:08.350 01:59:42 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:08.608 01:59:42 -- target/nvmf_lvs_grow.sh@28 -- # lvs=8b51d6f8-e4bf-4400-9e8d-66a69d96158d 00:17:08.608 01:59:42 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8b51d6f8-e4bf-4400-9e8d-66a69d96158d 00:17:08.608 01:59:42 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:08.867 01:59:43 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:08.867 01:59:43 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:08.867 01:59:43 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 8b51d6f8-e4bf-4400-9e8d-66a69d96158d lvol 150 00:17:09.125 01:59:43 -- target/nvmf_lvs_grow.sh@33 -- # lvol=259c5aa4-7a90-43cf-bbf5-c8f13a95e16a 00:17:09.125 01:59:43 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:09.125 01:59:43 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:09.384 [2024-11-18 01:59:43.724764] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:09.384 [2024-11-18 01:59:43.724860] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:09.384 true 00:17:09.384 01:59:43 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8b51d6f8-e4bf-4400-9e8d-66a69d96158d 00:17:09.384 01:59:43 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:09.642 01:59:43 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:09.642 01:59:43 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:09.901 01:59:44 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 259c5aa4-7a90-43cf-bbf5-c8f13a95e16a 00:17:10.159 01:59:44 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:10.417 [2024-11-18 01:59:44.776033] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:10.417 01:59:44 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:10.675 01:59:45 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1197292 00:17:10.675 01:59:45 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:10.675 01:59:45 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:10.675 01:59:45 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1197292 /var/tmp/bdevperf.sock 00:17:10.675 01:59:45 -- common/autotest_common.sh@829 -- # '[' -z 1197292 ']' 00:17:10.675 01:59:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:10.675 01:59:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:10.675 01:59:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:10.675 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:10.676 01:59:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:10.676 01:59:45 -- common/autotest_common.sh@10 -- # set +x 00:17:10.934 [2024-11-18 01:59:45.079390] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:10.934 [2024-11-18 01:59:45.079455] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1197292 ] 00:17:10.934 EAL: No free 2048 kB hugepages reported on node 1 00:17:10.934 [2024-11-18 01:59:45.140534] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:10.934 [2024-11-18 01:59:45.229481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:11.868 01:59:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:11.868 01:59:46 -- common/autotest_common.sh@862 -- # return 0 00:17:11.868 01:59:46 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:12.126 Nvme0n1 00:17:12.126 01:59:46 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:12.384 [ 00:17:12.384 { 00:17:12.384 "name": "Nvme0n1", 00:17:12.384 "aliases": [ 00:17:12.384 "259c5aa4-7a90-43cf-bbf5-c8f13a95e16a" 00:17:12.384 ], 00:17:12.384 "product_name": "NVMe disk", 00:17:12.384 "block_size": 4096, 00:17:12.384 "num_blocks": 38912, 00:17:12.384 "uuid": "259c5aa4-7a90-43cf-bbf5-c8f13a95e16a", 00:17:12.384 "assigned_rate_limits": { 00:17:12.384 "rw_ios_per_sec": 0, 00:17:12.384 "rw_mbytes_per_sec": 0, 00:17:12.384 "r_mbytes_per_sec": 0, 00:17:12.384 "w_mbytes_per_sec": 0 00:17:12.384 }, 00:17:12.384 "claimed": false, 00:17:12.384 "zoned": false, 00:17:12.384 "supported_io_types": { 00:17:12.384 "read": true, 00:17:12.384 "write": true, 00:17:12.384 "unmap": true, 00:17:12.384 "write_zeroes": true, 00:17:12.384 "flush": true, 00:17:12.384 "reset": true, 00:17:12.384 "compare": true, 00:17:12.384 "compare_and_write": true, 00:17:12.384 "abort": true, 00:17:12.384 "nvme_admin": true, 00:17:12.384 "nvme_io": true 00:17:12.384 }, 00:17:12.384 "driver_specific": { 00:17:12.384 "nvme": [ 00:17:12.384 { 00:17:12.384 "trid": { 00:17:12.384 "trtype": "TCP", 00:17:12.384 "adrfam": "IPv4", 00:17:12.384 "traddr": "10.0.0.2", 00:17:12.384 "trsvcid": "4420", 00:17:12.384 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:12.384 }, 00:17:12.384 "ctrlr_data": { 00:17:12.384 "cntlid": 1, 00:17:12.384 "vendor_id": "0x8086", 00:17:12.384 "model_number": "SPDK bdev Controller", 00:17:12.384 "serial_number": "SPDK0", 00:17:12.384 "firmware_revision": "24.01.1", 00:17:12.384 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:12.384 "oacs": { 00:17:12.384 "security": 0, 00:17:12.384 "format": 0, 00:17:12.384 "firmware": 0, 00:17:12.384 "ns_manage": 0 00:17:12.384 }, 00:17:12.384 "multi_ctrlr": true, 00:17:12.384 "ana_reporting": false 00:17:12.384 }, 00:17:12.384 "vs": { 00:17:12.385 "nvme_version": "1.3" 00:17:12.385 }, 00:17:12.385 "ns_data": { 00:17:12.385 "id": 1, 00:17:12.385 "can_share": true 00:17:12.385 } 00:17:12.385 } 00:17:12.385 ], 00:17:12.385 "mp_policy": "active_passive" 00:17:12.385 } 00:17:12.385 } 00:17:12.385 ] 00:17:12.385 01:59:46 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1197561 00:17:12.385 01:59:46 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:12.385 01:59:46 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:12.643 Running I/O for 10 seconds... 00:17:13.577 Latency(us) 00:17:13.577 [2024-11-18T00:59:47.979Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:13.577 [2024-11-18T00:59:47.979Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:13.577 Nvme0n1 : 1.00 14819.00 57.89 0.00 0.00 0.00 0.00 0.00 00:17:13.577 [2024-11-18T00:59:47.979Z] =================================================================================================================== 00:17:13.577 [2024-11-18T00:59:47.979Z] Total : 14819.00 57.89 0.00 0.00 0.00 0.00 0.00 00:17:13.577 00:17:14.511 01:59:48 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 8b51d6f8-e4bf-4400-9e8d-66a69d96158d 00:17:14.511 [2024-11-18T00:59:48.913Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:14.511 Nvme0n1 : 2.00 15004.00 58.61 0.00 0.00 0.00 0.00 0.00 00:17:14.511 [2024-11-18T00:59:48.913Z] =================================================================================================================== 00:17:14.511 [2024-11-18T00:59:48.913Z] Total : 15004.00 58.61 0.00 0.00 0.00 0.00 0.00 00:17:14.511 00:17:14.769 true 00:17:14.769 01:59:49 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8b51d6f8-e4bf-4400-9e8d-66a69d96158d 00:17:14.769 01:59:49 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:15.026 01:59:49 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:15.026 01:59:49 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:15.026 01:59:49 -- target/nvmf_lvs_grow.sh@65 -- # wait 1197561 00:17:15.592 [2024-11-18T00:59:49.994Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:15.592 Nvme0n1 : 3.00 15022.67 58.68 0.00 0.00 0.00 0.00 0.00 00:17:15.592 [2024-11-18T00:59:49.994Z] =================================================================================================================== 00:17:15.592 [2024-11-18T00:59:49.994Z] Total : 15022.67 58.68 0.00 0.00 0.00 0.00 0.00 00:17:15.592 00:17:16.526 [2024-11-18T00:59:50.928Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:16.526 Nvme0n1 : 4.00 15047.25 58.78 0.00 0.00 0.00 0.00 0.00 00:17:16.526 [2024-11-18T00:59:50.928Z] =================================================================================================================== 00:17:16.526 [2024-11-18T00:59:50.928Z] Total : 15047.25 58.78 0.00 0.00 0.00 0.00 0.00 00:17:16.526 00:17:17.461 [2024-11-18T00:59:51.863Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:17.461 Nvme0n1 : 5.00 15060.80 58.83 0.00 0.00 0.00 0.00 0.00 00:17:17.461 [2024-11-18T00:59:51.863Z] =================================================================================================================== 00:17:17.461 [2024-11-18T00:59:51.863Z] Total : 15060.80 58.83 0.00 0.00 0.00 0.00 0.00 00:17:17.461 00:17:18.835 [2024-11-18T00:59:53.237Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:18.835 Nvme0n1 : 6.00 15119.67 59.06 0.00 0.00 0.00 0.00 0.00 00:17:18.835 [2024-11-18T00:59:53.237Z] =================================================================================================================== 00:17:18.835 [2024-11-18T00:59:53.237Z] Total : 15119.67 59.06 0.00 0.00 0.00 0.00 0.00 00:17:18.835 00:17:19.769 [2024-11-18T00:59:54.171Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:19.769 Nvme0n1 : 7.00 15167.43 59.25 0.00 0.00 0.00 0.00 0.00 00:17:19.769 [2024-11-18T00:59:54.171Z] =================================================================================================================== 00:17:19.769 [2024-11-18T00:59:54.171Z] Total : 15167.43 59.25 0.00 0.00 0.00 0.00 0.00 00:17:19.769 00:17:20.704 [2024-11-18T00:59:55.106Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:20.704 Nvme0n1 : 8.00 15208.75 59.41 0.00 0.00 0.00 0.00 0.00 00:17:20.704 [2024-11-18T00:59:55.106Z] =================================================================================================================== 00:17:20.704 [2024-11-18T00:59:55.106Z] Total : 15208.75 59.41 0.00 0.00 0.00 0.00 0.00 00:17:20.704 00:17:21.637 [2024-11-18T00:59:56.039Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:21.637 Nvme0n1 : 9.00 15255.33 59.59 0.00 0.00 0.00 0.00 0.00 00:17:21.637 [2024-11-18T00:59:56.039Z] =================================================================================================================== 00:17:21.637 [2024-11-18T00:59:56.039Z] Total : 15255.33 59.59 0.00 0.00 0.00 0.00 0.00 00:17:21.638 00:17:22.571 [2024-11-18T00:59:56.973Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:22.571 Nvme0n1 : 10.00 15285.90 59.71 0.00 0.00 0.00 0.00 0.00 00:17:22.571 [2024-11-18T00:59:56.973Z] =================================================================================================================== 00:17:22.571 [2024-11-18T00:59:56.973Z] Total : 15285.90 59.71 0.00 0.00 0.00 0.00 0.00 00:17:22.571 00:17:22.571 00:17:22.571 Latency(us) 00:17:22.571 [2024-11-18T00:59:56.973Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:22.571 [2024-11-18T00:59:56.973Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:22.571 Nvme0n1 : 10.00 15285.68 59.71 0.00 0.00 8368.63 2293.76 16893.72 00:17:22.571 [2024-11-18T00:59:56.973Z] =================================================================================================================== 00:17:22.571 [2024-11-18T00:59:56.973Z] Total : 15285.68 59.71 0.00 0.00 8368.63 2293.76 16893.72 00:17:22.571 0 00:17:22.571 01:59:56 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1197292 00:17:22.571 01:59:56 -- common/autotest_common.sh@936 -- # '[' -z 1197292 ']' 00:17:22.571 01:59:56 -- common/autotest_common.sh@940 -- # kill -0 1197292 00:17:22.571 01:59:56 -- common/autotest_common.sh@941 -- # uname 00:17:22.571 01:59:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:22.571 01:59:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1197292 00:17:22.571 01:59:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:22.571 01:59:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:22.571 01:59:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1197292' 00:17:22.571 killing process with pid 1197292 00:17:22.571 01:59:56 -- common/autotest_common.sh@955 -- # kill 1197292 00:17:22.571 Received shutdown signal, test time was about 10.000000 seconds 00:17:22.571 00:17:22.571 Latency(us) 00:17:22.571 [2024-11-18T00:59:56.973Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:22.571 [2024-11-18T00:59:56.973Z] =================================================================================================================== 00:17:22.572 [2024-11-18T00:59:56.974Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:22.572 01:59:56 -- common/autotest_common.sh@960 -- # wait 1197292 00:17:22.830 01:59:57 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:23.088 01:59:57 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8b51d6f8-e4bf-4400-9e8d-66a69d96158d 00:17:23.088 01:59:57 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:23.346 01:59:57 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:23.346 01:59:57 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:23.346 01:59:57 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:23.605 [2024-11-18 01:59:57.875169] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:23.605 01:59:57 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8b51d6f8-e4bf-4400-9e8d-66a69d96158d 00:17:23.605 01:59:57 -- common/autotest_common.sh@650 -- # local es=0 00:17:23.605 01:59:57 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8b51d6f8-e4bf-4400-9e8d-66a69d96158d 00:17:23.605 01:59:57 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:23.605 01:59:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:23.605 01:59:57 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:23.605 01:59:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:23.605 01:59:57 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:23.605 01:59:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:23.605 01:59:57 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:23.605 01:59:57 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:23.605 01:59:57 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8b51d6f8-e4bf-4400-9e8d-66a69d96158d 00:17:23.864 request: 00:17:23.864 { 00:17:23.864 "uuid": "8b51d6f8-e4bf-4400-9e8d-66a69d96158d", 00:17:23.864 "method": "bdev_lvol_get_lvstores", 00:17:23.864 "req_id": 1 00:17:23.864 } 00:17:23.864 Got JSON-RPC error response 00:17:23.864 response: 00:17:23.864 { 00:17:23.864 "code": -19, 00:17:23.864 "message": "No such device" 00:17:23.864 } 00:17:23.864 01:59:58 -- common/autotest_common.sh@653 -- # es=1 00:17:23.864 01:59:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:23.864 01:59:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:23.864 01:59:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:23.864 01:59:58 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:24.122 aio_bdev 00:17:24.122 01:59:58 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 259c5aa4-7a90-43cf-bbf5-c8f13a95e16a 00:17:24.122 01:59:58 -- common/autotest_common.sh@897 -- # local bdev_name=259c5aa4-7a90-43cf-bbf5-c8f13a95e16a 00:17:24.122 01:59:58 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:24.122 01:59:58 -- common/autotest_common.sh@899 -- # local i 00:17:24.122 01:59:58 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:24.122 01:59:58 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:24.122 01:59:58 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:24.380 01:59:58 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 259c5aa4-7a90-43cf-bbf5-c8f13a95e16a -t 2000 00:17:24.638 [ 00:17:24.638 { 00:17:24.638 "name": "259c5aa4-7a90-43cf-bbf5-c8f13a95e16a", 00:17:24.638 "aliases": [ 00:17:24.638 "lvs/lvol" 00:17:24.638 ], 00:17:24.638 "product_name": "Logical Volume", 00:17:24.638 "block_size": 4096, 00:17:24.638 "num_blocks": 38912, 00:17:24.638 "uuid": "259c5aa4-7a90-43cf-bbf5-c8f13a95e16a", 00:17:24.638 "assigned_rate_limits": { 00:17:24.638 "rw_ios_per_sec": 0, 00:17:24.638 "rw_mbytes_per_sec": 0, 00:17:24.638 "r_mbytes_per_sec": 0, 00:17:24.638 "w_mbytes_per_sec": 0 00:17:24.638 }, 00:17:24.638 "claimed": false, 00:17:24.638 "zoned": false, 00:17:24.638 "supported_io_types": { 00:17:24.638 "read": true, 00:17:24.638 "write": true, 00:17:24.638 "unmap": true, 00:17:24.638 "write_zeroes": true, 00:17:24.638 "flush": false, 00:17:24.638 "reset": true, 00:17:24.638 "compare": false, 00:17:24.638 "compare_and_write": false, 00:17:24.638 "abort": false, 00:17:24.638 "nvme_admin": false, 00:17:24.638 "nvme_io": false 00:17:24.638 }, 00:17:24.638 "driver_specific": { 00:17:24.638 "lvol": { 00:17:24.638 "lvol_store_uuid": "8b51d6f8-e4bf-4400-9e8d-66a69d96158d", 00:17:24.638 "base_bdev": "aio_bdev", 00:17:24.638 "thin_provision": false, 00:17:24.638 "snapshot": false, 00:17:24.638 "clone": false, 00:17:24.638 "esnap_clone": false 00:17:24.638 } 00:17:24.638 } 00:17:24.638 } 00:17:24.638 ] 00:17:24.638 01:59:58 -- common/autotest_common.sh@905 -- # return 0 00:17:24.638 01:59:58 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8b51d6f8-e4bf-4400-9e8d-66a69d96158d 00:17:24.638 01:59:58 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:24.897 01:59:59 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:24.898 01:59:59 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8b51d6f8-e4bf-4400-9e8d-66a69d96158d 00:17:24.898 01:59:59 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:25.160 01:59:59 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:25.160 01:59:59 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 259c5aa4-7a90-43cf-bbf5-c8f13a95e16a 00:17:25.418 01:59:59 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 8b51d6f8-e4bf-4400-9e8d-66a69d96158d 00:17:25.676 02:00:00 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:25.934 02:00:00 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:25.934 00:17:25.934 real 0m17.949s 00:17:25.934 user 0m17.788s 00:17:25.934 sys 0m1.788s 00:17:25.934 02:00:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:25.934 02:00:00 -- common/autotest_common.sh@10 -- # set +x 00:17:25.934 ************************************ 00:17:25.934 END TEST lvs_grow_clean 00:17:25.934 ************************************ 00:17:25.934 02:00:00 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:25.934 02:00:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:25.934 02:00:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:25.934 02:00:00 -- common/autotest_common.sh@10 -- # set +x 00:17:25.934 ************************************ 00:17:25.934 START TEST lvs_grow_dirty 00:17:25.934 ************************************ 00:17:25.934 02:00:00 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:17:25.934 02:00:00 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:25.934 02:00:00 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:25.934 02:00:00 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:25.934 02:00:00 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:25.934 02:00:00 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:25.934 02:00:00 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:25.934 02:00:00 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:25.934 02:00:00 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:25.934 02:00:00 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:26.500 02:00:00 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:26.501 02:00:00 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:26.501 02:00:00 -- target/nvmf_lvs_grow.sh@28 -- # lvs=17884618-4263-48c7-a16b-19592d4f6633 00:17:26.501 02:00:00 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:26.501 02:00:00 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:26.757 02:00:01 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:26.758 02:00:01 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:26.758 02:00:01 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 17884618-4263-48c7-a16b-19592d4f6633 lvol 150 00:17:27.014 02:00:01 -- target/nvmf_lvs_grow.sh@33 -- # lvol=68e2f159-73c1-41af-8912-5d6089acc317 00:17:27.014 02:00:01 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:27.014 02:00:01 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:27.272 [2024-11-18 02:00:01.652769] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:27.272 [2024-11-18 02:00:01.652863] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:27.272 true 00:17:27.272 02:00:01 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:27.272 02:00:01 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:27.531 02:00:01 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:27.531 02:00:01 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:27.789 02:00:02 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 68e2f159-73c1-41af-8912-5d6089acc317 00:17:28.048 02:00:02 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:28.305 02:00:02 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:28.870 02:00:02 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1199642 00:17:28.870 02:00:02 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:28.870 02:00:02 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:28.870 02:00:02 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1199642 /var/tmp/bdevperf.sock 00:17:28.870 02:00:02 -- common/autotest_common.sh@829 -- # '[' -z 1199642 ']' 00:17:28.870 02:00:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:28.870 02:00:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:28.870 02:00:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:28.870 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:28.870 02:00:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:28.870 02:00:02 -- common/autotest_common.sh@10 -- # set +x 00:17:28.870 [2024-11-18 02:00:03.020901] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:28.870 [2024-11-18 02:00:03.020980] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1199642 ] 00:17:28.870 EAL: No free 2048 kB hugepages reported on node 1 00:17:28.870 [2024-11-18 02:00:03.087829] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:28.870 [2024-11-18 02:00:03.176254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:29.801 02:00:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:29.801 02:00:04 -- common/autotest_common.sh@862 -- # return 0 00:17:29.801 02:00:04 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:30.391 Nvme0n1 00:17:30.391 02:00:04 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:30.673 [ 00:17:30.673 { 00:17:30.673 "name": "Nvme0n1", 00:17:30.673 "aliases": [ 00:17:30.673 "68e2f159-73c1-41af-8912-5d6089acc317" 00:17:30.673 ], 00:17:30.673 "product_name": "NVMe disk", 00:17:30.673 "block_size": 4096, 00:17:30.673 "num_blocks": 38912, 00:17:30.673 "uuid": "68e2f159-73c1-41af-8912-5d6089acc317", 00:17:30.673 "assigned_rate_limits": { 00:17:30.673 "rw_ios_per_sec": 0, 00:17:30.673 "rw_mbytes_per_sec": 0, 00:17:30.673 "r_mbytes_per_sec": 0, 00:17:30.673 "w_mbytes_per_sec": 0 00:17:30.673 }, 00:17:30.673 "claimed": false, 00:17:30.673 "zoned": false, 00:17:30.673 "supported_io_types": { 00:17:30.673 "read": true, 00:17:30.673 "write": true, 00:17:30.673 "unmap": true, 00:17:30.673 "write_zeroes": true, 00:17:30.673 "flush": true, 00:17:30.673 "reset": true, 00:17:30.673 "compare": true, 00:17:30.673 "compare_and_write": true, 00:17:30.673 "abort": true, 00:17:30.673 "nvme_admin": true, 00:17:30.673 "nvme_io": true 00:17:30.673 }, 00:17:30.673 "driver_specific": { 00:17:30.673 "nvme": [ 00:17:30.673 { 00:17:30.673 "trid": { 00:17:30.673 "trtype": "TCP", 00:17:30.673 "adrfam": "IPv4", 00:17:30.673 "traddr": "10.0.0.2", 00:17:30.673 "trsvcid": "4420", 00:17:30.673 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:30.673 }, 00:17:30.673 "ctrlr_data": { 00:17:30.673 "cntlid": 1, 00:17:30.673 "vendor_id": "0x8086", 00:17:30.673 "model_number": "SPDK bdev Controller", 00:17:30.673 "serial_number": "SPDK0", 00:17:30.673 "firmware_revision": "24.01.1", 00:17:30.673 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:30.673 "oacs": { 00:17:30.673 "security": 0, 00:17:30.673 "format": 0, 00:17:30.673 "firmware": 0, 00:17:30.673 "ns_manage": 0 00:17:30.673 }, 00:17:30.673 "multi_ctrlr": true, 00:17:30.673 "ana_reporting": false 00:17:30.673 }, 00:17:30.673 "vs": { 00:17:30.673 "nvme_version": "1.3" 00:17:30.673 }, 00:17:30.673 "ns_data": { 00:17:30.673 "id": 1, 00:17:30.673 "can_share": true 00:17:30.673 } 00:17:30.673 } 00:17:30.673 ], 00:17:30.673 "mp_policy": "active_passive" 00:17:30.673 } 00:17:30.673 } 00:17:30.673 ] 00:17:30.673 02:00:04 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1199915 00:17:30.673 02:00:04 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:30.673 02:00:04 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:30.673 Running I/O for 10 seconds... 00:17:31.607 Latency(us) 00:17:31.607 [2024-11-18T01:00:06.009Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:31.607 [2024-11-18T01:00:06.009Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:31.607 Nvme0n1 : 1.00 14770.00 57.70 0.00 0.00 0.00 0.00 0.00 00:17:31.607 [2024-11-18T01:00:06.009Z] =================================================================================================================== 00:17:31.607 [2024-11-18T01:00:06.009Z] Total : 14770.00 57.70 0.00 0.00 0.00 0.00 0.00 00:17:31.607 00:17:32.543 02:00:06 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:32.801 [2024-11-18T01:00:07.204Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:32.802 Nvme0n1 : 2.00 14863.50 58.06 0.00 0.00 0.00 0.00 0.00 00:17:32.802 [2024-11-18T01:00:07.204Z] =================================================================================================================== 00:17:32.802 [2024-11-18T01:00:07.204Z] Total : 14863.50 58.06 0.00 0.00 0.00 0.00 0.00 00:17:32.802 00:17:32.802 true 00:17:32.802 02:00:07 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:32.802 02:00:07 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:33.061 02:00:07 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:33.061 02:00:07 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:33.061 02:00:07 -- target/nvmf_lvs_grow.sh@65 -- # wait 1199915 00:17:33.625 [2024-11-18T01:00:08.027Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:33.625 Nvme0n1 : 3.00 14948.67 58.39 0.00 0.00 0.00 0.00 0.00 00:17:33.625 [2024-11-18T01:00:08.028Z] =================================================================================================================== 00:17:33.626 [2024-11-18T01:00:08.028Z] Total : 14948.67 58.39 0.00 0.00 0.00 0.00 0.00 00:17:33.626 00:17:35.002 [2024-11-18T01:00:09.404Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:35.002 Nvme0n1 : 4.00 15021.50 58.68 0.00 0.00 0.00 0.00 0.00 00:17:35.002 [2024-11-18T01:00:09.404Z] =================================================================================================================== 00:17:35.002 [2024-11-18T01:00:09.404Z] Total : 15021.50 58.68 0.00 0.00 0.00 0.00 0.00 00:17:35.002 00:17:35.936 [2024-11-18T01:00:10.338Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:35.936 Nvme0n1 : 5.00 15078.80 58.90 0.00 0.00 0.00 0.00 0.00 00:17:35.936 [2024-11-18T01:00:10.338Z] =================================================================================================================== 00:17:35.936 [2024-11-18T01:00:10.338Z] Total : 15078.80 58.90 0.00 0.00 0.00 0.00 0.00 00:17:35.936 00:17:36.870 [2024-11-18T01:00:11.272Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:36.870 Nvme0n1 : 6.00 15111.33 59.03 0.00 0.00 0.00 0.00 0.00 00:17:36.870 [2024-11-18T01:00:11.272Z] =================================================================================================================== 00:17:36.870 [2024-11-18T01:00:11.272Z] Total : 15111.33 59.03 0.00 0.00 0.00 0.00 0.00 00:17:36.870 00:17:37.803 [2024-11-18T01:00:12.205Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:37.803 Nvme0n1 : 7.00 15166.00 59.24 0.00 0.00 0.00 0.00 0.00 00:17:37.803 [2024-11-18T01:00:12.205Z] =================================================================================================================== 00:17:37.803 [2024-11-18T01:00:12.205Z] Total : 15166.00 59.24 0.00 0.00 0.00 0.00 0.00 00:17:37.803 00:17:38.738 [2024-11-18T01:00:13.140Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:38.738 Nvme0n1 : 8.00 15215.00 59.43 0.00 0.00 0.00 0.00 0.00 00:17:38.738 [2024-11-18T01:00:13.140Z] =================================================================================================================== 00:17:38.738 [2024-11-18T01:00:13.140Z] Total : 15215.00 59.43 0.00 0.00 0.00 0.00 0.00 00:17:38.738 00:17:39.672 [2024-11-18T01:00:14.074Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:39.672 Nvme0n1 : 9.00 15253.11 59.58 0.00 0.00 0.00 0.00 0.00 00:17:39.672 [2024-11-18T01:00:14.074Z] =================================================================================================================== 00:17:39.672 [2024-11-18T01:00:14.074Z] Total : 15253.11 59.58 0.00 0.00 0.00 0.00 0.00 00:17:39.672 00:17:40.607 [2024-11-18T01:00:15.009Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.607 Nvme0n1 : 10.00 15277.20 59.68 0.00 0.00 0.00 0.00 0.00 00:17:40.607 [2024-11-18T01:00:15.009Z] =================================================================================================================== 00:17:40.607 [2024-11-18T01:00:15.009Z] Total : 15277.20 59.68 0.00 0.00 0.00 0.00 0.00 00:17:40.607 00:17:40.607 00:17:40.607 Latency(us) 00:17:40.607 [2024-11-18T01:00:15.009Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:40.607 [2024-11-18T01:00:15.009Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.607 Nvme0n1 : 10.01 15280.88 59.69 0.00 0.00 8372.15 2245.21 16602.45 00:17:40.607 [2024-11-18T01:00:15.009Z] =================================================================================================================== 00:17:40.607 [2024-11-18T01:00:15.009Z] Total : 15280.88 59.69 0.00 0.00 8372.15 2245.21 16602.45 00:17:40.607 0 00:17:40.607 02:00:15 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1199642 00:17:40.607 02:00:15 -- common/autotest_common.sh@936 -- # '[' -z 1199642 ']' 00:17:40.607 02:00:15 -- common/autotest_common.sh@940 -- # kill -0 1199642 00:17:40.607 02:00:15 -- common/autotest_common.sh@941 -- # uname 00:17:40.865 02:00:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:40.865 02:00:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1199642 00:17:40.865 02:00:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:40.865 02:00:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:40.866 02:00:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1199642' 00:17:40.866 killing process with pid 1199642 00:17:40.866 02:00:15 -- common/autotest_common.sh@955 -- # kill 1199642 00:17:40.866 Received shutdown signal, test time was about 10.000000 seconds 00:17:40.866 00:17:40.866 Latency(us) 00:17:40.866 [2024-11-18T01:00:15.268Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:40.866 [2024-11-18T01:00:15.268Z] =================================================================================================================== 00:17:40.866 [2024-11-18T01:00:15.268Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:40.866 02:00:15 -- common/autotest_common.sh@960 -- # wait 1199642 00:17:40.866 02:00:15 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:41.124 02:00:15 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:41.124 02:00:15 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:41.383 02:00:15 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:41.383 02:00:15 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:17:41.383 02:00:15 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1196828 00:17:41.383 02:00:15 -- target/nvmf_lvs_grow.sh@74 -- # wait 1196828 00:17:41.642 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1196828 Killed "${NVMF_APP[@]}" "$@" 00:17:41.642 02:00:15 -- target/nvmf_lvs_grow.sh@74 -- # true 00:17:41.642 02:00:15 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:17:41.642 02:00:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:41.642 02:00:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:41.642 02:00:15 -- common/autotest_common.sh@10 -- # set +x 00:17:41.642 02:00:15 -- nvmf/common.sh@469 -- # nvmfpid=1201661 00:17:41.642 02:00:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:41.642 02:00:15 -- nvmf/common.sh@470 -- # waitforlisten 1201661 00:17:41.642 02:00:15 -- common/autotest_common.sh@829 -- # '[' -z 1201661 ']' 00:17:41.642 02:00:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:41.642 02:00:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:41.642 02:00:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:41.642 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:41.642 02:00:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:41.642 02:00:15 -- common/autotest_common.sh@10 -- # set +x 00:17:41.642 [2024-11-18 02:00:15.843633] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:41.642 [2024-11-18 02:00:15.843751] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:41.642 EAL: No free 2048 kB hugepages reported on node 1 00:17:41.642 [2024-11-18 02:00:15.914501] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:41.642 [2024-11-18 02:00:16.004647] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:41.642 [2024-11-18 02:00:16.004802] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:41.642 [2024-11-18 02:00:16.004820] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:41.642 [2024-11-18 02:00:16.004832] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:41.642 [2024-11-18 02:00:16.004860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:42.577 02:00:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:42.577 02:00:16 -- common/autotest_common.sh@862 -- # return 0 00:17:42.577 02:00:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:42.577 02:00:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:42.577 02:00:16 -- common/autotest_common.sh@10 -- # set +x 00:17:42.577 02:00:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:42.577 02:00:16 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:42.835 [2024-11-18 02:00:17.079474] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:17:42.835 [2024-11-18 02:00:17.079611] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:17:42.835 [2024-11-18 02:00:17.079676] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:17:42.835 02:00:17 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:17:42.835 02:00:17 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 68e2f159-73c1-41af-8912-5d6089acc317 00:17:42.835 02:00:17 -- common/autotest_common.sh@897 -- # local bdev_name=68e2f159-73c1-41af-8912-5d6089acc317 00:17:42.835 02:00:17 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:42.835 02:00:17 -- common/autotest_common.sh@899 -- # local i 00:17:42.835 02:00:17 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:42.835 02:00:17 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:42.835 02:00:17 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:43.094 02:00:17 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 68e2f159-73c1-41af-8912-5d6089acc317 -t 2000 00:17:43.353 [ 00:17:43.353 { 00:17:43.353 "name": "68e2f159-73c1-41af-8912-5d6089acc317", 00:17:43.353 "aliases": [ 00:17:43.353 "lvs/lvol" 00:17:43.353 ], 00:17:43.353 "product_name": "Logical Volume", 00:17:43.353 "block_size": 4096, 00:17:43.353 "num_blocks": 38912, 00:17:43.353 "uuid": "68e2f159-73c1-41af-8912-5d6089acc317", 00:17:43.353 "assigned_rate_limits": { 00:17:43.353 "rw_ios_per_sec": 0, 00:17:43.353 "rw_mbytes_per_sec": 0, 00:17:43.353 "r_mbytes_per_sec": 0, 00:17:43.353 "w_mbytes_per_sec": 0 00:17:43.353 }, 00:17:43.353 "claimed": false, 00:17:43.353 "zoned": false, 00:17:43.353 "supported_io_types": { 00:17:43.353 "read": true, 00:17:43.353 "write": true, 00:17:43.353 "unmap": true, 00:17:43.353 "write_zeroes": true, 00:17:43.353 "flush": false, 00:17:43.353 "reset": true, 00:17:43.353 "compare": false, 00:17:43.353 "compare_and_write": false, 00:17:43.353 "abort": false, 00:17:43.353 "nvme_admin": false, 00:17:43.353 "nvme_io": false 00:17:43.353 }, 00:17:43.353 "driver_specific": { 00:17:43.353 "lvol": { 00:17:43.353 "lvol_store_uuid": "17884618-4263-48c7-a16b-19592d4f6633", 00:17:43.353 "base_bdev": "aio_bdev", 00:17:43.353 "thin_provision": false, 00:17:43.353 "snapshot": false, 00:17:43.353 "clone": false, 00:17:43.353 "esnap_clone": false 00:17:43.353 } 00:17:43.353 } 00:17:43.353 } 00:17:43.353 ] 00:17:43.353 02:00:17 -- common/autotest_common.sh@905 -- # return 0 00:17:43.353 02:00:17 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:43.353 02:00:17 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:17:43.611 02:00:17 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:17:43.611 02:00:17 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:43.611 02:00:17 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:17:43.869 02:00:18 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:17:43.869 02:00:18 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:44.127 [2024-11-18 02:00:18.448747] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:44.127 02:00:18 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:44.127 02:00:18 -- common/autotest_common.sh@650 -- # local es=0 00:17:44.127 02:00:18 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:44.127 02:00:18 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:44.127 02:00:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:44.127 02:00:18 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:44.127 02:00:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:44.127 02:00:18 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:44.127 02:00:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:44.127 02:00:18 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:44.127 02:00:18 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:44.127 02:00:18 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:44.385 request: 00:17:44.385 { 00:17:44.385 "uuid": "17884618-4263-48c7-a16b-19592d4f6633", 00:17:44.385 "method": "bdev_lvol_get_lvstores", 00:17:44.385 "req_id": 1 00:17:44.385 } 00:17:44.385 Got JSON-RPC error response 00:17:44.385 response: 00:17:44.385 { 00:17:44.385 "code": -19, 00:17:44.385 "message": "No such device" 00:17:44.385 } 00:17:44.385 02:00:18 -- common/autotest_common.sh@653 -- # es=1 00:17:44.385 02:00:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:44.385 02:00:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:44.385 02:00:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:44.385 02:00:18 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:44.643 aio_bdev 00:17:44.643 02:00:19 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 68e2f159-73c1-41af-8912-5d6089acc317 00:17:44.643 02:00:19 -- common/autotest_common.sh@897 -- # local bdev_name=68e2f159-73c1-41af-8912-5d6089acc317 00:17:44.643 02:00:19 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:44.643 02:00:19 -- common/autotest_common.sh@899 -- # local i 00:17:44.643 02:00:19 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:44.643 02:00:19 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:44.643 02:00:19 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:45.209 02:00:19 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 68e2f159-73c1-41af-8912-5d6089acc317 -t 2000 00:17:45.209 [ 00:17:45.209 { 00:17:45.209 "name": "68e2f159-73c1-41af-8912-5d6089acc317", 00:17:45.209 "aliases": [ 00:17:45.209 "lvs/lvol" 00:17:45.209 ], 00:17:45.209 "product_name": "Logical Volume", 00:17:45.209 "block_size": 4096, 00:17:45.209 "num_blocks": 38912, 00:17:45.209 "uuid": "68e2f159-73c1-41af-8912-5d6089acc317", 00:17:45.209 "assigned_rate_limits": { 00:17:45.209 "rw_ios_per_sec": 0, 00:17:45.209 "rw_mbytes_per_sec": 0, 00:17:45.209 "r_mbytes_per_sec": 0, 00:17:45.209 "w_mbytes_per_sec": 0 00:17:45.209 }, 00:17:45.209 "claimed": false, 00:17:45.209 "zoned": false, 00:17:45.209 "supported_io_types": { 00:17:45.209 "read": true, 00:17:45.209 "write": true, 00:17:45.209 "unmap": true, 00:17:45.209 "write_zeroes": true, 00:17:45.209 "flush": false, 00:17:45.209 "reset": true, 00:17:45.209 "compare": false, 00:17:45.209 "compare_and_write": false, 00:17:45.209 "abort": false, 00:17:45.209 "nvme_admin": false, 00:17:45.209 "nvme_io": false 00:17:45.209 }, 00:17:45.209 "driver_specific": { 00:17:45.209 "lvol": { 00:17:45.209 "lvol_store_uuid": "17884618-4263-48c7-a16b-19592d4f6633", 00:17:45.209 "base_bdev": "aio_bdev", 00:17:45.209 "thin_provision": false, 00:17:45.209 "snapshot": false, 00:17:45.209 "clone": false, 00:17:45.209 "esnap_clone": false 00:17:45.209 } 00:17:45.209 } 00:17:45.209 } 00:17:45.209 ] 00:17:45.467 02:00:19 -- common/autotest_common.sh@905 -- # return 0 00:17:45.467 02:00:19 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:45.467 02:00:19 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:45.725 02:00:19 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:45.725 02:00:19 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:45.725 02:00:19 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:45.983 02:00:20 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:45.983 02:00:20 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 68e2f159-73c1-41af-8912-5d6089acc317 00:17:46.242 02:00:20 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 17884618-4263-48c7-a16b-19592d4f6633 00:17:46.500 02:00:20 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:46.758 02:00:20 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:46.758 00:17:46.758 real 0m20.629s 00:17:46.758 user 0m51.695s 00:17:46.758 sys 0m4.524s 00:17:46.758 02:00:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:46.758 02:00:20 -- common/autotest_common.sh@10 -- # set +x 00:17:46.758 ************************************ 00:17:46.758 END TEST lvs_grow_dirty 00:17:46.758 ************************************ 00:17:46.758 02:00:20 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:17:46.758 02:00:20 -- common/autotest_common.sh@806 -- # type=--id 00:17:46.758 02:00:20 -- common/autotest_common.sh@807 -- # id=0 00:17:46.758 02:00:20 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:17:46.758 02:00:20 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:46.758 02:00:20 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:17:46.758 02:00:20 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:17:46.758 02:00:20 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:17:46.758 02:00:20 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:46.758 nvmf_trace.0 00:17:46.758 02:00:20 -- common/autotest_common.sh@821 -- # return 0 00:17:46.758 02:00:20 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:17:46.758 02:00:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:46.758 02:00:20 -- nvmf/common.sh@116 -- # sync 00:17:46.758 02:00:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:46.758 02:00:21 -- nvmf/common.sh@119 -- # set +e 00:17:46.758 02:00:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:46.758 02:00:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:46.758 rmmod nvme_tcp 00:17:46.758 rmmod nvme_fabrics 00:17:46.758 rmmod nvme_keyring 00:17:46.758 02:00:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:46.758 02:00:21 -- nvmf/common.sh@123 -- # set -e 00:17:46.758 02:00:21 -- nvmf/common.sh@124 -- # return 0 00:17:46.758 02:00:21 -- nvmf/common.sh@477 -- # '[' -n 1201661 ']' 00:17:46.758 02:00:21 -- nvmf/common.sh@478 -- # killprocess 1201661 00:17:46.758 02:00:21 -- common/autotest_common.sh@936 -- # '[' -z 1201661 ']' 00:17:46.758 02:00:21 -- common/autotest_common.sh@940 -- # kill -0 1201661 00:17:46.758 02:00:21 -- common/autotest_common.sh@941 -- # uname 00:17:46.758 02:00:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:46.758 02:00:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1201661 00:17:46.758 02:00:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:46.758 02:00:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:46.758 02:00:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1201661' 00:17:46.758 killing process with pid 1201661 00:17:46.758 02:00:21 -- common/autotest_common.sh@955 -- # kill 1201661 00:17:46.758 02:00:21 -- common/autotest_common.sh@960 -- # wait 1201661 00:17:47.016 02:00:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:47.016 02:00:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:47.016 02:00:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:47.016 02:00:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:47.016 02:00:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:47.016 02:00:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:47.016 02:00:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:47.016 02:00:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:49.551 02:00:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:49.551 00:17:49.551 real 0m44.867s 00:17:49.551 user 1m16.463s 00:17:49.551 sys 0m8.240s 00:17:49.551 02:00:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:49.551 02:00:23 -- common/autotest_common.sh@10 -- # set +x 00:17:49.551 ************************************ 00:17:49.551 END TEST nvmf_lvs_grow 00:17:49.551 ************************************ 00:17:49.551 02:00:23 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:49.551 02:00:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:49.551 02:00:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:49.551 02:00:23 -- common/autotest_common.sh@10 -- # set +x 00:17:49.551 ************************************ 00:17:49.551 START TEST nvmf_bdev_io_wait 00:17:49.551 ************************************ 00:17:49.551 02:00:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:49.551 * Looking for test storage... 00:17:49.551 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:49.551 02:00:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:49.551 02:00:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:49.551 02:00:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:49.551 02:00:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:49.551 02:00:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:49.551 02:00:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:49.551 02:00:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:49.551 02:00:23 -- scripts/common.sh@335 -- # IFS=.-: 00:17:49.551 02:00:23 -- scripts/common.sh@335 -- # read -ra ver1 00:17:49.551 02:00:23 -- scripts/common.sh@336 -- # IFS=.-: 00:17:49.551 02:00:23 -- scripts/common.sh@336 -- # read -ra ver2 00:17:49.551 02:00:23 -- scripts/common.sh@337 -- # local 'op=<' 00:17:49.551 02:00:23 -- scripts/common.sh@339 -- # ver1_l=2 00:17:49.551 02:00:23 -- scripts/common.sh@340 -- # ver2_l=1 00:17:49.551 02:00:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:49.551 02:00:23 -- scripts/common.sh@343 -- # case "$op" in 00:17:49.551 02:00:23 -- scripts/common.sh@344 -- # : 1 00:17:49.551 02:00:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:49.551 02:00:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:49.551 02:00:23 -- scripts/common.sh@364 -- # decimal 1 00:17:49.551 02:00:23 -- scripts/common.sh@352 -- # local d=1 00:17:49.551 02:00:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:49.551 02:00:23 -- scripts/common.sh@354 -- # echo 1 00:17:49.551 02:00:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:49.551 02:00:23 -- scripts/common.sh@365 -- # decimal 2 00:17:49.551 02:00:23 -- scripts/common.sh@352 -- # local d=2 00:17:49.551 02:00:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:49.551 02:00:23 -- scripts/common.sh@354 -- # echo 2 00:17:49.551 02:00:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:49.551 02:00:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:49.551 02:00:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:49.551 02:00:23 -- scripts/common.sh@367 -- # return 0 00:17:49.551 02:00:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:49.551 02:00:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:49.551 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:49.551 --rc genhtml_branch_coverage=1 00:17:49.551 --rc genhtml_function_coverage=1 00:17:49.551 --rc genhtml_legend=1 00:17:49.551 --rc geninfo_all_blocks=1 00:17:49.551 --rc geninfo_unexecuted_blocks=1 00:17:49.551 00:17:49.551 ' 00:17:49.551 02:00:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:49.551 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:49.551 --rc genhtml_branch_coverage=1 00:17:49.551 --rc genhtml_function_coverage=1 00:17:49.551 --rc genhtml_legend=1 00:17:49.551 --rc geninfo_all_blocks=1 00:17:49.551 --rc geninfo_unexecuted_blocks=1 00:17:49.551 00:17:49.551 ' 00:17:49.551 02:00:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:49.551 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:49.551 --rc genhtml_branch_coverage=1 00:17:49.551 --rc genhtml_function_coverage=1 00:17:49.551 --rc genhtml_legend=1 00:17:49.551 --rc geninfo_all_blocks=1 00:17:49.552 --rc geninfo_unexecuted_blocks=1 00:17:49.552 00:17:49.552 ' 00:17:49.552 02:00:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:49.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:49.552 --rc genhtml_branch_coverage=1 00:17:49.552 --rc genhtml_function_coverage=1 00:17:49.552 --rc genhtml_legend=1 00:17:49.552 --rc geninfo_all_blocks=1 00:17:49.552 --rc geninfo_unexecuted_blocks=1 00:17:49.552 00:17:49.552 ' 00:17:49.552 02:00:23 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:49.552 02:00:23 -- nvmf/common.sh@7 -- # uname -s 00:17:49.552 02:00:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:49.552 02:00:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:49.552 02:00:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:49.552 02:00:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:49.552 02:00:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:49.552 02:00:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:49.552 02:00:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:49.552 02:00:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:49.552 02:00:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:49.552 02:00:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:49.552 02:00:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:49.552 02:00:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:49.552 02:00:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:49.552 02:00:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:49.552 02:00:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:49.552 02:00:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:49.552 02:00:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:49.552 02:00:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:49.552 02:00:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:49.552 02:00:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:49.552 02:00:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:49.552 02:00:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:49.552 02:00:23 -- paths/export.sh@5 -- # export PATH 00:17:49.552 02:00:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:49.552 02:00:23 -- nvmf/common.sh@46 -- # : 0 00:17:49.552 02:00:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:49.552 02:00:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:49.552 02:00:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:49.552 02:00:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:49.552 02:00:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:49.552 02:00:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:49.552 02:00:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:49.552 02:00:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:49.552 02:00:23 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:49.552 02:00:23 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:49.552 02:00:23 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:17:49.552 02:00:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:49.552 02:00:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:49.552 02:00:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:49.552 02:00:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:49.552 02:00:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:49.552 02:00:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:49.552 02:00:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:49.552 02:00:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:49.552 02:00:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:49.552 02:00:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:49.552 02:00:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:49.552 02:00:23 -- common/autotest_common.sh@10 -- # set +x 00:17:51.452 02:00:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:51.453 02:00:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:51.453 02:00:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:51.453 02:00:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:51.453 02:00:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:51.453 02:00:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:51.453 02:00:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:51.453 02:00:25 -- nvmf/common.sh@294 -- # net_devs=() 00:17:51.453 02:00:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:51.453 02:00:25 -- nvmf/common.sh@295 -- # e810=() 00:17:51.453 02:00:25 -- nvmf/common.sh@295 -- # local -ga e810 00:17:51.453 02:00:25 -- nvmf/common.sh@296 -- # x722=() 00:17:51.453 02:00:25 -- nvmf/common.sh@296 -- # local -ga x722 00:17:51.453 02:00:25 -- nvmf/common.sh@297 -- # mlx=() 00:17:51.453 02:00:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:51.453 02:00:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:51.453 02:00:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:51.453 02:00:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:51.453 02:00:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:51.453 02:00:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:51.453 02:00:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:51.453 02:00:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:51.453 02:00:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:51.453 02:00:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:51.453 02:00:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:51.453 02:00:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:51.453 02:00:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:51.453 02:00:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:51.453 02:00:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:51.453 02:00:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:51.453 02:00:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:51.453 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:51.453 02:00:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:51.453 02:00:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:51.453 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:51.453 02:00:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:51.453 02:00:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:51.453 02:00:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:51.453 02:00:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:51.453 02:00:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:51.453 02:00:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:51.453 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:51.453 02:00:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:51.453 02:00:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:51.453 02:00:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:51.453 02:00:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:51.453 02:00:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:51.453 02:00:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:51.453 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:51.453 02:00:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:51.453 02:00:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:51.453 02:00:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:51.453 02:00:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:51.453 02:00:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:51.453 02:00:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:51.453 02:00:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:51.453 02:00:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:51.453 02:00:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:51.453 02:00:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:51.453 02:00:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:51.453 02:00:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:51.453 02:00:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:51.453 02:00:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:51.453 02:00:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:51.453 02:00:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:51.453 02:00:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:51.453 02:00:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:51.453 02:00:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:51.453 02:00:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:51.453 02:00:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:51.453 02:00:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:51.453 02:00:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:51.453 02:00:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:51.453 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:51.453 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.288 ms 00:17:51.453 00:17:51.453 --- 10.0.0.2 ping statistics --- 00:17:51.453 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:51.453 rtt min/avg/max/mdev = 0.288/0.288/0.288/0.000 ms 00:17:51.453 02:00:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:51.453 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:51.453 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.155 ms 00:17:51.453 00:17:51.453 --- 10.0.0.1 ping statistics --- 00:17:51.453 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:51.453 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:17:51.453 02:00:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:51.453 02:00:25 -- nvmf/common.sh@410 -- # return 0 00:17:51.453 02:00:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:51.453 02:00:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:51.453 02:00:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:51.453 02:00:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:51.453 02:00:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:51.453 02:00:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:51.453 02:00:25 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:17:51.453 02:00:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:51.453 02:00:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:51.453 02:00:25 -- common/autotest_common.sh@10 -- # set +x 00:17:51.453 02:00:25 -- nvmf/common.sh@469 -- # nvmfpid=1204351 00:17:51.453 02:00:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:17:51.453 02:00:25 -- nvmf/common.sh@470 -- # waitforlisten 1204351 00:17:51.453 02:00:25 -- common/autotest_common.sh@829 -- # '[' -z 1204351 ']' 00:17:51.453 02:00:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:51.453 02:00:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:51.453 02:00:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:51.453 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:51.453 02:00:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:51.453 02:00:25 -- common/autotest_common.sh@10 -- # set +x 00:17:51.453 [2024-11-18 02:00:25.667982] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:51.453 [2024-11-18 02:00:25.668067] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:51.453 EAL: No free 2048 kB hugepages reported on node 1 00:17:51.453 [2024-11-18 02:00:25.736106] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:51.453 [2024-11-18 02:00:25.828603] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:51.453 [2024-11-18 02:00:25.828748] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:51.453 [2024-11-18 02:00:25.828766] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:51.453 [2024-11-18 02:00:25.828778] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:51.453 [2024-11-18 02:00:25.831336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:51.453 [2024-11-18 02:00:25.831384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:51.453 [2024-11-18 02:00:25.831467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:51.453 [2024-11-18 02:00:25.831471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:51.712 02:00:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:51.712 02:00:25 -- common/autotest_common.sh@862 -- # return 0 00:17:51.712 02:00:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:51.712 02:00:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:51.712 02:00:25 -- common/autotest_common.sh@10 -- # set +x 00:17:51.712 02:00:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:51.712 02:00:25 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:17:51.712 02:00:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:51.712 02:00:25 -- common/autotest_common.sh@10 -- # set +x 00:17:51.712 02:00:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:51.712 02:00:25 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:17:51.712 02:00:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:51.712 02:00:25 -- common/autotest_common.sh@10 -- # set +x 00:17:51.712 02:00:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:51.712 02:00:25 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:51.712 02:00:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:51.712 02:00:25 -- common/autotest_common.sh@10 -- # set +x 00:17:51.712 [2024-11-18 02:00:25.997748] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:51.712 02:00:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:51.712 02:00:26 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:51.712 02:00:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:51.712 02:00:26 -- common/autotest_common.sh@10 -- # set +x 00:17:51.712 Malloc0 00:17:51.712 02:00:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:51.712 02:00:26 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:51.712 02:00:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:51.712 02:00:26 -- common/autotest_common.sh@10 -- # set +x 00:17:51.712 02:00:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:51.712 02:00:26 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:51.712 02:00:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:51.712 02:00:26 -- common/autotest_common.sh@10 -- # set +x 00:17:51.712 02:00:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:51.712 02:00:26 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:51.712 02:00:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:51.712 02:00:26 -- common/autotest_common.sh@10 -- # set +x 00:17:51.712 [2024-11-18 02:00:26.061944] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:51.712 02:00:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:51.712 02:00:26 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1204393 00:17:51.712 02:00:26 -- target/bdev_io_wait.sh@30 -- # READ_PID=1204395 00:17:51.712 02:00:26 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:17:51.712 02:00:26 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:17:51.712 02:00:26 -- nvmf/common.sh@520 -- # config=() 00:17:51.712 02:00:26 -- nvmf/common.sh@520 -- # local subsystem config 00:17:51.712 02:00:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:51.712 02:00:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:51.712 { 00:17:51.712 "params": { 00:17:51.713 "name": "Nvme$subsystem", 00:17:51.713 "trtype": "$TEST_TRANSPORT", 00:17:51.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:51.713 "adrfam": "ipv4", 00:17:51.713 "trsvcid": "$NVMF_PORT", 00:17:51.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:51.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:51.713 "hdgst": ${hdgst:-false}, 00:17:51.713 "ddgst": ${ddgst:-false} 00:17:51.713 }, 00:17:51.713 "method": "bdev_nvme_attach_controller" 00:17:51.713 } 00:17:51.713 EOF 00:17:51.713 )") 00:17:51.713 02:00:26 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1204398 00:17:51.713 02:00:26 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:17:51.713 02:00:26 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:17:51.713 02:00:26 -- nvmf/common.sh@520 -- # config=() 00:17:51.713 02:00:26 -- nvmf/common.sh@520 -- # local subsystem config 00:17:51.713 02:00:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:51.713 02:00:26 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:17:51.713 02:00:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:51.713 { 00:17:51.713 "params": { 00:17:51.713 "name": "Nvme$subsystem", 00:17:51.713 "trtype": "$TEST_TRANSPORT", 00:17:51.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:51.713 "adrfam": "ipv4", 00:17:51.713 "trsvcid": "$NVMF_PORT", 00:17:51.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:51.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:51.713 "hdgst": ${hdgst:-false}, 00:17:51.713 "ddgst": ${ddgst:-false} 00:17:51.713 }, 00:17:51.713 "method": "bdev_nvme_attach_controller" 00:17:51.713 } 00:17:51.713 EOF 00:17:51.713 )") 00:17:51.713 02:00:26 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1204402 00:17:51.713 02:00:26 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:17:51.713 02:00:26 -- target/bdev_io_wait.sh@35 -- # sync 00:17:51.713 02:00:26 -- nvmf/common.sh@520 -- # config=() 00:17:51.713 02:00:26 -- nvmf/common.sh@542 -- # cat 00:17:51.713 02:00:26 -- nvmf/common.sh@520 -- # local subsystem config 00:17:51.713 02:00:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:51.713 02:00:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:51.713 { 00:17:51.713 "params": { 00:17:51.713 "name": "Nvme$subsystem", 00:17:51.713 "trtype": "$TEST_TRANSPORT", 00:17:51.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:51.713 "adrfam": "ipv4", 00:17:51.713 "trsvcid": "$NVMF_PORT", 00:17:51.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:51.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:51.713 "hdgst": ${hdgst:-false}, 00:17:51.713 "ddgst": ${ddgst:-false} 00:17:51.713 }, 00:17:51.713 "method": "bdev_nvme_attach_controller" 00:17:51.713 } 00:17:51.713 EOF 00:17:51.713 )") 00:17:51.713 02:00:26 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:17:51.713 02:00:26 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:17:51.713 02:00:26 -- nvmf/common.sh@520 -- # config=() 00:17:51.713 02:00:26 -- nvmf/common.sh@542 -- # cat 00:17:51.713 02:00:26 -- nvmf/common.sh@520 -- # local subsystem config 00:17:51.713 02:00:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:51.713 02:00:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:51.713 { 00:17:51.713 "params": { 00:17:51.713 "name": "Nvme$subsystem", 00:17:51.713 "trtype": "$TEST_TRANSPORT", 00:17:51.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:51.713 "adrfam": "ipv4", 00:17:51.713 "trsvcid": "$NVMF_PORT", 00:17:51.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:51.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:51.713 "hdgst": ${hdgst:-false}, 00:17:51.713 "ddgst": ${ddgst:-false} 00:17:51.713 }, 00:17:51.713 "method": "bdev_nvme_attach_controller" 00:17:51.713 } 00:17:51.713 EOF 00:17:51.713 )") 00:17:51.713 02:00:26 -- nvmf/common.sh@542 -- # cat 00:17:51.713 02:00:26 -- target/bdev_io_wait.sh@37 -- # wait 1204393 00:17:51.713 02:00:26 -- nvmf/common.sh@542 -- # cat 00:17:51.713 02:00:26 -- nvmf/common.sh@544 -- # jq . 00:17:51.713 02:00:26 -- nvmf/common.sh@544 -- # jq . 00:17:51.713 02:00:26 -- nvmf/common.sh@544 -- # jq . 00:17:51.713 02:00:26 -- nvmf/common.sh@545 -- # IFS=, 00:17:51.713 02:00:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:51.713 "params": { 00:17:51.713 "name": "Nvme1", 00:17:51.713 "trtype": "tcp", 00:17:51.713 "traddr": "10.0.0.2", 00:17:51.713 "adrfam": "ipv4", 00:17:51.713 "trsvcid": "4420", 00:17:51.713 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:51.713 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:51.713 "hdgst": false, 00:17:51.713 "ddgst": false 00:17:51.713 }, 00:17:51.713 "method": "bdev_nvme_attach_controller" 00:17:51.713 }' 00:17:51.713 02:00:26 -- nvmf/common.sh@544 -- # jq . 00:17:51.713 02:00:26 -- nvmf/common.sh@545 -- # IFS=, 00:17:51.713 02:00:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:51.713 "params": { 00:17:51.713 "name": "Nvme1", 00:17:51.713 "trtype": "tcp", 00:17:51.713 "traddr": "10.0.0.2", 00:17:51.713 "adrfam": "ipv4", 00:17:51.713 "trsvcid": "4420", 00:17:51.713 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:51.713 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:51.713 "hdgst": false, 00:17:51.713 "ddgst": false 00:17:51.713 }, 00:17:51.713 "method": "bdev_nvme_attach_controller" 00:17:51.713 }' 00:17:51.713 02:00:26 -- nvmf/common.sh@545 -- # IFS=, 00:17:51.713 02:00:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:51.713 "params": { 00:17:51.713 "name": "Nvme1", 00:17:51.713 "trtype": "tcp", 00:17:51.713 "traddr": "10.0.0.2", 00:17:51.713 "adrfam": "ipv4", 00:17:51.713 "trsvcid": "4420", 00:17:51.713 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:51.713 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:51.713 "hdgst": false, 00:17:51.713 "ddgst": false 00:17:51.713 }, 00:17:51.713 "method": "bdev_nvme_attach_controller" 00:17:51.713 }' 00:17:51.713 02:00:26 -- nvmf/common.sh@545 -- # IFS=, 00:17:51.713 02:00:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:51.713 "params": { 00:17:51.713 "name": "Nvme1", 00:17:51.713 "trtype": "tcp", 00:17:51.713 "traddr": "10.0.0.2", 00:17:51.713 "adrfam": "ipv4", 00:17:51.713 "trsvcid": "4420", 00:17:51.713 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:51.713 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:51.713 "hdgst": false, 00:17:51.713 "ddgst": false 00:17:51.713 }, 00:17:51.713 "method": "bdev_nvme_attach_controller" 00:17:51.713 }' 00:17:51.713 [2024-11-18 02:00:26.106413] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:51.713 [2024-11-18 02:00:26.106412] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:51.713 [2024-11-18 02:00:26.106499] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-18 02:00:26.106499] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:17:51.713 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:17:51.713 [2024-11-18 02:00:26.106916] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:51.713 [2024-11-18 02:00:26.106917] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:51.713 [2024-11-18 02:00:26.106987] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-18 02:00:26.106987] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:17:51.713 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:17:51.971 EAL: No free 2048 kB hugepages reported on node 1 00:17:51.971 EAL: No free 2048 kB hugepages reported on node 1 00:17:51.972 [2024-11-18 02:00:26.284932] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:51.972 EAL: No free 2048 kB hugepages reported on node 1 00:17:51.972 [2024-11-18 02:00:26.357985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:52.230 [2024-11-18 02:00:26.384001] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:52.230 EAL: No free 2048 kB hugepages reported on node 1 00:17:52.230 [2024-11-18 02:00:26.460491] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:52.230 [2024-11-18 02:00:26.461257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:52.230 [2024-11-18 02:00:26.524872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:17:52.230 [2024-11-18 02:00:26.535389] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:52.230 [2024-11-18 02:00:26.603872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:52.488 Running I/O for 1 seconds... 00:17:52.488 Running I/O for 1 seconds... 00:17:52.488 Running I/O for 1 seconds... 00:17:52.747 Running I/O for 1 seconds... 00:17:53.314 00:17:53.314 Latency(us) 00:17:53.314 [2024-11-18T01:00:27.716Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:53.314 [2024-11-18T01:00:27.716Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:17:53.314 Nvme1n1 : 1.01 12338.37 48.20 0.00 0.00 10335.43 6602.15 20971.52 00:17:53.314 [2024-11-18T01:00:27.716Z] =================================================================================================================== 00:17:53.314 [2024-11-18T01:00:27.716Z] Total : 12338.37 48.20 0.00 0.00 10335.43 6602.15 20971.52 00:17:53.573 00:17:53.573 Latency(us) 00:17:53.573 [2024-11-18T01:00:27.975Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:53.573 [2024-11-18T01:00:27.975Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:17:53.573 Nvme1n1 : 1.02 5078.67 19.84 0.00 0.00 24874.94 4563.25 37476.88 00:17:53.573 [2024-11-18T01:00:27.975Z] =================================================================================================================== 00:17:53.573 [2024-11-18T01:00:27.975Z] Total : 5078.67 19.84 0.00 0.00 24874.94 4563.25 37476.88 00:17:53.573 00:17:53.573 Latency(us) 00:17:53.573 [2024-11-18T01:00:27.975Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:53.573 [2024-11-18T01:00:27.975Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:17:53.573 Nvme1n1 : 1.00 199649.51 779.88 0.00 0.00 638.72 259.41 767.62 00:17:53.573 [2024-11-18T01:00:27.975Z] =================================================================================================================== 00:17:53.573 [2024-11-18T01:00:27.975Z] Total : 199649.51 779.88 0.00 0.00 638.72 259.41 767.62 00:17:53.573 00:17:53.573 Latency(us) 00:17:53.573 [2024-11-18T01:00:27.975Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:53.573 [2024-11-18T01:00:27.975Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:17:53.573 Nvme1n1 : 1.01 5679.55 22.19 0.00 0.00 22458.72 6068.15 54758.97 00:17:53.573 [2024-11-18T01:00:27.975Z] =================================================================================================================== 00:17:53.573 [2024-11-18T01:00:27.975Z] Total : 5679.55 22.19 0.00 0.00 22458.72 6068.15 54758.97 00:17:53.831 02:00:28 -- target/bdev_io_wait.sh@38 -- # wait 1204395 00:17:53.831 02:00:28 -- target/bdev_io_wait.sh@39 -- # wait 1204398 00:17:53.831 02:00:28 -- target/bdev_io_wait.sh@40 -- # wait 1204402 00:17:53.831 02:00:28 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:53.831 02:00:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:53.831 02:00:28 -- common/autotest_common.sh@10 -- # set +x 00:17:53.831 02:00:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:53.831 02:00:28 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:17:53.831 02:00:28 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:17:53.831 02:00:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:53.831 02:00:28 -- nvmf/common.sh@116 -- # sync 00:17:53.831 02:00:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:53.831 02:00:28 -- nvmf/common.sh@119 -- # set +e 00:17:53.831 02:00:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:53.831 02:00:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:53.831 rmmod nvme_tcp 00:17:53.831 rmmod nvme_fabrics 00:17:54.088 rmmod nvme_keyring 00:17:54.088 02:00:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:54.088 02:00:28 -- nvmf/common.sh@123 -- # set -e 00:17:54.088 02:00:28 -- nvmf/common.sh@124 -- # return 0 00:17:54.088 02:00:28 -- nvmf/common.sh@477 -- # '[' -n 1204351 ']' 00:17:54.088 02:00:28 -- nvmf/common.sh@478 -- # killprocess 1204351 00:17:54.088 02:00:28 -- common/autotest_common.sh@936 -- # '[' -z 1204351 ']' 00:17:54.088 02:00:28 -- common/autotest_common.sh@940 -- # kill -0 1204351 00:17:54.088 02:00:28 -- common/autotest_common.sh@941 -- # uname 00:17:54.088 02:00:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:54.088 02:00:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1204351 00:17:54.088 02:00:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:54.089 02:00:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:54.089 02:00:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1204351' 00:17:54.089 killing process with pid 1204351 00:17:54.089 02:00:28 -- common/autotest_common.sh@955 -- # kill 1204351 00:17:54.089 02:00:28 -- common/autotest_common.sh@960 -- # wait 1204351 00:17:54.348 02:00:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:54.348 02:00:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:54.348 02:00:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:54.348 02:00:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:54.348 02:00:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:54.348 02:00:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:54.348 02:00:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:54.348 02:00:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:56.258 02:00:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:56.258 00:17:56.258 real 0m7.210s 00:17:56.258 user 0m16.538s 00:17:56.258 sys 0m3.426s 00:17:56.258 02:00:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:56.258 02:00:30 -- common/autotest_common.sh@10 -- # set +x 00:17:56.258 ************************************ 00:17:56.258 END TEST nvmf_bdev_io_wait 00:17:56.258 ************************************ 00:17:56.258 02:00:30 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:17:56.258 02:00:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:56.258 02:00:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:56.258 02:00:30 -- common/autotest_common.sh@10 -- # set +x 00:17:56.258 ************************************ 00:17:56.258 START TEST nvmf_queue_depth 00:17:56.258 ************************************ 00:17:56.258 02:00:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:17:56.258 * Looking for test storage... 00:17:56.518 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:56.518 02:00:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:56.518 02:00:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:56.518 02:00:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:56.518 02:00:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:56.518 02:00:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:56.518 02:00:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:56.518 02:00:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:56.518 02:00:30 -- scripts/common.sh@335 -- # IFS=.-: 00:17:56.518 02:00:30 -- scripts/common.sh@335 -- # read -ra ver1 00:17:56.518 02:00:30 -- scripts/common.sh@336 -- # IFS=.-: 00:17:56.518 02:00:30 -- scripts/common.sh@336 -- # read -ra ver2 00:17:56.518 02:00:30 -- scripts/common.sh@337 -- # local 'op=<' 00:17:56.518 02:00:30 -- scripts/common.sh@339 -- # ver1_l=2 00:17:56.518 02:00:30 -- scripts/common.sh@340 -- # ver2_l=1 00:17:56.518 02:00:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:56.518 02:00:30 -- scripts/common.sh@343 -- # case "$op" in 00:17:56.518 02:00:30 -- scripts/common.sh@344 -- # : 1 00:17:56.518 02:00:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:56.518 02:00:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:56.518 02:00:30 -- scripts/common.sh@364 -- # decimal 1 00:17:56.518 02:00:30 -- scripts/common.sh@352 -- # local d=1 00:17:56.518 02:00:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:56.518 02:00:30 -- scripts/common.sh@354 -- # echo 1 00:17:56.518 02:00:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:56.518 02:00:30 -- scripts/common.sh@365 -- # decimal 2 00:17:56.518 02:00:30 -- scripts/common.sh@352 -- # local d=2 00:17:56.518 02:00:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:56.518 02:00:30 -- scripts/common.sh@354 -- # echo 2 00:17:56.518 02:00:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:56.518 02:00:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:56.518 02:00:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:56.518 02:00:30 -- scripts/common.sh@367 -- # return 0 00:17:56.518 02:00:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:56.518 02:00:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:56.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:56.518 --rc genhtml_branch_coverage=1 00:17:56.518 --rc genhtml_function_coverage=1 00:17:56.518 --rc genhtml_legend=1 00:17:56.518 --rc geninfo_all_blocks=1 00:17:56.518 --rc geninfo_unexecuted_blocks=1 00:17:56.518 00:17:56.518 ' 00:17:56.518 02:00:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:56.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:56.518 --rc genhtml_branch_coverage=1 00:17:56.518 --rc genhtml_function_coverage=1 00:17:56.518 --rc genhtml_legend=1 00:17:56.518 --rc geninfo_all_blocks=1 00:17:56.518 --rc geninfo_unexecuted_blocks=1 00:17:56.518 00:17:56.518 ' 00:17:56.518 02:00:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:56.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:56.518 --rc genhtml_branch_coverage=1 00:17:56.518 --rc genhtml_function_coverage=1 00:17:56.518 --rc genhtml_legend=1 00:17:56.518 --rc geninfo_all_blocks=1 00:17:56.518 --rc geninfo_unexecuted_blocks=1 00:17:56.518 00:17:56.518 ' 00:17:56.518 02:00:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:56.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:56.518 --rc genhtml_branch_coverage=1 00:17:56.518 --rc genhtml_function_coverage=1 00:17:56.518 --rc genhtml_legend=1 00:17:56.518 --rc geninfo_all_blocks=1 00:17:56.518 --rc geninfo_unexecuted_blocks=1 00:17:56.518 00:17:56.518 ' 00:17:56.518 02:00:30 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:56.518 02:00:30 -- nvmf/common.sh@7 -- # uname -s 00:17:56.518 02:00:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:56.518 02:00:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:56.518 02:00:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:56.518 02:00:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:56.518 02:00:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:56.518 02:00:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:56.518 02:00:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:56.518 02:00:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:56.518 02:00:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:56.518 02:00:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:56.518 02:00:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:56.518 02:00:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:56.518 02:00:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:56.518 02:00:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:56.518 02:00:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:56.518 02:00:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:56.518 02:00:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:56.518 02:00:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:56.518 02:00:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:56.518 02:00:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.519 02:00:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.519 02:00:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.519 02:00:30 -- paths/export.sh@5 -- # export PATH 00:17:56.519 02:00:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.519 02:00:30 -- nvmf/common.sh@46 -- # : 0 00:17:56.519 02:00:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:56.519 02:00:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:56.519 02:00:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:56.519 02:00:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:56.519 02:00:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:56.519 02:00:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:56.519 02:00:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:56.519 02:00:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:56.519 02:00:30 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:17:56.519 02:00:30 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:17:56.519 02:00:30 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:56.519 02:00:30 -- target/queue_depth.sh@19 -- # nvmftestinit 00:17:56.519 02:00:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:56.519 02:00:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:56.519 02:00:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:56.519 02:00:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:56.519 02:00:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:56.519 02:00:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:56.519 02:00:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:56.519 02:00:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:56.519 02:00:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:56.519 02:00:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:56.519 02:00:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:56.519 02:00:30 -- common/autotest_common.sh@10 -- # set +x 00:17:59.052 02:00:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:59.052 02:00:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:59.052 02:00:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:59.052 02:00:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:59.052 02:00:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:59.052 02:00:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:59.052 02:00:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:59.052 02:00:32 -- nvmf/common.sh@294 -- # net_devs=() 00:17:59.052 02:00:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:59.052 02:00:32 -- nvmf/common.sh@295 -- # e810=() 00:17:59.052 02:00:32 -- nvmf/common.sh@295 -- # local -ga e810 00:17:59.052 02:00:32 -- nvmf/common.sh@296 -- # x722=() 00:17:59.052 02:00:32 -- nvmf/common.sh@296 -- # local -ga x722 00:17:59.052 02:00:32 -- nvmf/common.sh@297 -- # mlx=() 00:17:59.052 02:00:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:59.052 02:00:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:59.052 02:00:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:59.052 02:00:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:59.052 02:00:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:59.052 02:00:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:59.052 02:00:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:59.052 02:00:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:59.052 02:00:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:59.052 02:00:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:59.052 02:00:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:59.052 02:00:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:59.052 02:00:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:59.052 02:00:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:59.052 02:00:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:59.052 02:00:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:59.052 02:00:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:59.052 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:59.052 02:00:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:59.052 02:00:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:59.052 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:59.052 02:00:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:59.052 02:00:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:59.052 02:00:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:59.052 02:00:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:59.052 02:00:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:59.052 02:00:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:59.052 02:00:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:59.052 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:59.052 02:00:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:59.052 02:00:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:59.052 02:00:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:59.052 02:00:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:59.052 02:00:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:59.052 02:00:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:59.052 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:59.052 02:00:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:59.052 02:00:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:59.053 02:00:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:59.053 02:00:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:59.053 02:00:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:59.053 02:00:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:59.053 02:00:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:59.053 02:00:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:59.053 02:00:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:59.053 02:00:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:59.053 02:00:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:59.053 02:00:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:59.053 02:00:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:59.053 02:00:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:59.053 02:00:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:59.053 02:00:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:59.053 02:00:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:59.053 02:00:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:59.053 02:00:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:59.053 02:00:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:59.053 02:00:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:59.053 02:00:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:59.053 02:00:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:59.053 02:00:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:59.053 02:00:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:59.053 02:00:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:59.053 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:59.053 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.158 ms 00:17:59.053 00:17:59.053 --- 10.0.0.2 ping statistics --- 00:17:59.053 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:59.053 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:17:59.053 02:00:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:59.053 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:59.053 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:17:59.053 00:17:59.053 --- 10.0.0.1 ping statistics --- 00:17:59.053 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:59.053 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:17:59.053 02:00:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:59.053 02:00:32 -- nvmf/common.sh@410 -- # return 0 00:17:59.053 02:00:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:59.053 02:00:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:59.053 02:00:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:59.053 02:00:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:59.053 02:00:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:59.053 02:00:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:59.053 02:00:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:59.053 02:00:32 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:17:59.053 02:00:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:59.053 02:00:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:59.053 02:00:32 -- common/autotest_common.sh@10 -- # set +x 00:17:59.053 02:00:32 -- nvmf/common.sh@469 -- # nvmfpid=1206743 00:17:59.053 02:00:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:59.053 02:00:32 -- nvmf/common.sh@470 -- # waitforlisten 1206743 00:17:59.053 02:00:32 -- common/autotest_common.sh@829 -- # '[' -z 1206743 ']' 00:17:59.053 02:00:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:59.053 02:00:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:59.053 02:00:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:59.053 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:59.053 02:00:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:59.053 02:00:32 -- common/autotest_common.sh@10 -- # set +x 00:17:59.053 [2024-11-18 02:00:33.038580] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:59.053 [2024-11-18 02:00:33.038666] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:59.053 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.053 [2024-11-18 02:00:33.107538] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.053 [2024-11-18 02:00:33.198168] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:59.053 [2024-11-18 02:00:33.198335] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:59.053 [2024-11-18 02:00:33.198370] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:59.053 [2024-11-18 02:00:33.198383] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:59.053 [2024-11-18 02:00:33.198412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:59.620 02:00:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:59.620 02:00:33 -- common/autotest_common.sh@862 -- # return 0 00:17:59.620 02:00:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:59.620 02:00:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:59.620 02:00:33 -- common/autotest_common.sh@10 -- # set +x 00:17:59.620 02:00:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:59.620 02:00:34 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:59.620 02:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:59.620 02:00:34 -- common/autotest_common.sh@10 -- # set +x 00:17:59.878 [2024-11-18 02:00:34.025554] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:59.878 02:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:59.878 02:00:34 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:59.878 02:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:59.878 02:00:34 -- common/autotest_common.sh@10 -- # set +x 00:17:59.878 Malloc0 00:17:59.878 02:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:59.878 02:00:34 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:59.878 02:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:59.878 02:00:34 -- common/autotest_common.sh@10 -- # set +x 00:17:59.878 02:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:59.878 02:00:34 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:59.878 02:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:59.878 02:00:34 -- common/autotest_common.sh@10 -- # set +x 00:17:59.878 02:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:59.878 02:00:34 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:59.878 02:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:59.878 02:00:34 -- common/autotest_common.sh@10 -- # set +x 00:17:59.878 [2024-11-18 02:00:34.094572] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:59.878 02:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:59.878 02:00:34 -- target/queue_depth.sh@30 -- # bdevperf_pid=1206897 00:17:59.878 02:00:34 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:17:59.878 02:00:34 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:59.878 02:00:34 -- target/queue_depth.sh@33 -- # waitforlisten 1206897 /var/tmp/bdevperf.sock 00:17:59.878 02:00:34 -- common/autotest_common.sh@829 -- # '[' -z 1206897 ']' 00:17:59.878 02:00:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:59.878 02:00:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:59.878 02:00:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:59.878 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:59.878 02:00:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:59.878 02:00:34 -- common/autotest_common.sh@10 -- # set +x 00:17:59.878 [2024-11-18 02:00:34.138009] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:59.878 [2024-11-18 02:00:34.138080] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1206897 ] 00:17:59.878 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.878 [2024-11-18 02:00:34.199512] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:00.136 [2024-11-18 02:00:34.290289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:00.136 02:00:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:00.136 02:00:34 -- common/autotest_common.sh@862 -- # return 0 00:18:00.136 02:00:34 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:00.136 02:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:00.136 02:00:34 -- common/autotest_common.sh@10 -- # set +x 00:18:00.395 NVMe0n1 00:18:00.395 02:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:00.395 02:00:34 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:00.395 Running I/O for 10 seconds... 00:18:10.443 00:18:10.443 Latency(us) 00:18:10.443 [2024-11-18T01:00:44.845Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:10.443 [2024-11-18T01:00:44.845Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:10.443 Verification LBA range: start 0x0 length 0x4000 00:18:10.443 NVMe0n1 : 10.07 12569.33 49.10 0.00 0.00 81153.30 14854.83 60972.75 00:18:10.443 [2024-11-18T01:00:44.845Z] =================================================================================================================== 00:18:10.443 [2024-11-18T01:00:44.846Z] Total : 12569.33 49.10 0.00 0.00 81153.30 14854.83 60972.75 00:18:10.444 0 00:18:10.444 02:00:44 -- target/queue_depth.sh@39 -- # killprocess 1206897 00:18:10.444 02:00:44 -- common/autotest_common.sh@936 -- # '[' -z 1206897 ']' 00:18:10.444 02:00:44 -- common/autotest_common.sh@940 -- # kill -0 1206897 00:18:10.444 02:00:44 -- common/autotest_common.sh@941 -- # uname 00:18:10.444 02:00:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:10.444 02:00:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1206897 00:18:10.444 02:00:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:10.444 02:00:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:10.444 02:00:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1206897' 00:18:10.444 killing process with pid 1206897 00:18:10.444 02:00:44 -- common/autotest_common.sh@955 -- # kill 1206897 00:18:10.444 Received shutdown signal, test time was about 10.000000 seconds 00:18:10.444 00:18:10.444 Latency(us) 00:18:10.444 [2024-11-18T01:00:44.846Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:10.444 [2024-11-18T01:00:44.846Z] =================================================================================================================== 00:18:10.444 [2024-11-18T01:00:44.846Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:10.444 02:00:44 -- common/autotest_common.sh@960 -- # wait 1206897 00:18:10.702 02:00:45 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:10.702 02:00:45 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:10.702 02:00:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:10.702 02:00:45 -- nvmf/common.sh@116 -- # sync 00:18:10.702 02:00:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:10.702 02:00:45 -- nvmf/common.sh@119 -- # set +e 00:18:10.702 02:00:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:10.702 02:00:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:10.702 rmmod nvme_tcp 00:18:10.702 rmmod nvme_fabrics 00:18:10.702 rmmod nvme_keyring 00:18:10.960 02:00:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:10.960 02:00:45 -- nvmf/common.sh@123 -- # set -e 00:18:10.960 02:00:45 -- nvmf/common.sh@124 -- # return 0 00:18:10.960 02:00:45 -- nvmf/common.sh@477 -- # '[' -n 1206743 ']' 00:18:10.960 02:00:45 -- nvmf/common.sh@478 -- # killprocess 1206743 00:18:10.960 02:00:45 -- common/autotest_common.sh@936 -- # '[' -z 1206743 ']' 00:18:10.960 02:00:45 -- common/autotest_common.sh@940 -- # kill -0 1206743 00:18:10.960 02:00:45 -- common/autotest_common.sh@941 -- # uname 00:18:10.960 02:00:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:10.960 02:00:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1206743 00:18:10.960 02:00:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:10.960 02:00:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:10.960 02:00:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1206743' 00:18:10.960 killing process with pid 1206743 00:18:10.960 02:00:45 -- common/autotest_common.sh@955 -- # kill 1206743 00:18:10.960 02:00:45 -- common/autotest_common.sh@960 -- # wait 1206743 00:18:11.218 02:00:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:11.218 02:00:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:11.218 02:00:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:11.218 02:00:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:11.218 02:00:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:11.218 02:00:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:11.218 02:00:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:11.218 02:00:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:13.118 02:00:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:13.118 00:18:13.118 real 0m16.855s 00:18:13.118 user 0m23.469s 00:18:13.118 sys 0m3.236s 00:18:13.118 02:00:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:13.118 02:00:47 -- common/autotest_common.sh@10 -- # set +x 00:18:13.118 ************************************ 00:18:13.118 END TEST nvmf_queue_depth 00:18:13.118 ************************************ 00:18:13.118 02:00:47 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:13.118 02:00:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:13.118 02:00:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:13.118 02:00:47 -- common/autotest_common.sh@10 -- # set +x 00:18:13.118 ************************************ 00:18:13.118 START TEST nvmf_multipath 00:18:13.118 ************************************ 00:18:13.118 02:00:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:13.377 * Looking for test storage... 00:18:13.377 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:13.377 02:00:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:13.377 02:00:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:13.377 02:00:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:13.377 02:00:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:13.377 02:00:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:13.377 02:00:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:13.377 02:00:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:13.377 02:00:47 -- scripts/common.sh@335 -- # IFS=.-: 00:18:13.377 02:00:47 -- scripts/common.sh@335 -- # read -ra ver1 00:18:13.377 02:00:47 -- scripts/common.sh@336 -- # IFS=.-: 00:18:13.377 02:00:47 -- scripts/common.sh@336 -- # read -ra ver2 00:18:13.377 02:00:47 -- scripts/common.sh@337 -- # local 'op=<' 00:18:13.377 02:00:47 -- scripts/common.sh@339 -- # ver1_l=2 00:18:13.377 02:00:47 -- scripts/common.sh@340 -- # ver2_l=1 00:18:13.377 02:00:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:13.377 02:00:47 -- scripts/common.sh@343 -- # case "$op" in 00:18:13.377 02:00:47 -- scripts/common.sh@344 -- # : 1 00:18:13.377 02:00:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:13.377 02:00:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:13.377 02:00:47 -- scripts/common.sh@364 -- # decimal 1 00:18:13.377 02:00:47 -- scripts/common.sh@352 -- # local d=1 00:18:13.377 02:00:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:13.377 02:00:47 -- scripts/common.sh@354 -- # echo 1 00:18:13.377 02:00:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:13.377 02:00:47 -- scripts/common.sh@365 -- # decimal 2 00:18:13.377 02:00:47 -- scripts/common.sh@352 -- # local d=2 00:18:13.377 02:00:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:13.377 02:00:47 -- scripts/common.sh@354 -- # echo 2 00:18:13.377 02:00:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:13.377 02:00:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:13.377 02:00:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:13.377 02:00:47 -- scripts/common.sh@367 -- # return 0 00:18:13.377 02:00:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:13.377 02:00:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:13.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:13.377 --rc genhtml_branch_coverage=1 00:18:13.377 --rc genhtml_function_coverage=1 00:18:13.377 --rc genhtml_legend=1 00:18:13.377 --rc geninfo_all_blocks=1 00:18:13.377 --rc geninfo_unexecuted_blocks=1 00:18:13.377 00:18:13.377 ' 00:18:13.377 02:00:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:13.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:13.377 --rc genhtml_branch_coverage=1 00:18:13.377 --rc genhtml_function_coverage=1 00:18:13.377 --rc genhtml_legend=1 00:18:13.377 --rc geninfo_all_blocks=1 00:18:13.377 --rc geninfo_unexecuted_blocks=1 00:18:13.377 00:18:13.377 ' 00:18:13.377 02:00:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:13.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:13.377 --rc genhtml_branch_coverage=1 00:18:13.377 --rc genhtml_function_coverage=1 00:18:13.377 --rc genhtml_legend=1 00:18:13.377 --rc geninfo_all_blocks=1 00:18:13.377 --rc geninfo_unexecuted_blocks=1 00:18:13.377 00:18:13.377 ' 00:18:13.377 02:00:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:13.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:13.377 --rc genhtml_branch_coverage=1 00:18:13.377 --rc genhtml_function_coverage=1 00:18:13.377 --rc genhtml_legend=1 00:18:13.377 --rc geninfo_all_blocks=1 00:18:13.377 --rc geninfo_unexecuted_blocks=1 00:18:13.377 00:18:13.377 ' 00:18:13.377 02:00:47 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:13.377 02:00:47 -- nvmf/common.sh@7 -- # uname -s 00:18:13.377 02:00:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:13.377 02:00:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:13.377 02:00:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:13.377 02:00:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:13.377 02:00:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:13.377 02:00:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:13.377 02:00:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:13.377 02:00:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:13.377 02:00:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:13.377 02:00:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:13.377 02:00:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:13.377 02:00:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:13.377 02:00:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:13.377 02:00:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:13.377 02:00:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:13.377 02:00:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:13.377 02:00:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:13.377 02:00:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:13.377 02:00:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:13.377 02:00:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.377 02:00:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.377 02:00:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.377 02:00:47 -- paths/export.sh@5 -- # export PATH 00:18:13.377 02:00:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.377 02:00:47 -- nvmf/common.sh@46 -- # : 0 00:18:13.377 02:00:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:13.377 02:00:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:13.377 02:00:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:13.377 02:00:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:13.377 02:00:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:13.377 02:00:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:13.377 02:00:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:13.377 02:00:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:13.377 02:00:47 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:13.377 02:00:47 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:13.377 02:00:47 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:13.377 02:00:47 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:13.377 02:00:47 -- target/multipath.sh@43 -- # nvmftestinit 00:18:13.377 02:00:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:13.377 02:00:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:13.377 02:00:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:13.377 02:00:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:13.377 02:00:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:13.377 02:00:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:13.377 02:00:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:13.377 02:00:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:13.377 02:00:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:13.377 02:00:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:13.377 02:00:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:13.378 02:00:47 -- common/autotest_common.sh@10 -- # set +x 00:18:15.911 02:00:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:15.911 02:00:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:15.911 02:00:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:15.911 02:00:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:15.911 02:00:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:15.911 02:00:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:15.911 02:00:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:15.911 02:00:49 -- nvmf/common.sh@294 -- # net_devs=() 00:18:15.911 02:00:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:15.911 02:00:49 -- nvmf/common.sh@295 -- # e810=() 00:18:15.911 02:00:49 -- nvmf/common.sh@295 -- # local -ga e810 00:18:15.911 02:00:49 -- nvmf/common.sh@296 -- # x722=() 00:18:15.911 02:00:49 -- nvmf/common.sh@296 -- # local -ga x722 00:18:15.911 02:00:49 -- nvmf/common.sh@297 -- # mlx=() 00:18:15.911 02:00:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:15.911 02:00:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:15.911 02:00:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:15.911 02:00:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:15.911 02:00:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:15.911 02:00:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:15.911 02:00:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:15.911 02:00:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:15.911 02:00:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:15.911 02:00:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:15.911 02:00:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:15.911 02:00:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:15.911 02:00:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:15.911 02:00:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:15.911 02:00:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:15.911 02:00:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:15.911 02:00:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:15.911 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:15.911 02:00:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:15.911 02:00:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:15.911 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:15.911 02:00:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:15.911 02:00:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:15.911 02:00:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:15.911 02:00:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:15.911 02:00:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:15.911 02:00:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:15.911 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:15.911 02:00:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:15.911 02:00:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:15.911 02:00:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:15.911 02:00:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:15.911 02:00:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:15.911 02:00:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:15.911 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:15.911 02:00:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:15.911 02:00:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:15.911 02:00:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:15.911 02:00:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:15.911 02:00:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:15.911 02:00:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:15.911 02:00:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:15.911 02:00:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:15.911 02:00:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:15.911 02:00:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:15.911 02:00:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:15.911 02:00:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:15.911 02:00:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:15.911 02:00:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:15.911 02:00:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:15.911 02:00:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:15.911 02:00:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:15.911 02:00:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:15.911 02:00:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:15.911 02:00:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:15.911 02:00:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:15.911 02:00:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:15.911 02:00:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:15.911 02:00:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:15.911 02:00:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:15.911 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:15.911 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.197 ms 00:18:15.912 00:18:15.912 --- 10.0.0.2 ping statistics --- 00:18:15.912 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:15.912 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:18:15.912 02:00:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:15.912 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:15.912 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:18:15.912 00:18:15.912 --- 10.0.0.1 ping statistics --- 00:18:15.912 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:15.912 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:18:15.912 02:00:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:15.912 02:00:49 -- nvmf/common.sh@410 -- # return 0 00:18:15.912 02:00:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:15.912 02:00:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:15.912 02:00:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:15.912 02:00:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:15.912 02:00:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:15.912 02:00:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:15.912 02:00:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:15.912 02:00:49 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:15.912 02:00:49 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:15.912 only one NIC for nvmf test 00:18:15.912 02:00:49 -- target/multipath.sh@47 -- # nvmftestfini 00:18:15.912 02:00:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:15.912 02:00:49 -- nvmf/common.sh@116 -- # sync 00:18:15.912 02:00:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:15.912 02:00:49 -- nvmf/common.sh@119 -- # set +e 00:18:15.912 02:00:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:15.912 02:00:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:15.912 rmmod nvme_tcp 00:18:15.912 rmmod nvme_fabrics 00:18:15.912 rmmod nvme_keyring 00:18:15.912 02:00:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:15.912 02:00:50 -- nvmf/common.sh@123 -- # set -e 00:18:15.912 02:00:50 -- nvmf/common.sh@124 -- # return 0 00:18:15.912 02:00:50 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:15.912 02:00:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:15.912 02:00:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:15.912 02:00:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:15.912 02:00:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:15.912 02:00:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:15.912 02:00:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:15.912 02:00:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:15.912 02:00:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:17.814 02:00:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:17.814 02:00:52 -- target/multipath.sh@48 -- # exit 0 00:18:17.814 02:00:52 -- target/multipath.sh@1 -- # nvmftestfini 00:18:17.814 02:00:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:17.814 02:00:52 -- nvmf/common.sh@116 -- # sync 00:18:17.814 02:00:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:17.814 02:00:52 -- nvmf/common.sh@119 -- # set +e 00:18:17.814 02:00:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:17.814 02:00:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:17.814 02:00:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:17.814 02:00:52 -- nvmf/common.sh@123 -- # set -e 00:18:17.814 02:00:52 -- nvmf/common.sh@124 -- # return 0 00:18:17.814 02:00:52 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:17.815 02:00:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:17.815 02:00:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:17.815 02:00:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:17.815 02:00:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:17.815 02:00:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:17.815 02:00:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:17.815 02:00:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:17.815 02:00:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:17.815 02:00:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:17.815 00:18:17.815 real 0m4.600s 00:18:17.815 user 0m0.937s 00:18:17.815 sys 0m1.579s 00:18:17.815 02:00:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:17.815 02:00:52 -- common/autotest_common.sh@10 -- # set +x 00:18:17.815 ************************************ 00:18:17.815 END TEST nvmf_multipath 00:18:17.815 ************************************ 00:18:17.815 02:00:52 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:17.815 02:00:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:17.815 02:00:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:17.815 02:00:52 -- common/autotest_common.sh@10 -- # set +x 00:18:17.815 ************************************ 00:18:17.815 START TEST nvmf_zcopy 00:18:17.815 ************************************ 00:18:17.815 02:00:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:17.815 * Looking for test storage... 00:18:17.815 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:17.815 02:00:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:17.815 02:00:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:17.815 02:00:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:18.073 02:00:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:18.073 02:00:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:18.073 02:00:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:18.073 02:00:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:18.073 02:00:52 -- scripts/common.sh@335 -- # IFS=.-: 00:18:18.073 02:00:52 -- scripts/common.sh@335 -- # read -ra ver1 00:18:18.073 02:00:52 -- scripts/common.sh@336 -- # IFS=.-: 00:18:18.073 02:00:52 -- scripts/common.sh@336 -- # read -ra ver2 00:18:18.073 02:00:52 -- scripts/common.sh@337 -- # local 'op=<' 00:18:18.073 02:00:52 -- scripts/common.sh@339 -- # ver1_l=2 00:18:18.074 02:00:52 -- scripts/common.sh@340 -- # ver2_l=1 00:18:18.074 02:00:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:18.074 02:00:52 -- scripts/common.sh@343 -- # case "$op" in 00:18:18.074 02:00:52 -- scripts/common.sh@344 -- # : 1 00:18:18.074 02:00:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:18.074 02:00:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:18.074 02:00:52 -- scripts/common.sh@364 -- # decimal 1 00:18:18.074 02:00:52 -- scripts/common.sh@352 -- # local d=1 00:18:18.074 02:00:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:18.074 02:00:52 -- scripts/common.sh@354 -- # echo 1 00:18:18.074 02:00:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:18.074 02:00:52 -- scripts/common.sh@365 -- # decimal 2 00:18:18.074 02:00:52 -- scripts/common.sh@352 -- # local d=2 00:18:18.074 02:00:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:18.074 02:00:52 -- scripts/common.sh@354 -- # echo 2 00:18:18.074 02:00:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:18.074 02:00:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:18.074 02:00:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:18.074 02:00:52 -- scripts/common.sh@367 -- # return 0 00:18:18.074 02:00:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:18.074 02:00:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:18.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:18.074 --rc genhtml_branch_coverage=1 00:18:18.074 --rc genhtml_function_coverage=1 00:18:18.074 --rc genhtml_legend=1 00:18:18.074 --rc geninfo_all_blocks=1 00:18:18.074 --rc geninfo_unexecuted_blocks=1 00:18:18.074 00:18:18.074 ' 00:18:18.074 02:00:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:18.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:18.074 --rc genhtml_branch_coverage=1 00:18:18.074 --rc genhtml_function_coverage=1 00:18:18.074 --rc genhtml_legend=1 00:18:18.074 --rc geninfo_all_blocks=1 00:18:18.074 --rc geninfo_unexecuted_blocks=1 00:18:18.074 00:18:18.074 ' 00:18:18.074 02:00:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:18.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:18.074 --rc genhtml_branch_coverage=1 00:18:18.074 --rc genhtml_function_coverage=1 00:18:18.074 --rc genhtml_legend=1 00:18:18.074 --rc geninfo_all_blocks=1 00:18:18.074 --rc geninfo_unexecuted_blocks=1 00:18:18.074 00:18:18.074 ' 00:18:18.074 02:00:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:18.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:18.074 --rc genhtml_branch_coverage=1 00:18:18.074 --rc genhtml_function_coverage=1 00:18:18.074 --rc genhtml_legend=1 00:18:18.074 --rc geninfo_all_blocks=1 00:18:18.074 --rc geninfo_unexecuted_blocks=1 00:18:18.074 00:18:18.074 ' 00:18:18.074 02:00:52 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:18.074 02:00:52 -- nvmf/common.sh@7 -- # uname -s 00:18:18.074 02:00:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:18.074 02:00:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:18.074 02:00:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:18.074 02:00:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:18.074 02:00:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:18.074 02:00:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:18.074 02:00:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:18.074 02:00:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:18.074 02:00:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:18.074 02:00:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:18.074 02:00:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:18.074 02:00:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:18.074 02:00:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:18.074 02:00:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:18.074 02:00:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:18.074 02:00:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:18.074 02:00:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:18.074 02:00:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:18.074 02:00:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:18.074 02:00:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.074 02:00:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.074 02:00:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.074 02:00:52 -- paths/export.sh@5 -- # export PATH 00:18:18.074 02:00:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.074 02:00:52 -- nvmf/common.sh@46 -- # : 0 00:18:18.074 02:00:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:18.074 02:00:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:18.074 02:00:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:18.074 02:00:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:18.074 02:00:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:18.074 02:00:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:18.074 02:00:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:18.074 02:00:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:18.074 02:00:52 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:18.074 02:00:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:18.074 02:00:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:18.074 02:00:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:18.074 02:00:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:18.074 02:00:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:18.074 02:00:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:18.074 02:00:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:18.074 02:00:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:18.074 02:00:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:18.074 02:00:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:18.074 02:00:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:18.074 02:00:52 -- common/autotest_common.sh@10 -- # set +x 00:18:19.979 02:00:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:19.979 02:00:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:19.979 02:00:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:19.979 02:00:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:19.979 02:00:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:19.979 02:00:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:19.979 02:00:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:19.979 02:00:54 -- nvmf/common.sh@294 -- # net_devs=() 00:18:19.979 02:00:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:19.979 02:00:54 -- nvmf/common.sh@295 -- # e810=() 00:18:19.979 02:00:54 -- nvmf/common.sh@295 -- # local -ga e810 00:18:19.979 02:00:54 -- nvmf/common.sh@296 -- # x722=() 00:18:19.979 02:00:54 -- nvmf/common.sh@296 -- # local -ga x722 00:18:19.979 02:00:54 -- nvmf/common.sh@297 -- # mlx=() 00:18:19.979 02:00:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:19.979 02:00:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:19.979 02:00:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:19.979 02:00:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:19.979 02:00:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:19.979 02:00:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:19.979 02:00:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:19.979 02:00:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:19.979 02:00:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:19.979 02:00:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:19.979 02:00:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:19.979 02:00:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:19.979 02:00:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:19.979 02:00:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:19.979 02:00:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:19.979 02:00:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:19.979 02:00:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:19.979 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:19.979 02:00:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:19.979 02:00:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:19.979 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:19.979 02:00:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:19.979 02:00:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:19.979 02:00:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:19.979 02:00:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:19.979 02:00:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:19.979 02:00:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:19.980 02:00:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:19.980 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:19.980 02:00:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:19.980 02:00:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:19.980 02:00:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:19.980 02:00:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:19.980 02:00:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:19.980 02:00:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:19.980 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:19.980 02:00:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:19.980 02:00:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:19.980 02:00:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:19.980 02:00:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:19.980 02:00:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:19.980 02:00:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:19.980 02:00:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:19.980 02:00:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:19.980 02:00:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:19.980 02:00:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:19.980 02:00:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:19.980 02:00:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:19.980 02:00:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:19.980 02:00:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:19.980 02:00:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:19.980 02:00:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:19.980 02:00:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:19.980 02:00:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:19.980 02:00:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:19.980 02:00:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:19.980 02:00:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:19.980 02:00:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:19.980 02:00:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:20.238 02:00:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:20.238 02:00:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:20.238 02:00:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:20.238 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:20.239 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:18:20.239 00:18:20.239 --- 10.0.0.2 ping statistics --- 00:18:20.239 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:20.239 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:18:20.239 02:00:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:20.239 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:20.239 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:18:20.239 00:18:20.239 --- 10.0.0.1 ping statistics --- 00:18:20.239 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:20.239 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:18:20.239 02:00:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:20.239 02:00:54 -- nvmf/common.sh@410 -- # return 0 00:18:20.239 02:00:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:20.239 02:00:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:20.239 02:00:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:20.239 02:00:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:20.239 02:00:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:20.239 02:00:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:20.239 02:00:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:20.239 02:00:54 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:20.239 02:00:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:20.239 02:00:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:20.239 02:00:54 -- common/autotest_common.sh@10 -- # set +x 00:18:20.239 02:00:54 -- nvmf/common.sh@469 -- # nvmfpid=1212037 00:18:20.239 02:00:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:20.239 02:00:54 -- nvmf/common.sh@470 -- # waitforlisten 1212037 00:18:20.239 02:00:54 -- common/autotest_common.sh@829 -- # '[' -z 1212037 ']' 00:18:20.239 02:00:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:20.239 02:00:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:20.239 02:00:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:20.239 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:20.239 02:00:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:20.239 02:00:54 -- common/autotest_common.sh@10 -- # set +x 00:18:20.239 [2024-11-18 02:00:54.483968] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:20.239 [2024-11-18 02:00:54.484045] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:20.239 EAL: No free 2048 kB hugepages reported on node 1 00:18:20.239 [2024-11-18 02:00:54.555496] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:20.497 [2024-11-18 02:00:54.648585] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:20.497 [2024-11-18 02:00:54.648761] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:20.497 [2024-11-18 02:00:54.648791] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:20.497 [2024-11-18 02:00:54.648805] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:20.497 [2024-11-18 02:00:54.648845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:21.063 02:00:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:21.063 02:00:55 -- common/autotest_common.sh@862 -- # return 0 00:18:21.063 02:00:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:21.063 02:00:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:21.063 02:00:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.322 02:00:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:21.322 02:00:55 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:21.322 02:00:55 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:21.322 02:00:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.322 02:00:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.322 [2024-11-18 02:00:55.489903] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:21.322 02:00:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.322 02:00:55 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:21.322 02:00:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.322 02:00:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.322 02:00:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.322 02:00:55 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:21.322 02:00:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.322 02:00:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.322 [2024-11-18 02:00:55.506102] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:21.322 02:00:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.322 02:00:55 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:21.322 02:00:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.322 02:00:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.322 02:00:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.322 02:00:55 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:21.322 02:00:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.322 02:00:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.322 malloc0 00:18:21.322 02:00:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.322 02:00:55 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:21.322 02:00:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.322 02:00:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.322 02:00:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.322 02:00:55 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:21.322 02:00:55 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:21.322 02:00:55 -- nvmf/common.sh@520 -- # config=() 00:18:21.322 02:00:55 -- nvmf/common.sh@520 -- # local subsystem config 00:18:21.322 02:00:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:21.322 02:00:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:21.322 { 00:18:21.322 "params": { 00:18:21.322 "name": "Nvme$subsystem", 00:18:21.322 "trtype": "$TEST_TRANSPORT", 00:18:21.322 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:21.322 "adrfam": "ipv4", 00:18:21.322 "trsvcid": "$NVMF_PORT", 00:18:21.322 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:21.322 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:21.322 "hdgst": ${hdgst:-false}, 00:18:21.322 "ddgst": ${ddgst:-false} 00:18:21.322 }, 00:18:21.322 "method": "bdev_nvme_attach_controller" 00:18:21.322 } 00:18:21.322 EOF 00:18:21.322 )") 00:18:21.322 02:00:55 -- nvmf/common.sh@542 -- # cat 00:18:21.322 02:00:55 -- nvmf/common.sh@544 -- # jq . 00:18:21.322 02:00:55 -- nvmf/common.sh@545 -- # IFS=, 00:18:21.322 02:00:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:21.322 "params": { 00:18:21.322 "name": "Nvme1", 00:18:21.322 "trtype": "tcp", 00:18:21.322 "traddr": "10.0.0.2", 00:18:21.322 "adrfam": "ipv4", 00:18:21.322 "trsvcid": "4420", 00:18:21.322 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.322 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:21.323 "hdgst": false, 00:18:21.323 "ddgst": false 00:18:21.323 }, 00:18:21.323 "method": "bdev_nvme_attach_controller" 00:18:21.323 }' 00:18:21.323 [2024-11-18 02:00:55.584518] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:21.323 [2024-11-18 02:00:55.584602] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1212200 ] 00:18:21.323 EAL: No free 2048 kB hugepages reported on node 1 00:18:21.323 [2024-11-18 02:00:55.649150] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:21.581 [2024-11-18 02:00:55.744707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:21.581 Running I/O for 10 seconds... 00:18:33.784 00:18:33.784 Latency(us) 00:18:33.784 [2024-11-18T01:01:08.186Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:33.784 [2024-11-18T01:01:08.186Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:33.784 Verification LBA range: start 0x0 length 0x1000 00:18:33.784 Nvme1n1 : 10.01 8601.71 67.20 0.00 0.00 14845.59 1510.97 23010.42 00:18:33.784 [2024-11-18T01:01:08.186Z] =================================================================================================================== 00:18:33.784 [2024-11-18T01:01:08.186Z] Total : 8601.71 67.20 0.00 0.00 14845.59 1510.97 23010.42 00:18:33.784 02:01:06 -- target/zcopy.sh@39 -- # perfpid=1213540 00:18:33.784 02:01:06 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:33.784 02:01:06 -- common/autotest_common.sh@10 -- # set +x 00:18:33.784 02:01:06 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:33.784 02:01:06 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:33.784 02:01:06 -- nvmf/common.sh@520 -- # config=() 00:18:33.784 02:01:06 -- nvmf/common.sh@520 -- # local subsystem config 00:18:33.784 02:01:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:33.784 02:01:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:33.784 { 00:18:33.784 "params": { 00:18:33.784 "name": "Nvme$subsystem", 00:18:33.784 "trtype": "$TEST_TRANSPORT", 00:18:33.784 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:33.784 "adrfam": "ipv4", 00:18:33.784 "trsvcid": "$NVMF_PORT", 00:18:33.784 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:33.784 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:33.784 "hdgst": ${hdgst:-false}, 00:18:33.784 "ddgst": ${ddgst:-false} 00:18:33.784 }, 00:18:33.784 "method": "bdev_nvme_attach_controller" 00:18:33.784 } 00:18:33.784 EOF 00:18:33.784 )") 00:18:33.784 02:01:06 -- nvmf/common.sh@542 -- # cat 00:18:33.784 [2024-11-18 02:01:06.214459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.214507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 02:01:06 -- nvmf/common.sh@544 -- # jq . 00:18:33.784 02:01:06 -- nvmf/common.sh@545 -- # IFS=, 00:18:33.784 02:01:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:33.784 "params": { 00:18:33.784 "name": "Nvme1", 00:18:33.784 "trtype": "tcp", 00:18:33.784 "traddr": "10.0.0.2", 00:18:33.784 "adrfam": "ipv4", 00:18:33.784 "trsvcid": "4420", 00:18:33.784 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:33.784 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:33.784 "hdgst": false, 00:18:33.784 "ddgst": false 00:18:33.784 }, 00:18:33.784 "method": "bdev_nvme_attach_controller" 00:18:33.784 }' 00:18:33.784 [2024-11-18 02:01:06.222396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.222425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.230418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.230443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.238443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.238469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.246457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.246483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.252340] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:33.784 [2024-11-18 02:01:06.252420] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1213540 ] 00:18:33.784 [2024-11-18 02:01:06.254477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.254500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.262498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.262520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.270520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.270542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.278542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.278564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 EAL: No free 2048 kB hugepages reported on node 1 00:18:33.784 [2024-11-18 02:01:06.286565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.286588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.294586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.294625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.302627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.302652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.310653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.310678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.318675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.318699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.320460] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:33.784 [2024-11-18 02:01:06.326721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.326754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.334771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.334815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.342739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.342765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.350758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.350785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.358778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.358803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.366803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.366829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.374863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.374900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.382891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.382930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.390873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.390898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.398894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.398918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.406917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.406942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.414937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.414962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.415164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:33.784 [2024-11-18 02:01:06.422958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.422982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.431004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.431039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.439041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.439083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.447067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.447107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.455089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.455129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.784 [2024-11-18 02:01:06.463112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.784 [2024-11-18 02:01:06.463154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.471136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.471176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.479157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.479198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.487136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.487162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.495198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.495250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.503221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.503261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.511241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.511283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.519224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.519249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.527247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.527272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.535325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.535371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.543299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.543336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.551332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.551372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.559371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.559397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.567386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.567409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.575407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.575432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.583421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.583443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.591437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.591463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.599451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.599474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 Running I/O for 5 seconds... 00:18:33.785 [2024-11-18 02:01:06.607476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.607498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.621047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.621079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.632053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.632086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.643390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.643418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.656287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.656327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.666976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.667007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.678260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.678290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.691240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.691271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.701875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.701905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.712609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.712640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.723929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.723960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.734793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.734824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.745684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.745715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.756677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.756707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.767362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.767389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.778331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.778362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.791410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.791437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.801834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.801865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.812558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.812601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.823562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.823607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.836743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.836775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.846968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.846998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.858047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.858077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.871008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.871039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.881408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.881436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.892807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.892837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.903815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.903845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.915304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.915372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.926524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.926551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.937860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.937891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.949271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.949302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.960808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.960838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.972394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.972421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.983604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.983634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:06.997254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:06.997284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:07.008046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.785 [2024-11-18 02:01:07.008078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.785 [2024-11-18 02:01:07.019196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.019226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.030363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.030391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.041769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.041799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.052733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.052763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.063660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.063691] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.074554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.074581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.085275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.085305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.096672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.096703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.107586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.107629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.120911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.120941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.131433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.131460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.142308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.142363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.155440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.155467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.165527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.165554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.176235] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.176264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.187292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.187330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.198538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.198565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.211708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.211738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.222037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.222069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.232770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.232799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.244155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.244185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.255095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.255125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.268013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.268042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.277678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.277708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.289399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.289427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.300381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.300415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.311299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.311356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.324500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.324527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.334907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.334937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.346045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.346075] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.359065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.359095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.369536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.369563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.380200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.380230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.391176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.391205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.402267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.402297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.415046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.415076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.425182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.425212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.435852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.435882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.448974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.449004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.459552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.459579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.470785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.470815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.483633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.483663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.493697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.493727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.504892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.504923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.518128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.518166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.528776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.528807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.539866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.539896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.552524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.552551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.562194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.562225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.573861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.573891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.585260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.585291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.596413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.596441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.608994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.609024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.786 [2024-11-18 02:01:07.619145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.786 [2024-11-18 02:01:07.619175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.630452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.630480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.643167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.643196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.653504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.653532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.664530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.664558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.675870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.675900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.687121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.687152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.699965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.699995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.710211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.710241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.721266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.721295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.731898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.731936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.742715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.742746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.753677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.753707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.764748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.764779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.777288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.777328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.787887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.787918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.799182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.799212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.810099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.810129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.820966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.820995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.834029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.834059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.844573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.844600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.855121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.855151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.866530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.866558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.877467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.877494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.888636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.888667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.899344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.899388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.910519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.910546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.921706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.921736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.934680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.934710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.945068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.945105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.956176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.956207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.969129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.969160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.979634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.979665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:07.990634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:07.990664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.003195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.003225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.013267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.013302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.024289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.024353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.037706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.037737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.047990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.048017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.057889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.057916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.067750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.067780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.078840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.078867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.089472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.089499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.100882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.100912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.111858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.111887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.122439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.122467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.133262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.133293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.146082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.146114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.155623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.155654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.167220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.167251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.787 [2024-11-18 02:01:08.178661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.787 [2024-11-18 02:01:08.178692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.046 [2024-11-18 02:01:08.189921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.046 [2024-11-18 02:01:08.189952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.046 [2024-11-18 02:01:08.201750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.046 [2024-11-18 02:01:08.201781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.046 [2024-11-18 02:01:08.215456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.046 [2024-11-18 02:01:08.215484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.046 [2024-11-18 02:01:08.226195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.046 [2024-11-18 02:01:08.226226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.046 [2024-11-18 02:01:08.237890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.046 [2024-11-18 02:01:08.237921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.046 [2024-11-18 02:01:08.248904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.046 [2024-11-18 02:01:08.248935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.046 [2024-11-18 02:01:08.259625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.046 [2024-11-18 02:01:08.259656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.046 [2024-11-18 02:01:08.270428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.046 [2024-11-18 02:01:08.270456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.046 [2024-11-18 02:01:08.283583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.046 [2024-11-18 02:01:08.283628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.046 [2024-11-18 02:01:08.293740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.293770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.304381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.304408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.315485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.315512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.326164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.326194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.337133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.337163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.350022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.350052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.360257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.360287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.370757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.370787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.382134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.382163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.393544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.393571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.404391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.404418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.415426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.415453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.426529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.426556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.437450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.437478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.047 [2024-11-18 02:01:08.448388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.047 [2024-11-18 02:01:08.448416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.461646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.461677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.472333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.472376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.482837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.482867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.494183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.494213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.506932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.506962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.517152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.517182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.527913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.527943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.540438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.540465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.550227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.550257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.561982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.562011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.574630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.574660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.584129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.584159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.596065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.596095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.609152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.609182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.619689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.619719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.630887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.630917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.643668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.643699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.653723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.653753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.664806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.664836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.676258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.676288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.687761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.687792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.306 [2024-11-18 02:01:08.701219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.306 [2024-11-18 02:01:08.701250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.711964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.711994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.723136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.723166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.736261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.736291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.746383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.746410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.757876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.757906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.768946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.768976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.779837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.779867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.790602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.790632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.801924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.801955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.812831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.812862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.823649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.823679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.834302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.834355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.845527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.845554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.856663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.856693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.869149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.869178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.878035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.878065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.891455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.891496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.902188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.902218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.913276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.913305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.926290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.926329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.936824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.936854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.947680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.947710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.565 [2024-11-18 02:01:08.960972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.565 [2024-11-18 02:01:08.961002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.824 [2024-11-18 02:01:08.971777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.824 [2024-11-18 02:01:08.971807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.824 [2024-11-18 02:01:08.982682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.824 [2024-11-18 02:01:08.982713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.824 [2024-11-18 02:01:08.993700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.824 [2024-11-18 02:01:08.993730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.824 [2024-11-18 02:01:09.004470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.824 [2024-11-18 02:01:09.004507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.824 [2024-11-18 02:01:09.017416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.824 [2024-11-18 02:01:09.017444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.824 [2024-11-18 02:01:09.028052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.824 [2024-11-18 02:01:09.028082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.824 [2024-11-18 02:01:09.039025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.824 [2024-11-18 02:01:09.039055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.824 [2024-11-18 02:01:09.052096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.824 [2024-11-18 02:01:09.052126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.062840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.062870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.073942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.073972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.086631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.086661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.096291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.096350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.107765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.107795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.120404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.120432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.130945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.130976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.142083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.142110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.154807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.154838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.165107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.165136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.176045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.176076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.188444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.188471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.197737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.197767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.210852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.210882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.825 [2024-11-18 02:01:09.221470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.825 [2024-11-18 02:01:09.221506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.232246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.232276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.242951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.242981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.253670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.253701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.264265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.264295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.275479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.275507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.286368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.286396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.297509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.297537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.310481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.310509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.320901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.320931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.331919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.331949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.344963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.344995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.355066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.355096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.366329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.366359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.377505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.377532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.388501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.388529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.399635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.399664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.410802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.410832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.421792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.421822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.433035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.433073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.444084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.444114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.455252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.455282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.466352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.466397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.083 [2024-11-18 02:01:09.477339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.083 [2024-11-18 02:01:09.477380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.488717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.488747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.500024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.500053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.513053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.513082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.523481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.523508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.534802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.534832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.545655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.545685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.557109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.557140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.568083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.568113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.579237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.579266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.590417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.590444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.601744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.601774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.613276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.613306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.624482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.624509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.635753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.635783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.647115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.647152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.657944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.657973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.671282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.671319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.682169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.682198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.693415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.693443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.706559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.706586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.717195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.717225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.728008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.342 [2024-11-18 02:01:09.728038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.342 [2024-11-18 02:01:09.739345] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.343 [2024-11-18 02:01:09.739388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.750555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.750582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.761615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.761643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.772715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.772744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.785959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.785988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.796548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.796575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.807433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.807460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.818209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.818238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.829222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.829252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.840418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.840445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.851530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.851558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.864523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.864551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.874959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.874989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.885728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.885758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.897221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.897250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.908650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.908680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.920098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.920128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.930553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.930580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.941583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.941610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.952992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.953022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.964289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.964329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.975089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.975119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.987960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.987990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.601 [2024-11-18 02:01:09.997824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.601 [2024-11-18 02:01:09.997854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.859 [2024-11-18 02:01:10.009612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.859 [2024-11-18 02:01:10.009641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.859 [2024-11-18 02:01:10.020546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.859 [2024-11-18 02:01:10.020574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.031155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.031182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.043463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.043497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.058536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.058570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.073873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.073911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.085845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.085876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.097031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.097061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.108186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.108216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.121228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.121259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.131370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.131397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.142708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.142738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.154152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.154183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.165022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.165052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.176074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.176104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.187767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.187797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.198613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.198644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.209502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.209533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.220032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.220062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.233674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.233705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.244487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.244517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:35.860 [2024-11-18 02:01:10.255682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:35.860 [2024-11-18 02:01:10.255712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.266641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.266671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.278397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.278427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.289477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.289507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.300631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.300661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.312007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.312037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.323366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.323396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.334747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.334777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.345660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.345690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.356523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.356553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.367443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.367473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.378472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.378502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.389615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.389645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.400292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.400333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.411299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.411340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.424324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.424355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.434546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.434586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.118 [2024-11-18 02:01:10.445201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.118 [2024-11-18 02:01:10.445231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.119 [2024-11-18 02:01:10.458174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.119 [2024-11-18 02:01:10.458204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.119 [2024-11-18 02:01:10.468693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.119 [2024-11-18 02:01:10.468723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.119 [2024-11-18 02:01:10.479860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.119 [2024-11-18 02:01:10.479890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.119 [2024-11-18 02:01:10.492425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.119 [2024-11-18 02:01:10.492455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.119 [2024-11-18 02:01:10.502240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.119 [2024-11-18 02:01:10.502271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.119 [2024-11-18 02:01:10.513175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.119 [2024-11-18 02:01:10.513206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.377 [2024-11-18 02:01:10.524229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.377 [2024-11-18 02:01:10.524260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.377 [2024-11-18 02:01:10.534989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.377 [2024-11-18 02:01:10.535019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.377 [2024-11-18 02:01:10.547602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.377 [2024-11-18 02:01:10.547631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.377 [2024-11-18 02:01:10.557462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.377 [2024-11-18 02:01:10.557492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.377 [2024-11-18 02:01:10.568214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.377 [2024-11-18 02:01:10.568244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.377 [2024-11-18 02:01:10.579288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.377 [2024-11-18 02:01:10.579327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.377 [2024-11-18 02:01:10.590230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.377 [2024-11-18 02:01:10.590260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.377 [2024-11-18 02:01:10.602853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.377 [2024-11-18 02:01:10.602883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.377 [2024-11-18 02:01:10.612377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.377 [2024-11-18 02:01:10.612407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.377 [2024-11-18 02:01:10.624253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.377 [2024-11-18 02:01:10.624283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.637653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.637683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.648105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.648136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.659061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.659092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.671759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.671790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.681807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.681837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.692750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.692780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.703551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.703582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.714500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.714540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.725623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.725653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.736689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.736719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.747608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.747638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.758258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.758289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.769009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.769039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.378 [2024-11-18 02:01:10.780060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.378 [2024-11-18 02:01:10.780092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.792899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.792929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.802912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.802942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.814537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.814567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.825828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.825858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.838927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.838957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.849112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.849142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.859809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.859840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.870627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.870657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.881701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.881731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.892533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.892563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.903491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.903521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.914553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.914583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.925710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.925748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.936982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.937012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.949860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.949890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.960322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.960352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.970905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.970935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.981735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.981765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:10.992932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:10.992963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:11.005485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:11.005515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:11.015887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:11.015917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:11.026667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:11.026698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.637 [2024-11-18 02:01:11.038032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.637 [2024-11-18 02:01:11.038062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.049451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.049481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.060366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.060397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.071119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.071150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.082146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.082176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.092992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.093022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.103979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.104009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.115096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.115125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.126136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.126166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.138967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.139006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.149462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.149493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.160627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.160656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.171147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.171176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.182274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.182304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.194921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.194951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.204959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.204989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.216442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.216472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.227869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.227899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.238148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.238178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.249004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.249034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.260432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.260462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.271420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.271450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.282444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.282474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.896 [2024-11-18 02:01:11.293740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.896 [2024-11-18 02:01:11.293771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.305366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.305397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.318473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.318504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.328814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.328844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.340101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.340133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.350948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.350986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.361994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.362024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.373066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.373096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.384011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.384041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.396587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.396617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.406643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.406673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.417416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.417447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.428409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.428439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.439386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.439416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.450565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.450594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.461352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.461382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.472362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.472393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.483168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.483198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.493969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.493999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.504943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.504973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.517629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.517659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.527401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.527431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.538429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.538460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.155 [2024-11-18 02:01:11.549151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.155 [2024-11-18 02:01:11.549192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.560466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.560510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.573392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.573422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.583583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.583613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.594493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.594524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.605145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.605176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.616415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.616446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.622928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.622958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 00:18:37.414 Latency(us) 00:18:37.414 [2024-11-18T01:01:11.816Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:37.414 [2024-11-18T01:01:11.816Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:18:37.414 Nvme1n1 : 5.01 11506.59 89.90 0.00 0.00 11109.08 4975.88 25826.04 00:18:37.414 [2024-11-18T01:01:11.816Z] =================================================================================================================== 00:18:37.414 [2024-11-18T01:01:11.816Z] Total : 11506.59 89.90 0.00 0.00 11109.08 4975.88 25826.04 00:18:37.414 [2024-11-18 02:01:11.630652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.630681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.638670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.638699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.646732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.646778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.654784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.654839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.670833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.670897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.678824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.678873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.686855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.414 [2024-11-18 02:01:11.686904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.414 [2024-11-18 02:01:11.694876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.694925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.702895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.702942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.710918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.710967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.718940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.718991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.726970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.727021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.734992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.735040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.743006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.743052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.751028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.751075] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.759047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.759097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.767063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.767108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.775050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.775077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.783086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.783121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.791150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.791200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.799160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.799209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.807170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.807212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.415 [2024-11-18 02:01:11.815174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.415 [2024-11-18 02:01:11.815206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.673 [2024-11-18 02:01:11.823239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.673 [2024-11-18 02:01:11.823287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.673 [2024-11-18 02:01:11.831257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.673 [2024-11-18 02:01:11.831308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.673 [2024-11-18 02:01:11.839270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.673 [2024-11-18 02:01:11.839323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.673 [2024-11-18 02:01:11.847247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.673 [2024-11-18 02:01:11.847272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.673 [2024-11-18 02:01:11.855269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.673 [2024-11-18 02:01:11.855294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.673 [2024-11-18 02:01:11.863291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.673 [2024-11-18 02:01:11.863325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.673 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (1213540) - No such process 00:18:37.673 02:01:11 -- target/zcopy.sh@49 -- # wait 1213540 00:18:37.673 02:01:11 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:18:37.673 02:01:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:37.673 02:01:11 -- common/autotest_common.sh@10 -- # set +x 00:18:37.673 02:01:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:37.673 02:01:11 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:18:37.673 02:01:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:37.673 02:01:11 -- common/autotest_common.sh@10 -- # set +x 00:18:37.673 delay0 00:18:37.673 02:01:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:37.673 02:01:11 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:18:37.673 02:01:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:37.673 02:01:11 -- common/autotest_common.sh@10 -- # set +x 00:18:37.673 02:01:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:37.673 02:01:11 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:18:37.673 EAL: No free 2048 kB hugepages reported on node 1 00:18:37.673 [2024-11-18 02:01:11.982262] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:18:44.236 Initializing NVMe Controllers 00:18:44.236 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:44.236 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:44.236 Initialization complete. Launching workers. 00:18:44.236 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 124 00:18:44.236 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 411, failed to submit 33 00:18:44.236 success 259, unsuccess 152, failed 0 00:18:44.236 02:01:18 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:18:44.236 02:01:18 -- target/zcopy.sh@60 -- # nvmftestfini 00:18:44.236 02:01:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:44.236 02:01:18 -- nvmf/common.sh@116 -- # sync 00:18:44.236 02:01:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:44.236 02:01:18 -- nvmf/common.sh@119 -- # set +e 00:18:44.236 02:01:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:44.236 02:01:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:44.236 rmmod nvme_tcp 00:18:44.236 rmmod nvme_fabrics 00:18:44.236 rmmod nvme_keyring 00:18:44.236 02:01:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:44.236 02:01:18 -- nvmf/common.sh@123 -- # set -e 00:18:44.236 02:01:18 -- nvmf/common.sh@124 -- # return 0 00:18:44.236 02:01:18 -- nvmf/common.sh@477 -- # '[' -n 1212037 ']' 00:18:44.236 02:01:18 -- nvmf/common.sh@478 -- # killprocess 1212037 00:18:44.236 02:01:18 -- common/autotest_common.sh@936 -- # '[' -z 1212037 ']' 00:18:44.236 02:01:18 -- common/autotest_common.sh@940 -- # kill -0 1212037 00:18:44.236 02:01:18 -- common/autotest_common.sh@941 -- # uname 00:18:44.236 02:01:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:44.236 02:01:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1212037 00:18:44.236 02:01:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:44.236 02:01:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:44.236 02:01:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1212037' 00:18:44.236 killing process with pid 1212037 00:18:44.236 02:01:18 -- common/autotest_common.sh@955 -- # kill 1212037 00:18:44.236 02:01:18 -- common/autotest_common.sh@960 -- # wait 1212037 00:18:44.236 02:01:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:44.236 02:01:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:44.236 02:01:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:44.236 02:01:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:44.236 02:01:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:44.236 02:01:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:44.236 02:01:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:44.236 02:01:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:46.143 02:01:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:46.143 00:18:46.143 real 0m28.322s 00:18:46.143 user 0m41.711s 00:18:46.143 sys 0m8.066s 00:18:46.143 02:01:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:46.143 02:01:20 -- common/autotest_common.sh@10 -- # set +x 00:18:46.143 ************************************ 00:18:46.143 END TEST nvmf_zcopy 00:18:46.143 ************************************ 00:18:46.143 02:01:20 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:46.143 02:01:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:46.143 02:01:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:46.143 02:01:20 -- common/autotest_common.sh@10 -- # set +x 00:18:46.143 ************************************ 00:18:46.143 START TEST nvmf_nmic 00:18:46.143 ************************************ 00:18:46.143 02:01:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:46.143 * Looking for test storage... 00:18:46.143 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:46.143 02:01:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:46.143 02:01:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:46.143 02:01:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:46.402 02:01:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:46.402 02:01:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:46.402 02:01:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:46.402 02:01:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:46.402 02:01:20 -- scripts/common.sh@335 -- # IFS=.-: 00:18:46.402 02:01:20 -- scripts/common.sh@335 -- # read -ra ver1 00:18:46.402 02:01:20 -- scripts/common.sh@336 -- # IFS=.-: 00:18:46.402 02:01:20 -- scripts/common.sh@336 -- # read -ra ver2 00:18:46.402 02:01:20 -- scripts/common.sh@337 -- # local 'op=<' 00:18:46.402 02:01:20 -- scripts/common.sh@339 -- # ver1_l=2 00:18:46.402 02:01:20 -- scripts/common.sh@340 -- # ver2_l=1 00:18:46.402 02:01:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:46.402 02:01:20 -- scripts/common.sh@343 -- # case "$op" in 00:18:46.402 02:01:20 -- scripts/common.sh@344 -- # : 1 00:18:46.402 02:01:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:46.402 02:01:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:46.402 02:01:20 -- scripts/common.sh@364 -- # decimal 1 00:18:46.402 02:01:20 -- scripts/common.sh@352 -- # local d=1 00:18:46.402 02:01:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:46.402 02:01:20 -- scripts/common.sh@354 -- # echo 1 00:18:46.402 02:01:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:46.402 02:01:20 -- scripts/common.sh@365 -- # decimal 2 00:18:46.402 02:01:20 -- scripts/common.sh@352 -- # local d=2 00:18:46.402 02:01:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:46.402 02:01:20 -- scripts/common.sh@354 -- # echo 2 00:18:46.402 02:01:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:46.402 02:01:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:46.402 02:01:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:46.402 02:01:20 -- scripts/common.sh@367 -- # return 0 00:18:46.402 02:01:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:46.402 02:01:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:46.402 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:46.402 --rc genhtml_branch_coverage=1 00:18:46.402 --rc genhtml_function_coverage=1 00:18:46.402 --rc genhtml_legend=1 00:18:46.402 --rc geninfo_all_blocks=1 00:18:46.402 --rc geninfo_unexecuted_blocks=1 00:18:46.402 00:18:46.402 ' 00:18:46.402 02:01:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:46.402 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:46.402 --rc genhtml_branch_coverage=1 00:18:46.402 --rc genhtml_function_coverage=1 00:18:46.402 --rc genhtml_legend=1 00:18:46.402 --rc geninfo_all_blocks=1 00:18:46.402 --rc geninfo_unexecuted_blocks=1 00:18:46.402 00:18:46.402 ' 00:18:46.402 02:01:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:46.402 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:46.402 --rc genhtml_branch_coverage=1 00:18:46.402 --rc genhtml_function_coverage=1 00:18:46.402 --rc genhtml_legend=1 00:18:46.402 --rc geninfo_all_blocks=1 00:18:46.402 --rc geninfo_unexecuted_blocks=1 00:18:46.402 00:18:46.402 ' 00:18:46.402 02:01:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:46.402 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:46.402 --rc genhtml_branch_coverage=1 00:18:46.402 --rc genhtml_function_coverage=1 00:18:46.402 --rc genhtml_legend=1 00:18:46.402 --rc geninfo_all_blocks=1 00:18:46.402 --rc geninfo_unexecuted_blocks=1 00:18:46.402 00:18:46.402 ' 00:18:46.402 02:01:20 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:46.402 02:01:20 -- nvmf/common.sh@7 -- # uname -s 00:18:46.402 02:01:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:46.402 02:01:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:46.402 02:01:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:46.402 02:01:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:46.402 02:01:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:46.402 02:01:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:46.402 02:01:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:46.402 02:01:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:46.402 02:01:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:46.402 02:01:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:46.402 02:01:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:46.402 02:01:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:46.402 02:01:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:46.402 02:01:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:46.402 02:01:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:46.402 02:01:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:46.402 02:01:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:46.402 02:01:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:46.402 02:01:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:46.402 02:01:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:46.402 02:01:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:46.402 02:01:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:46.402 02:01:20 -- paths/export.sh@5 -- # export PATH 00:18:46.403 02:01:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:46.403 02:01:20 -- nvmf/common.sh@46 -- # : 0 00:18:46.403 02:01:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:46.403 02:01:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:46.403 02:01:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:46.403 02:01:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:46.403 02:01:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:46.403 02:01:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:46.403 02:01:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:46.403 02:01:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:46.403 02:01:20 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:46.403 02:01:20 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:46.403 02:01:20 -- target/nmic.sh@14 -- # nvmftestinit 00:18:46.403 02:01:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:46.403 02:01:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:46.403 02:01:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:46.403 02:01:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:46.403 02:01:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:46.403 02:01:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:46.403 02:01:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:46.403 02:01:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:46.403 02:01:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:46.403 02:01:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:46.403 02:01:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:46.403 02:01:20 -- common/autotest_common.sh@10 -- # set +x 00:18:48.305 02:01:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:48.305 02:01:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:48.305 02:01:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:48.305 02:01:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:48.305 02:01:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:48.305 02:01:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:48.305 02:01:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:48.305 02:01:22 -- nvmf/common.sh@294 -- # net_devs=() 00:18:48.306 02:01:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:48.306 02:01:22 -- nvmf/common.sh@295 -- # e810=() 00:18:48.306 02:01:22 -- nvmf/common.sh@295 -- # local -ga e810 00:18:48.306 02:01:22 -- nvmf/common.sh@296 -- # x722=() 00:18:48.306 02:01:22 -- nvmf/common.sh@296 -- # local -ga x722 00:18:48.306 02:01:22 -- nvmf/common.sh@297 -- # mlx=() 00:18:48.306 02:01:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:48.306 02:01:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:48.306 02:01:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:48.306 02:01:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:48.306 02:01:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:48.306 02:01:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:48.306 02:01:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:48.306 02:01:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:48.306 02:01:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:48.306 02:01:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:48.306 02:01:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:48.306 02:01:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:48.306 02:01:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:48.306 02:01:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:48.306 02:01:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:48.306 02:01:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:48.306 02:01:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:48.306 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:48.306 02:01:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:48.306 02:01:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:48.306 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:48.306 02:01:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:48.306 02:01:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:48.306 02:01:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:48.306 02:01:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:48.306 02:01:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:48.306 02:01:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:48.306 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:48.306 02:01:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:48.306 02:01:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:48.306 02:01:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:48.306 02:01:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:48.306 02:01:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:48.306 02:01:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:48.306 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:48.306 02:01:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:48.306 02:01:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:48.306 02:01:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:48.306 02:01:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:48.306 02:01:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:48.306 02:01:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:48.306 02:01:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:48.306 02:01:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:48.306 02:01:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:48.306 02:01:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:48.306 02:01:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:48.306 02:01:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:48.306 02:01:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:48.306 02:01:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:48.306 02:01:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:48.306 02:01:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:48.306 02:01:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:48.306 02:01:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:48.565 02:01:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:48.565 02:01:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:48.565 02:01:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:48.565 02:01:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:48.565 02:01:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:48.565 02:01:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:48.565 02:01:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:48.565 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:48.565 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:18:48.565 00:18:48.565 --- 10.0.0.2 ping statistics --- 00:18:48.565 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:48.565 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:18:48.565 02:01:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:48.565 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:48.565 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:18:48.565 00:18:48.565 --- 10.0.0.1 ping statistics --- 00:18:48.565 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:48.565 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:18:48.565 02:01:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:48.565 02:01:22 -- nvmf/common.sh@410 -- # return 0 00:18:48.565 02:01:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:48.565 02:01:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:48.565 02:01:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:48.565 02:01:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:48.565 02:01:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:48.565 02:01:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:48.565 02:01:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:48.565 02:01:22 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:18:48.565 02:01:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:48.565 02:01:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:48.565 02:01:22 -- common/autotest_common.sh@10 -- # set +x 00:18:48.565 02:01:22 -- nvmf/common.sh@469 -- # nvmfpid=1216904 00:18:48.565 02:01:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:48.565 02:01:22 -- nvmf/common.sh@470 -- # waitforlisten 1216904 00:18:48.565 02:01:22 -- common/autotest_common.sh@829 -- # '[' -z 1216904 ']' 00:18:48.565 02:01:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:48.565 02:01:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:48.565 02:01:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:48.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:48.565 02:01:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:48.565 02:01:22 -- common/autotest_common.sh@10 -- # set +x 00:18:48.565 [2024-11-18 02:01:22.918712] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:48.565 [2024-11-18 02:01:22.918799] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:48.565 EAL: No free 2048 kB hugepages reported on node 1 00:18:48.824 [2024-11-18 02:01:22.993746] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:48.824 [2024-11-18 02:01:23.088364] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:48.824 [2024-11-18 02:01:23.088518] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:48.824 [2024-11-18 02:01:23.088537] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:48.824 [2024-11-18 02:01:23.088552] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:48.824 [2024-11-18 02:01:23.088640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:48.824 [2024-11-18 02:01:23.088699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:48.824 [2024-11-18 02:01:23.088753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:48.824 [2024-11-18 02:01:23.088756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:49.758 02:01:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:49.758 02:01:23 -- common/autotest_common.sh@862 -- # return 0 00:18:49.758 02:01:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:49.758 02:01:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:49.758 02:01:23 -- common/autotest_common.sh@10 -- # set +x 00:18:49.758 02:01:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:49.758 02:01:23 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:49.758 02:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.758 02:01:23 -- common/autotest_common.sh@10 -- # set +x 00:18:49.758 [2024-11-18 02:01:23.892804] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:49.758 02:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.758 02:01:23 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:49.758 02:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.758 02:01:23 -- common/autotest_common.sh@10 -- # set +x 00:18:49.758 Malloc0 00:18:49.758 02:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.758 02:01:23 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:18:49.758 02:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.758 02:01:23 -- common/autotest_common.sh@10 -- # set +x 00:18:49.758 02:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.758 02:01:23 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:49.758 02:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.758 02:01:23 -- common/autotest_common.sh@10 -- # set +x 00:18:49.758 02:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.758 02:01:23 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:49.758 02:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.758 02:01:23 -- common/autotest_common.sh@10 -- # set +x 00:18:49.758 [2024-11-18 02:01:23.944037] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:49.758 02:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.758 02:01:23 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:18:49.758 test case1: single bdev can't be used in multiple subsystems 00:18:49.758 02:01:23 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:49.758 02:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.758 02:01:23 -- common/autotest_common.sh@10 -- # set +x 00:18:49.758 02:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.758 02:01:23 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:49.758 02:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.758 02:01:23 -- common/autotest_common.sh@10 -- # set +x 00:18:49.758 02:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.758 02:01:23 -- target/nmic.sh@28 -- # nmic_status=0 00:18:49.758 02:01:23 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:18:49.758 02:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.758 02:01:23 -- common/autotest_common.sh@10 -- # set +x 00:18:49.758 [2024-11-18 02:01:23.967906] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:18:49.758 [2024-11-18 02:01:23.967935] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:18:49.758 [2024-11-18 02:01:23.967965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:49.758 request: 00:18:49.758 { 00:18:49.758 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:18:49.758 "namespace": { 00:18:49.758 "bdev_name": "Malloc0" 00:18:49.758 }, 00:18:49.758 "method": "nvmf_subsystem_add_ns", 00:18:49.758 "req_id": 1 00:18:49.758 } 00:18:49.759 Got JSON-RPC error response 00:18:49.759 response: 00:18:49.759 { 00:18:49.759 "code": -32602, 00:18:49.759 "message": "Invalid parameters" 00:18:49.759 } 00:18:49.759 02:01:23 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:18:49.759 02:01:23 -- target/nmic.sh@29 -- # nmic_status=1 00:18:49.759 02:01:23 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:18:49.759 02:01:23 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:18:49.759 Adding namespace failed - expected result. 00:18:49.759 02:01:23 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:18:49.759 test case2: host connect to nvmf target in multiple paths 00:18:49.759 02:01:23 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:18:49.759 02:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.759 02:01:23 -- common/autotest_common.sh@10 -- # set +x 00:18:49.759 [2024-11-18 02:01:23.976021] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:18:49.759 02:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.759 02:01:23 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:50.323 02:01:24 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:18:50.887 02:01:25 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:18:50.887 02:01:25 -- common/autotest_common.sh@1187 -- # local i=0 00:18:50.887 02:01:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:18:50.887 02:01:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:18:50.887 02:01:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:18:52.784 02:01:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:18:52.784 02:01:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:18:52.784 02:01:27 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:18:53.042 02:01:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:18:53.042 02:01:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:18:53.042 02:01:27 -- common/autotest_common.sh@1197 -- # return 0 00:18:53.042 02:01:27 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:18:53.042 [global] 00:18:53.042 thread=1 00:18:53.042 invalidate=1 00:18:53.042 rw=write 00:18:53.042 time_based=1 00:18:53.042 runtime=1 00:18:53.042 ioengine=libaio 00:18:53.042 direct=1 00:18:53.042 bs=4096 00:18:53.042 iodepth=1 00:18:53.042 norandommap=0 00:18:53.042 numjobs=1 00:18:53.042 00:18:53.042 verify_dump=1 00:18:53.042 verify_backlog=512 00:18:53.042 verify_state_save=0 00:18:53.042 do_verify=1 00:18:53.042 verify=crc32c-intel 00:18:53.042 [job0] 00:18:53.042 filename=/dev/nvme0n1 00:18:53.042 Could not set queue depth (nvme0n1) 00:18:53.042 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:53.042 fio-3.35 00:18:53.042 Starting 1 thread 00:18:54.415 00:18:54.415 job0: (groupid=0, jobs=1): err= 0: pid=1217556: Mon Nov 18 02:01:28 2024 00:18:54.415 read: IOPS=2336, BW=9345KiB/s (9569kB/s)(9476KiB/1014msec) 00:18:54.415 slat (nsec): min=5331, max=36486, avg=9812.15, stdev=5794.54 00:18:54.415 clat (usec): min=168, max=41007, avg=227.18, stdev=838.52 00:18:54.415 lat (usec): min=174, max=41014, avg=236.99, stdev=838.56 00:18:54.415 clat percentiles (usec): 00:18:54.415 | 1.00th=[ 174], 5.00th=[ 182], 10.00th=[ 184], 20.00th=[ 190], 00:18:54.415 | 30.00th=[ 194], 40.00th=[ 198], 50.00th=[ 206], 60.00th=[ 215], 00:18:54.415 | 70.00th=[ 225], 80.00th=[ 233], 90.00th=[ 243], 95.00th=[ 251], 00:18:54.415 | 99.00th=[ 265], 99.50th=[ 269], 99.90th=[ 289], 99.95th=[ 355], 00:18:54.415 | 99.99th=[41157] 00:18:54.415 write: IOPS=2524, BW=9.86MiB/s (10.3MB/s)(10.0MiB/1014msec); 0 zone resets 00:18:54.415 slat (nsec): min=6979, max=51548, avg=12853.43, stdev=7251.74 00:18:54.415 clat (usec): min=120, max=287, avg=157.30, stdev=28.88 00:18:54.415 lat (usec): min=128, max=308, avg=170.15, stdev=33.58 00:18:54.415 clat percentiles (usec): 00:18:54.415 | 1.00th=[ 124], 5.00th=[ 127], 10.00th=[ 129], 20.00th=[ 133], 00:18:54.415 | 30.00th=[ 137], 40.00th=[ 141], 50.00th=[ 147], 60.00th=[ 159], 00:18:54.415 | 70.00th=[ 169], 80.00th=[ 180], 90.00th=[ 204], 95.00th=[ 212], 00:18:54.415 | 99.00th=[ 229], 99.50th=[ 269], 99.90th=[ 281], 99.95th=[ 281], 00:18:54.415 | 99.99th=[ 289] 00:18:54.415 bw ( KiB/s): min=10088, max=10392, per=100.00%, avg=10240.00, stdev=214.96, samples=2 00:18:54.415 iops : min= 2522, max= 2598, avg=2560.00, stdev=53.74, samples=2 00:18:54.415 lat (usec) : 250=97.26%, 500=2.72% 00:18:54.415 lat (msec) : 50=0.02% 00:18:54.415 cpu : usr=4.05%, sys=7.60%, ctx=4929, majf=0, minf=1 00:18:54.415 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:54.415 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:54.415 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:54.415 issued rwts: total=2369,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:54.415 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:54.415 00:18:54.415 Run status group 0 (all jobs): 00:18:54.415 READ: bw=9345KiB/s (9569kB/s), 9345KiB/s-9345KiB/s (9569kB/s-9569kB/s), io=9476KiB (9703kB), run=1014-1014msec 00:18:54.415 WRITE: bw=9.86MiB/s (10.3MB/s), 9.86MiB/s-9.86MiB/s (10.3MB/s-10.3MB/s), io=10.0MiB (10.5MB), run=1014-1014msec 00:18:54.415 00:18:54.415 Disk stats (read/write): 00:18:54.415 nvme0n1: ios=2098/2511, merge=0/0, ticks=453/369, in_queue=822, util=95.69% 00:18:54.415 02:01:28 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:18:54.415 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:18:54.415 02:01:28 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:18:54.415 02:01:28 -- common/autotest_common.sh@1208 -- # local i=0 00:18:54.415 02:01:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:18:54.415 02:01:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:54.415 02:01:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:18:54.415 02:01:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:54.415 02:01:28 -- common/autotest_common.sh@1220 -- # return 0 00:18:54.415 02:01:28 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:18:54.415 02:01:28 -- target/nmic.sh@53 -- # nvmftestfini 00:18:54.415 02:01:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:54.415 02:01:28 -- nvmf/common.sh@116 -- # sync 00:18:54.415 02:01:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:54.415 02:01:28 -- nvmf/common.sh@119 -- # set +e 00:18:54.415 02:01:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:54.415 02:01:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:54.415 rmmod nvme_tcp 00:18:54.415 rmmod nvme_fabrics 00:18:54.415 rmmod nvme_keyring 00:18:54.415 02:01:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:54.415 02:01:28 -- nvmf/common.sh@123 -- # set -e 00:18:54.415 02:01:28 -- nvmf/common.sh@124 -- # return 0 00:18:54.415 02:01:28 -- nvmf/common.sh@477 -- # '[' -n 1216904 ']' 00:18:54.415 02:01:28 -- nvmf/common.sh@478 -- # killprocess 1216904 00:18:54.415 02:01:28 -- common/autotest_common.sh@936 -- # '[' -z 1216904 ']' 00:18:54.415 02:01:28 -- common/autotest_common.sh@940 -- # kill -0 1216904 00:18:54.415 02:01:28 -- common/autotest_common.sh@941 -- # uname 00:18:54.415 02:01:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:54.415 02:01:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1216904 00:18:54.710 02:01:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:54.710 02:01:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:54.710 02:01:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1216904' 00:18:54.710 killing process with pid 1216904 00:18:54.710 02:01:28 -- common/autotest_common.sh@955 -- # kill 1216904 00:18:54.710 02:01:28 -- common/autotest_common.sh@960 -- # wait 1216904 00:18:55.012 02:01:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:55.012 02:01:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:55.012 02:01:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:55.012 02:01:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:55.012 02:01:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:55.012 02:01:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:55.012 02:01:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:55.012 02:01:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:56.912 02:01:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:56.912 00:18:56.912 real 0m10.682s 00:18:56.912 user 0m25.049s 00:18:56.912 sys 0m2.575s 00:18:56.912 02:01:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:56.912 02:01:31 -- common/autotest_common.sh@10 -- # set +x 00:18:56.912 ************************************ 00:18:56.912 END TEST nvmf_nmic 00:18:56.912 ************************************ 00:18:56.912 02:01:31 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:18:56.912 02:01:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:56.912 02:01:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:56.912 02:01:31 -- common/autotest_common.sh@10 -- # set +x 00:18:56.912 ************************************ 00:18:56.912 START TEST nvmf_fio_target 00:18:56.912 ************************************ 00:18:56.912 02:01:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:18:56.912 * Looking for test storage... 00:18:56.912 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:56.912 02:01:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:56.912 02:01:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:56.912 02:01:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:56.912 02:01:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:56.912 02:01:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:56.912 02:01:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:56.912 02:01:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:56.912 02:01:31 -- scripts/common.sh@335 -- # IFS=.-: 00:18:56.912 02:01:31 -- scripts/common.sh@335 -- # read -ra ver1 00:18:57.171 02:01:31 -- scripts/common.sh@336 -- # IFS=.-: 00:18:57.171 02:01:31 -- scripts/common.sh@336 -- # read -ra ver2 00:18:57.171 02:01:31 -- scripts/common.sh@337 -- # local 'op=<' 00:18:57.171 02:01:31 -- scripts/common.sh@339 -- # ver1_l=2 00:18:57.171 02:01:31 -- scripts/common.sh@340 -- # ver2_l=1 00:18:57.171 02:01:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:57.171 02:01:31 -- scripts/common.sh@343 -- # case "$op" in 00:18:57.171 02:01:31 -- scripts/common.sh@344 -- # : 1 00:18:57.171 02:01:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:57.171 02:01:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:57.171 02:01:31 -- scripts/common.sh@364 -- # decimal 1 00:18:57.171 02:01:31 -- scripts/common.sh@352 -- # local d=1 00:18:57.171 02:01:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:57.171 02:01:31 -- scripts/common.sh@354 -- # echo 1 00:18:57.171 02:01:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:57.171 02:01:31 -- scripts/common.sh@365 -- # decimal 2 00:18:57.171 02:01:31 -- scripts/common.sh@352 -- # local d=2 00:18:57.171 02:01:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:57.171 02:01:31 -- scripts/common.sh@354 -- # echo 2 00:18:57.171 02:01:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:57.171 02:01:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:57.171 02:01:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:57.171 02:01:31 -- scripts/common.sh@367 -- # return 0 00:18:57.171 02:01:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:57.171 02:01:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:57.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:57.171 --rc genhtml_branch_coverage=1 00:18:57.171 --rc genhtml_function_coverage=1 00:18:57.171 --rc genhtml_legend=1 00:18:57.171 --rc geninfo_all_blocks=1 00:18:57.171 --rc geninfo_unexecuted_blocks=1 00:18:57.171 00:18:57.171 ' 00:18:57.171 02:01:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:57.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:57.171 --rc genhtml_branch_coverage=1 00:18:57.171 --rc genhtml_function_coverage=1 00:18:57.171 --rc genhtml_legend=1 00:18:57.171 --rc geninfo_all_blocks=1 00:18:57.171 --rc geninfo_unexecuted_blocks=1 00:18:57.171 00:18:57.171 ' 00:18:57.171 02:01:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:57.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:57.171 --rc genhtml_branch_coverage=1 00:18:57.171 --rc genhtml_function_coverage=1 00:18:57.171 --rc genhtml_legend=1 00:18:57.171 --rc geninfo_all_blocks=1 00:18:57.171 --rc geninfo_unexecuted_blocks=1 00:18:57.171 00:18:57.171 ' 00:18:57.171 02:01:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:57.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:57.171 --rc genhtml_branch_coverage=1 00:18:57.171 --rc genhtml_function_coverage=1 00:18:57.171 --rc genhtml_legend=1 00:18:57.171 --rc geninfo_all_blocks=1 00:18:57.171 --rc geninfo_unexecuted_blocks=1 00:18:57.171 00:18:57.171 ' 00:18:57.171 02:01:31 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:57.171 02:01:31 -- nvmf/common.sh@7 -- # uname -s 00:18:57.171 02:01:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:57.171 02:01:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:57.171 02:01:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:57.171 02:01:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:57.171 02:01:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:57.171 02:01:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:57.171 02:01:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:57.171 02:01:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:57.171 02:01:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:57.171 02:01:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:57.171 02:01:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:57.171 02:01:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:57.171 02:01:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:57.171 02:01:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:57.171 02:01:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:57.171 02:01:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:57.171 02:01:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:57.171 02:01:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:57.172 02:01:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:57.172 02:01:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.172 02:01:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.172 02:01:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.172 02:01:31 -- paths/export.sh@5 -- # export PATH 00:18:57.172 02:01:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.172 02:01:31 -- nvmf/common.sh@46 -- # : 0 00:18:57.172 02:01:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:57.172 02:01:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:57.172 02:01:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:57.172 02:01:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:57.172 02:01:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:57.172 02:01:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:57.172 02:01:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:57.172 02:01:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:57.172 02:01:31 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:57.172 02:01:31 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:57.172 02:01:31 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:57.172 02:01:31 -- target/fio.sh@16 -- # nvmftestinit 00:18:57.172 02:01:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:57.172 02:01:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:57.172 02:01:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:57.172 02:01:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:57.172 02:01:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:57.172 02:01:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:57.172 02:01:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:57.172 02:01:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:57.172 02:01:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:57.172 02:01:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:57.172 02:01:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:57.172 02:01:31 -- common/autotest_common.sh@10 -- # set +x 00:18:59.076 02:01:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:59.076 02:01:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:59.076 02:01:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:59.076 02:01:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:59.076 02:01:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:59.076 02:01:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:59.076 02:01:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:59.076 02:01:33 -- nvmf/common.sh@294 -- # net_devs=() 00:18:59.076 02:01:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:59.076 02:01:33 -- nvmf/common.sh@295 -- # e810=() 00:18:59.076 02:01:33 -- nvmf/common.sh@295 -- # local -ga e810 00:18:59.076 02:01:33 -- nvmf/common.sh@296 -- # x722=() 00:18:59.076 02:01:33 -- nvmf/common.sh@296 -- # local -ga x722 00:18:59.076 02:01:33 -- nvmf/common.sh@297 -- # mlx=() 00:18:59.076 02:01:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:59.076 02:01:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:59.076 02:01:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:59.076 02:01:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:59.076 02:01:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:59.076 02:01:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:59.076 02:01:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:59.076 02:01:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:59.076 02:01:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:59.076 02:01:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:59.076 02:01:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:59.076 02:01:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:59.076 02:01:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:59.076 02:01:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:59.076 02:01:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:59.076 02:01:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:59.076 02:01:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:59.076 02:01:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:59.076 02:01:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:59.076 02:01:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:59.076 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:59.076 02:01:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:59.076 02:01:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:59.076 02:01:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:59.076 02:01:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:59.076 02:01:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:59.077 02:01:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:59.077 02:01:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:59.077 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:59.077 02:01:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:59.077 02:01:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:59.077 02:01:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:59.077 02:01:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:59.077 02:01:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:59.077 02:01:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:59.077 02:01:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:59.077 02:01:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:59.077 02:01:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:59.077 02:01:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:59.077 02:01:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:59.077 02:01:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:59.077 02:01:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:59.077 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:59.077 02:01:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:59.077 02:01:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:59.077 02:01:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:59.077 02:01:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:59.077 02:01:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:59.077 02:01:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:59.077 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:59.077 02:01:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:59.077 02:01:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:59.077 02:01:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:59.077 02:01:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:59.077 02:01:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:59.077 02:01:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:59.077 02:01:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:59.077 02:01:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:59.077 02:01:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:59.077 02:01:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:59.077 02:01:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:59.077 02:01:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:59.077 02:01:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:59.077 02:01:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:59.077 02:01:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:59.077 02:01:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:59.077 02:01:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:59.077 02:01:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:59.077 02:01:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:59.077 02:01:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:59.077 02:01:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:59.077 02:01:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:59.077 02:01:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:59.077 02:01:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:59.077 02:01:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:59.335 02:01:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:59.335 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:59.335 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:18:59.335 00:18:59.335 --- 10.0.0.2 ping statistics --- 00:18:59.335 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:59.335 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:18:59.335 02:01:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:59.335 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:59.335 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.178 ms 00:18:59.335 00:18:59.335 --- 10.0.0.1 ping statistics --- 00:18:59.335 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:59.336 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:18:59.336 02:01:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:59.336 02:01:33 -- nvmf/common.sh@410 -- # return 0 00:18:59.336 02:01:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:59.336 02:01:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:59.336 02:01:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:59.336 02:01:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:59.336 02:01:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:59.336 02:01:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:59.336 02:01:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:59.336 02:01:33 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:18:59.336 02:01:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:59.336 02:01:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:59.336 02:01:33 -- common/autotest_common.sh@10 -- # set +x 00:18:59.336 02:01:33 -- nvmf/common.sh@469 -- # nvmfpid=1219742 00:18:59.336 02:01:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:59.336 02:01:33 -- nvmf/common.sh@470 -- # waitforlisten 1219742 00:18:59.336 02:01:33 -- common/autotest_common.sh@829 -- # '[' -z 1219742 ']' 00:18:59.336 02:01:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:59.336 02:01:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:59.336 02:01:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:59.336 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:59.336 02:01:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:59.336 02:01:33 -- common/autotest_common.sh@10 -- # set +x 00:18:59.336 [2024-11-18 02:01:33.568029] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:59.336 [2024-11-18 02:01:33.568104] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:59.336 EAL: No free 2048 kB hugepages reported on node 1 00:18:59.336 [2024-11-18 02:01:33.633200] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:59.336 [2024-11-18 02:01:33.723532] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:59.336 [2024-11-18 02:01:33.723690] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:59.336 [2024-11-18 02:01:33.723706] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:59.336 [2024-11-18 02:01:33.723719] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:59.336 [2024-11-18 02:01:33.723771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:59.336 [2024-11-18 02:01:33.724015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:59.336 [2024-11-18 02:01:33.724077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:59.336 [2024-11-18 02:01:33.724079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:00.269 02:01:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:00.269 02:01:34 -- common/autotest_common.sh@862 -- # return 0 00:19:00.269 02:01:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:00.269 02:01:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:00.269 02:01:34 -- common/autotest_common.sh@10 -- # set +x 00:19:00.269 02:01:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:00.269 02:01:34 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:00.527 [2024-11-18 02:01:34.803779] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:00.527 02:01:34 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:00.785 02:01:35 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:00.785 02:01:35 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:01.043 02:01:35 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:01.043 02:01:35 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:01.301 02:01:35 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:01.301 02:01:35 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:01.560 02:01:35 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:01.560 02:01:35 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:01.817 02:01:36 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:02.076 02:01:36 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:02.076 02:01:36 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:02.334 02:01:36 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:02.334 02:01:36 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:02.592 02:01:36 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:02.592 02:01:36 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:02.850 02:01:37 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:03.108 02:01:37 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:03.108 02:01:37 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:03.366 02:01:37 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:03.366 02:01:37 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:03.624 02:01:37 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:03.882 [2024-11-18 02:01:38.194230] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:03.882 02:01:38 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:04.140 02:01:38 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:04.398 02:01:38 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:04.968 02:01:39 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:04.968 02:01:39 -- common/autotest_common.sh@1187 -- # local i=0 00:19:04.968 02:01:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:04.968 02:01:39 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:04.968 02:01:39 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:04.968 02:01:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:07.494 02:01:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:07.494 02:01:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:07.494 02:01:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:07.494 02:01:41 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:07.494 02:01:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:07.494 02:01:41 -- common/autotest_common.sh@1197 -- # return 0 00:19:07.494 02:01:41 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:07.494 [global] 00:19:07.494 thread=1 00:19:07.494 invalidate=1 00:19:07.494 rw=write 00:19:07.494 time_based=1 00:19:07.494 runtime=1 00:19:07.494 ioengine=libaio 00:19:07.494 direct=1 00:19:07.494 bs=4096 00:19:07.494 iodepth=1 00:19:07.494 norandommap=0 00:19:07.494 numjobs=1 00:19:07.494 00:19:07.494 verify_dump=1 00:19:07.494 verify_backlog=512 00:19:07.494 verify_state_save=0 00:19:07.494 do_verify=1 00:19:07.494 verify=crc32c-intel 00:19:07.494 [job0] 00:19:07.494 filename=/dev/nvme0n1 00:19:07.494 [job1] 00:19:07.494 filename=/dev/nvme0n2 00:19:07.494 [job2] 00:19:07.494 filename=/dev/nvme0n3 00:19:07.494 [job3] 00:19:07.494 filename=/dev/nvme0n4 00:19:07.494 Could not set queue depth (nvme0n1) 00:19:07.494 Could not set queue depth (nvme0n2) 00:19:07.494 Could not set queue depth (nvme0n3) 00:19:07.494 Could not set queue depth (nvme0n4) 00:19:07.494 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:07.494 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:07.494 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:07.494 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:07.494 fio-3.35 00:19:07.494 Starting 4 threads 00:19:08.428 00:19:08.428 job0: (groupid=0, jobs=1): err= 0: pid=1220848: Mon Nov 18 02:01:42 2024 00:19:08.428 read: IOPS=2030, BW=8124KiB/s (8319kB/s)(8132KiB/1001msec) 00:19:08.428 slat (nsec): min=4156, max=41637, avg=9971.67, stdev=3465.91 00:19:08.428 clat (usec): min=181, max=597, avg=269.80, stdev=97.20 00:19:08.428 lat (usec): min=185, max=607, avg=279.77, stdev=97.68 00:19:08.428 clat percentiles (usec): 00:19:08.428 | 1.00th=[ 192], 5.00th=[ 198], 10.00th=[ 200], 20.00th=[ 204], 00:19:08.428 | 30.00th=[ 210], 40.00th=[ 215], 50.00th=[ 219], 60.00th=[ 227], 00:19:08.428 | 70.00th=[ 265], 80.00th=[ 359], 90.00th=[ 449], 95.00th=[ 486], 00:19:08.428 | 99.00th=[ 537], 99.50th=[ 562], 99.90th=[ 594], 99.95th=[ 594], 00:19:08.428 | 99.99th=[ 594] 00:19:08.428 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:08.428 slat (nsec): min=7087, max=53858, avg=13454.82, stdev=4656.37 00:19:08.428 clat (usec): min=127, max=1047, avg=190.59, stdev=53.59 00:19:08.428 lat (usec): min=137, max=1060, avg=204.04, stdev=53.91 00:19:08.428 clat percentiles (usec): 00:19:08.428 | 1.00th=[ 135], 5.00th=[ 139], 10.00th=[ 143], 20.00th=[ 149], 00:19:08.428 | 30.00th=[ 155], 40.00th=[ 163], 50.00th=[ 176], 60.00th=[ 198], 00:19:08.428 | 70.00th=[ 217], 80.00th=[ 237], 90.00th=[ 245], 95.00th=[ 260], 00:19:08.428 | 99.00th=[ 326], 99.50th=[ 343], 99.90th=[ 709], 99.95th=[ 881], 00:19:08.428 | 99.99th=[ 1045] 00:19:08.428 bw ( KiB/s): min= 8192, max= 8192, per=37.38%, avg=8192.00, stdev= 0.00, samples=1 00:19:08.428 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:08.428 lat (usec) : 250=80.25%, 500=17.99%, 750=1.72%, 1000=0.02% 00:19:08.428 lat (msec) : 2=0.02% 00:19:08.428 cpu : usr=2.50%, sys=5.10%, ctx=4081, majf=0, minf=1 00:19:08.428 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:08.428 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.428 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.428 issued rwts: total=2033,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.428 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:08.428 job1: (groupid=0, jobs=1): err= 0: pid=1220849: Mon Nov 18 02:01:42 2024 00:19:08.428 read: IOPS=21, BW=85.7KiB/s (87.7kB/s)(88.0KiB/1027msec) 00:19:08.428 slat (nsec): min=8633, max=17872, avg=14400.59, stdev=2275.93 00:19:08.428 clat (usec): min=40973, max=42028, avg=41846.98, stdev=355.46 00:19:08.428 lat (usec): min=40988, max=42043, avg=41861.38, stdev=354.97 00:19:08.428 clat percentiles (usec): 00:19:08.428 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[42206], 00:19:08.428 | 30.00th=[42206], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:19:08.428 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:08.428 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:08.428 | 99.99th=[42206] 00:19:08.428 write: IOPS=498, BW=1994KiB/s (2042kB/s)(2048KiB/1027msec); 0 zone resets 00:19:08.428 slat (nsec): min=8669, max=52226, avg=17729.28, stdev=6988.66 00:19:08.428 clat (usec): min=143, max=459, avg=183.86, stdev=22.35 00:19:08.428 lat (usec): min=153, max=480, avg=201.58, stdev=25.80 00:19:08.428 clat percentiles (usec): 00:19:08.428 | 1.00th=[ 153], 5.00th=[ 159], 10.00th=[ 163], 20.00th=[ 172], 00:19:08.428 | 30.00th=[ 178], 40.00th=[ 182], 50.00th=[ 184], 60.00th=[ 188], 00:19:08.428 | 70.00th=[ 190], 80.00th=[ 194], 90.00th=[ 198], 95.00th=[ 206], 00:19:08.428 | 99.00th=[ 251], 99.50th=[ 343], 99.90th=[ 461], 99.95th=[ 461], 00:19:08.428 | 99.99th=[ 461] 00:19:08.428 bw ( KiB/s): min= 4096, max= 4096, per=18.69%, avg=4096.00, stdev= 0.00, samples=1 00:19:08.428 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:08.428 lat (usec) : 250=94.76%, 500=1.12% 00:19:08.428 lat (msec) : 50=4.12% 00:19:08.428 cpu : usr=0.78%, sys=0.97%, ctx=534, majf=0, minf=1 00:19:08.428 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:08.428 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.428 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.429 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.429 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:08.429 job2: (groupid=0, jobs=1): err= 0: pid=1220850: Mon Nov 18 02:01:42 2024 00:19:08.429 read: IOPS=1785, BW=7141KiB/s (7312kB/s)(7148KiB/1001msec) 00:19:08.429 slat (nsec): min=5740, max=48487, avg=11884.07, stdev=5644.59 00:19:08.429 clat (usec): min=176, max=41368, avg=293.48, stdev=975.29 00:19:08.429 lat (usec): min=189, max=41375, avg=305.37, stdev=975.32 00:19:08.429 clat percentiles (usec): 00:19:08.429 | 1.00th=[ 188], 5.00th=[ 202], 10.00th=[ 206], 20.00th=[ 217], 00:19:08.429 | 30.00th=[ 225], 40.00th=[ 237], 50.00th=[ 249], 60.00th=[ 260], 00:19:08.429 | 70.00th=[ 273], 80.00th=[ 302], 90.00th=[ 375], 95.00th=[ 469], 00:19:08.429 | 99.00th=[ 545], 99.50th=[ 553], 99.90th=[ 791], 99.95th=[41157], 00:19:08.429 | 99.99th=[41157] 00:19:08.429 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:08.429 slat (nsec): min=7692, max=73473, avg=14867.13, stdev=7293.88 00:19:08.429 clat (usec): min=123, max=868, avg=200.63, stdev=46.21 00:19:08.429 lat (usec): min=132, max=879, avg=215.49, stdev=46.46 00:19:08.429 clat percentiles (usec): 00:19:08.429 | 1.00th=[ 139], 5.00th=[ 153], 10.00th=[ 159], 20.00th=[ 167], 00:19:08.429 | 30.00th=[ 178], 40.00th=[ 186], 50.00th=[ 194], 60.00th=[ 200], 00:19:08.429 | 70.00th=[ 206], 80.00th=[ 231], 90.00th=[ 260], 95.00th=[ 281], 00:19:08.429 | 99.00th=[ 310], 99.50th=[ 334], 99.90th=[ 750], 99.95th=[ 775], 00:19:08.429 | 99.99th=[ 865] 00:19:08.429 bw ( KiB/s): min= 8192, max= 8192, per=37.38%, avg=8192.00, stdev= 0.00, samples=1 00:19:08.429 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:08.429 lat (usec) : 250=70.93%, 500=27.74%, 750=1.20%, 1000=0.10% 00:19:08.429 lat (msec) : 50=0.03% 00:19:08.429 cpu : usr=3.20%, sys=6.30%, ctx=3836, majf=0, minf=1 00:19:08.429 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:08.429 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.429 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.429 issued rwts: total=1787,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.429 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:08.429 job3: (groupid=0, jobs=1): err= 0: pid=1220851: Mon Nov 18 02:01:42 2024 00:19:08.429 read: IOPS=511, BW=2047KiB/s (2096kB/s)(2104KiB/1028msec) 00:19:08.429 slat (nsec): min=7555, max=24729, avg=10895.39, stdev=3152.25 00:19:08.429 clat (usec): min=205, max=42183, avg=1489.29, stdev=6566.32 00:19:08.429 lat (usec): min=215, max=42192, avg=1500.19, stdev=6566.93 00:19:08.429 clat percentiles (usec): 00:19:08.429 | 1.00th=[ 241], 5.00th=[ 281], 10.00th=[ 293], 20.00th=[ 326], 00:19:08.429 | 30.00th=[ 334], 40.00th=[ 351], 50.00th=[ 388], 60.00th=[ 429], 00:19:08.429 | 70.00th=[ 469], 80.00th=[ 502], 90.00th=[ 562], 95.00th=[ 635], 00:19:08.429 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:08.429 | 99.99th=[42206] 00:19:08.429 write: IOPS=996, BW=3984KiB/s (4080kB/s)(4096KiB/1028msec); 0 zone resets 00:19:08.429 slat (nsec): min=7105, max=55310, avg=13784.17, stdev=6888.31 00:19:08.429 clat (usec): min=128, max=906, avg=213.79, stdev=54.48 00:19:08.429 lat (usec): min=135, max=916, avg=227.58, stdev=54.88 00:19:08.429 clat percentiles (usec): 00:19:08.429 | 1.00th=[ 137], 5.00th=[ 151], 10.00th=[ 163], 20.00th=[ 184], 00:19:08.429 | 30.00th=[ 194], 40.00th=[ 200], 50.00th=[ 204], 60.00th=[ 212], 00:19:08.429 | 70.00th=[ 221], 80.00th=[ 239], 90.00th=[ 265], 95.00th=[ 293], 00:19:08.429 | 99.00th=[ 400], 99.50th=[ 429], 99.90th=[ 717], 99.95th=[ 906], 00:19:08.429 | 99.99th=[ 906] 00:19:08.429 bw ( KiB/s): min= 8192, max= 8192, per=37.38%, avg=8192.00, stdev= 0.00, samples=1 00:19:08.429 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:08.429 lat (usec) : 250=56.71%, 500=35.81%, 750=6.52%, 1000=0.06% 00:19:08.429 lat (msec) : 50=0.90% 00:19:08.429 cpu : usr=1.46%, sys=2.43%, ctx=1550, majf=0, minf=2 00:19:08.429 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:08.429 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.429 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.429 issued rwts: total=526,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.429 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:08.429 00:19:08.429 Run status group 0 (all jobs): 00:19:08.429 READ: bw=16.6MiB/s (17.4MB/s), 85.7KiB/s-8124KiB/s (87.7kB/s-8319kB/s), io=17.1MiB (17.9MB), run=1001-1028msec 00:19:08.429 WRITE: bw=21.4MiB/s (22.4MB/s), 1994KiB/s-8184KiB/s (2042kB/s-8380kB/s), io=22.0MiB (23.1MB), run=1001-1028msec 00:19:08.429 00:19:08.429 Disk stats (read/write): 00:19:08.429 nvme0n1: ios=1586/1800, merge=0/0, ticks=443/325, in_queue=768, util=85.87% 00:19:08.429 nvme0n2: ios=67/512, merge=0/0, ticks=782/94, in_queue=876, util=90.01% 00:19:08.429 nvme0n3: ios=1593/1645, merge=0/0, ticks=976/317, in_queue=1293, util=92.74% 00:19:08.429 nvme0n4: ios=578/1024, merge=0/0, ticks=648/210, in_queue=858, util=96.07% 00:19:08.429 02:01:42 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:08.429 [global] 00:19:08.429 thread=1 00:19:08.429 invalidate=1 00:19:08.429 rw=randwrite 00:19:08.429 time_based=1 00:19:08.429 runtime=1 00:19:08.429 ioengine=libaio 00:19:08.429 direct=1 00:19:08.429 bs=4096 00:19:08.429 iodepth=1 00:19:08.429 norandommap=0 00:19:08.429 numjobs=1 00:19:08.429 00:19:08.429 verify_dump=1 00:19:08.429 verify_backlog=512 00:19:08.429 verify_state_save=0 00:19:08.429 do_verify=1 00:19:08.429 verify=crc32c-intel 00:19:08.429 [job0] 00:19:08.429 filename=/dev/nvme0n1 00:19:08.429 [job1] 00:19:08.429 filename=/dev/nvme0n2 00:19:08.429 [job2] 00:19:08.429 filename=/dev/nvme0n3 00:19:08.429 [job3] 00:19:08.429 filename=/dev/nvme0n4 00:19:08.687 Could not set queue depth (nvme0n1) 00:19:08.687 Could not set queue depth (nvme0n2) 00:19:08.687 Could not set queue depth (nvme0n3) 00:19:08.687 Could not set queue depth (nvme0n4) 00:19:08.687 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:08.687 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:08.687 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:08.687 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:08.687 fio-3.35 00:19:08.687 Starting 4 threads 00:19:10.060 00:19:10.060 job0: (groupid=0, jobs=1): err= 0: pid=1221081: Mon Nov 18 02:01:44 2024 00:19:10.060 read: IOPS=21, BW=86.4KiB/s (88.4kB/s)(88.0KiB/1019msec) 00:19:10.060 slat (nsec): min=11616, max=36038, avg=20304.68, stdev=10144.57 00:19:10.060 clat (usec): min=40539, max=42444, avg=41374.73, stdev=572.32 00:19:10.060 lat (usec): min=40561, max=42458, avg=41395.03, stdev=575.83 00:19:10.060 clat percentiles (usec): 00:19:10.060 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:10.060 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[42206], 00:19:10.060 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:10.060 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:10.060 | 99.99th=[42206] 00:19:10.060 write: IOPS=502, BW=2010KiB/s (2058kB/s)(2048KiB/1019msec); 0 zone resets 00:19:10.060 slat (nsec): min=8483, max=27900, avg=11038.50, stdev=3472.40 00:19:10.060 clat (usec): min=143, max=1404, avg=195.98, stdev=57.82 00:19:10.060 lat (usec): min=153, max=1419, avg=207.02, stdev=58.15 00:19:10.060 clat percentiles (usec): 00:19:10.060 | 1.00th=[ 153], 5.00th=[ 161], 10.00th=[ 167], 20.00th=[ 174], 00:19:10.060 | 30.00th=[ 182], 40.00th=[ 188], 50.00th=[ 192], 60.00th=[ 198], 00:19:10.060 | 70.00th=[ 204], 80.00th=[ 212], 90.00th=[ 223], 95.00th=[ 237], 00:19:10.060 | 99.00th=[ 249], 99.50th=[ 253], 99.90th=[ 1401], 99.95th=[ 1401], 00:19:10.060 | 99.99th=[ 1401] 00:19:10.060 bw ( KiB/s): min= 4096, max= 4096, per=51.95%, avg=4096.00, stdev= 0.00, samples=1 00:19:10.060 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:10.060 lat (usec) : 250=95.13%, 500=0.56% 00:19:10.060 lat (msec) : 2=0.19%, 50=4.12% 00:19:10.060 cpu : usr=0.59%, sys=0.59%, ctx=534, majf=0, minf=1 00:19:10.060 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:10.060 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.060 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.060 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:10.060 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:10.060 job1: (groupid=0, jobs=1): err= 0: pid=1221082: Mon Nov 18 02:01:44 2024 00:19:10.060 read: IOPS=21, BW=84.7KiB/s (86.7kB/s)(88.0KiB/1039msec) 00:19:10.060 slat (nsec): min=12628, max=36362, avg=22211.64, stdev=10582.01 00:19:10.060 clat (usec): min=40499, max=42048, avg=41263.18, stdev=508.04 00:19:10.060 lat (usec): min=40521, max=42083, avg=41285.39, stdev=512.18 00:19:10.060 clat percentiles (usec): 00:19:10.060 | 1.00th=[40633], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:19:10.060 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:10.060 | 70.00th=[41681], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:10.060 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:10.060 | 99.99th=[42206] 00:19:10.060 write: IOPS=492, BW=1971KiB/s (2018kB/s)(2048KiB/1039msec); 0 zone resets 00:19:10.060 slat (nsec): min=7218, max=43008, avg=11650.49, stdev=4984.95 00:19:10.060 clat (usec): min=138, max=1514, avg=238.59, stdev=64.80 00:19:10.060 lat (usec): min=147, max=1522, avg=250.24, stdev=64.81 00:19:10.060 clat percentiles (usec): 00:19:10.060 | 1.00th=[ 163], 5.00th=[ 198], 10.00th=[ 206], 20.00th=[ 215], 00:19:10.060 | 30.00th=[ 219], 40.00th=[ 225], 50.00th=[ 229], 60.00th=[ 237], 00:19:10.060 | 70.00th=[ 249], 80.00th=[ 265], 90.00th=[ 277], 95.00th=[ 293], 00:19:10.060 | 99.00th=[ 318], 99.50th=[ 338], 99.90th=[ 1516], 99.95th=[ 1516], 00:19:10.060 | 99.99th=[ 1516] 00:19:10.060 bw ( KiB/s): min= 4096, max= 4096, per=51.95%, avg=4096.00, stdev= 0.00, samples=1 00:19:10.060 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:10.060 lat (usec) : 250=67.98%, 500=27.72% 00:19:10.060 lat (msec) : 2=0.19%, 50=4.12% 00:19:10.060 cpu : usr=0.29%, sys=0.77%, ctx=537, majf=0, minf=1 00:19:10.060 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:10.060 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.060 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.060 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:10.060 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:10.060 job2: (groupid=0, jobs=1): err= 0: pid=1221083: Mon Nov 18 02:01:44 2024 00:19:10.060 read: IOPS=20, BW=83.6KiB/s (85.6kB/s)(84.0KiB/1005msec) 00:19:10.060 slat (nsec): min=8814, max=36403, avg=22224.29, stdev=10919.08 00:19:10.060 clat (usec): min=40935, max=42041, avg=41496.73, stdev=502.39 00:19:10.060 lat (usec): min=40971, max=42050, avg=41518.95, stdev=501.30 00:19:10.060 clat percentiles (usec): 00:19:10.060 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:10.061 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41681], 60.00th=[42206], 00:19:10.061 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:10.061 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:10.061 | 99.99th=[42206] 00:19:10.061 write: IOPS=509, BW=2038KiB/s (2087kB/s)(2048KiB/1005msec); 0 zone resets 00:19:10.061 slat (nsec): min=7336, max=47167, avg=14736.99, stdev=6374.09 00:19:10.061 clat (usec): min=149, max=398, avg=238.88, stdev=36.23 00:19:10.061 lat (usec): min=162, max=435, avg=253.61, stdev=36.45 00:19:10.061 clat percentiles (usec): 00:19:10.061 | 1.00th=[ 163], 5.00th=[ 188], 10.00th=[ 198], 20.00th=[ 210], 00:19:10.061 | 30.00th=[ 219], 40.00th=[ 227], 50.00th=[ 237], 60.00th=[ 245], 00:19:10.061 | 70.00th=[ 258], 80.00th=[ 269], 90.00th=[ 285], 95.00th=[ 297], 00:19:10.061 | 99.00th=[ 334], 99.50th=[ 383], 99.90th=[ 400], 99.95th=[ 400], 00:19:10.061 | 99.99th=[ 400] 00:19:10.061 bw ( KiB/s): min= 4096, max= 4096, per=51.95%, avg=4096.00, stdev= 0.00, samples=1 00:19:10.061 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:10.061 lat (usec) : 250=62.85%, 500=33.21% 00:19:10.061 lat (msec) : 50=3.94% 00:19:10.061 cpu : usr=0.20%, sys=0.90%, ctx=535, majf=0, minf=1 00:19:10.061 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:10.061 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.061 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.061 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:10.061 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:10.061 job3: (groupid=0, jobs=1): err= 0: pid=1221084: Mon Nov 18 02:01:44 2024 00:19:10.061 read: IOPS=21, BW=86.4KiB/s (88.4kB/s)(88.0KiB/1019msec) 00:19:10.061 slat (nsec): min=8860, max=33211, avg=18945.91, stdev=9060.92 00:19:10.061 clat (usec): min=40809, max=42372, avg=41311.30, stdev=525.53 00:19:10.061 lat (usec): min=40823, max=42381, avg=41330.24, stdev=525.06 00:19:10.061 clat percentiles (usec): 00:19:10.061 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:10.061 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:10.061 | 70.00th=[41681], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:19:10.061 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:10.061 | 99.99th=[42206] 00:19:10.061 write: IOPS=502, BW=2010KiB/s (2058kB/s)(2048KiB/1019msec); 0 zone resets 00:19:10.061 slat (nsec): min=6478, max=43667, avg=10214.00, stdev=4893.13 00:19:10.061 clat (usec): min=143, max=1097, avg=200.59, stdev=57.50 00:19:10.061 lat (usec): min=151, max=1105, avg=210.80, stdev=57.89 00:19:10.061 clat percentiles (usec): 00:19:10.061 | 1.00th=[ 149], 5.00th=[ 155], 10.00th=[ 157], 20.00th=[ 163], 00:19:10.061 | 30.00th=[ 169], 40.00th=[ 180], 50.00th=[ 194], 60.00th=[ 208], 00:19:10.061 | 70.00th=[ 219], 80.00th=[ 225], 90.00th=[ 241], 95.00th=[ 277], 00:19:10.061 | 99.00th=[ 322], 99.50th=[ 416], 99.90th=[ 1090], 99.95th=[ 1090], 00:19:10.061 | 99.99th=[ 1090] 00:19:10.061 bw ( KiB/s): min= 4096, max= 4096, per=51.95%, avg=4096.00, stdev= 0.00, samples=1 00:19:10.061 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:10.061 lat (usec) : 250=87.64%, 500=7.87%, 750=0.19% 00:19:10.061 lat (msec) : 2=0.19%, 50=4.12% 00:19:10.061 cpu : usr=0.29%, sys=0.49%, ctx=534, majf=0, minf=1 00:19:10.061 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:10.061 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.061 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.061 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:10.061 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:10.061 00:19:10.061 Run status group 0 (all jobs): 00:19:10.061 READ: bw=335KiB/s (343kB/s), 83.6KiB/s-86.4KiB/s (85.6kB/s-88.4kB/s), io=348KiB (356kB), run=1005-1039msec 00:19:10.061 WRITE: bw=7885KiB/s (8074kB/s), 1971KiB/s-2038KiB/s (2018kB/s-2087kB/s), io=8192KiB (8389kB), run=1005-1039msec 00:19:10.061 00:19:10.061 Disk stats (read/write): 00:19:10.061 nvme0n1: ios=68/512, merge=0/0, ticks=760/96, in_queue=856, util=86.97% 00:19:10.061 nvme0n2: ios=67/512, merge=0/0, ticks=1260/123, in_queue=1383, util=98.48% 00:19:10.061 nvme0n3: ios=62/512, merge=0/0, ticks=948/123, in_queue=1071, util=97.50% 00:19:10.061 nvme0n4: ios=18/512, merge=0/0, ticks=745/102, in_queue=847, util=89.73% 00:19:10.061 02:01:44 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:10.061 [global] 00:19:10.061 thread=1 00:19:10.061 invalidate=1 00:19:10.061 rw=write 00:19:10.061 time_based=1 00:19:10.061 runtime=1 00:19:10.061 ioengine=libaio 00:19:10.061 direct=1 00:19:10.061 bs=4096 00:19:10.061 iodepth=128 00:19:10.061 norandommap=0 00:19:10.061 numjobs=1 00:19:10.061 00:19:10.061 verify_dump=1 00:19:10.061 verify_backlog=512 00:19:10.061 verify_state_save=0 00:19:10.061 do_verify=1 00:19:10.061 verify=crc32c-intel 00:19:10.061 [job0] 00:19:10.061 filename=/dev/nvme0n1 00:19:10.061 [job1] 00:19:10.061 filename=/dev/nvme0n2 00:19:10.061 [job2] 00:19:10.061 filename=/dev/nvme0n3 00:19:10.061 [job3] 00:19:10.061 filename=/dev/nvme0n4 00:19:10.061 Could not set queue depth (nvme0n1) 00:19:10.061 Could not set queue depth (nvme0n2) 00:19:10.061 Could not set queue depth (nvme0n3) 00:19:10.061 Could not set queue depth (nvme0n4) 00:19:10.318 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:10.318 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:10.318 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:10.318 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:10.318 fio-3.35 00:19:10.318 Starting 4 threads 00:19:11.692 00:19:11.692 job0: (groupid=0, jobs=1): err= 0: pid=1221440: Mon Nov 18 02:01:45 2024 00:19:11.692 read: IOPS=3104, BW=12.1MiB/s (12.7MB/s)(12.2MiB/1005msec) 00:19:11.692 slat (usec): min=2, max=12427, avg=124.40, stdev=720.95 00:19:11.692 clat (usec): min=3975, max=73884, avg=16330.98, stdev=8684.16 00:19:11.692 lat (usec): min=3985, max=73892, avg=16455.38, stdev=8743.13 00:19:11.692 clat percentiles (usec): 00:19:11.692 | 1.00th=[ 5538], 5.00th=[ 8717], 10.00th=[ 9503], 20.00th=[10683], 00:19:11.692 | 30.00th=[12649], 40.00th=[13042], 50.00th=[14091], 60.00th=[15008], 00:19:11.692 | 70.00th=[17433], 80.00th=[18744], 90.00th=[23462], 95.00th=[38011], 00:19:11.692 | 99.00th=[51643], 99.50th=[61604], 99.90th=[61604], 99.95th=[61604], 00:19:11.692 | 99.99th=[73925] 00:19:11.692 write: IOPS=3566, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1005msec); 0 zone resets 00:19:11.692 slat (usec): min=4, max=22830, avg=163.08, stdev=930.97 00:19:11.692 clat (usec): min=5346, max=65254, avg=21065.83, stdev=13223.81 00:19:11.692 lat (usec): min=5365, max=69999, avg=21228.91, stdev=13327.84 00:19:11.692 clat percentiles (usec): 00:19:11.692 | 1.00th=[ 6718], 5.00th=[ 8848], 10.00th=[10290], 20.00th=[10683], 00:19:11.692 | 30.00th=[11207], 40.00th=[13173], 50.00th=[16319], 60.00th=[20579], 00:19:11.692 | 70.00th=[22152], 80.00th=[30278], 90.00th=[44303], 95.00th=[51643], 00:19:11.692 | 99.00th=[59507], 99.50th=[60556], 99.90th=[65274], 99.95th=[65274], 00:19:11.692 | 99.99th=[65274] 00:19:11.692 bw ( KiB/s): min=12288, max=15752, per=20.11%, avg=14020.00, stdev=2449.42, samples=2 00:19:11.692 iops : min= 3072, max= 3938, avg=3505.00, stdev=612.35, samples=2 00:19:11.692 lat (msec) : 4=0.03%, 10=11.14%, 20=59.56%, 50=25.58%, 100=3.68% 00:19:11.692 cpu : usr=3.69%, sys=5.68%, ctx=425, majf=0, minf=1 00:19:11.692 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:11.692 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:11.692 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:11.692 issued rwts: total=3120,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:11.692 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:11.692 job1: (groupid=0, jobs=1): err= 0: pid=1221443: Mon Nov 18 02:01:45 2024 00:19:11.692 read: IOPS=4083, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec) 00:19:11.692 slat (usec): min=2, max=23561, avg=111.78, stdev=831.67 00:19:11.692 clat (usec): min=3899, max=50482, avg=14075.59, stdev=7599.46 00:19:11.692 lat (usec): min=3902, max=50488, avg=14187.37, stdev=7648.52 00:19:11.692 clat percentiles (usec): 00:19:11.692 | 1.00th=[ 6063], 5.00th=[ 8225], 10.00th=[ 9110], 20.00th=[ 9765], 00:19:11.692 | 30.00th=[10290], 40.00th=[10814], 50.00th=[11600], 60.00th=[12649], 00:19:11.692 | 70.00th=[12911], 80.00th=[15664], 90.00th=[22676], 95.00th=[27919], 00:19:11.692 | 99.00th=[46924], 99.50th=[49021], 99.90th=[50594], 99.95th=[50594], 00:19:11.692 | 99.99th=[50594] 00:19:11.692 write: IOPS=4193, BW=16.4MiB/s (17.2MB/s)(16.4MiB/1003msec); 0 zone resets 00:19:11.692 slat (usec): min=3, max=11485, avg=121.09, stdev=686.21 00:19:11.692 clat (usec): min=2190, max=50084, avg=16551.57, stdev=10162.78 00:19:11.692 lat (usec): min=2221, max=50089, avg=16672.65, stdev=10235.38 00:19:11.692 clat percentiles (usec): 00:19:11.692 | 1.00th=[ 3458], 5.00th=[ 6259], 10.00th=[ 8291], 20.00th=[ 9765], 00:19:11.692 | 30.00th=[10290], 40.00th=[10683], 50.00th=[11207], 60.00th=[12911], 00:19:11.692 | 70.00th=[21365], 80.00th=[24773], 90.00th=[31851], 95.00th=[38536], 00:19:11.692 | 99.00th=[45876], 99.50th=[46924], 99.90th=[50070], 99.95th=[50070], 00:19:11.692 | 99.99th=[50070] 00:19:11.692 bw ( KiB/s): min=12944, max=19824, per=23.50%, avg=16384.00, stdev=4864.89, samples=2 00:19:11.692 iops : min= 3236, max= 4956, avg=4096.00, stdev=1216.22, samples=2 00:19:11.692 lat (msec) : 4=1.07%, 10=22.42%, 20=51.82%, 50=24.49%, 100=0.20% 00:19:11.692 cpu : usr=3.29%, sys=4.49%, ctx=391, majf=0, minf=1 00:19:11.693 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:11.693 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:11.693 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:11.693 issued rwts: total=4096,4206,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:11.693 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:11.693 job2: (groupid=0, jobs=1): err= 0: pid=1221444: Mon Nov 18 02:01:45 2024 00:19:11.693 read: IOPS=5104, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec) 00:19:11.693 slat (usec): min=2, max=12025, avg=93.40, stdev=568.45 00:19:11.693 clat (usec): min=6186, max=33785, avg=11715.66, stdev=2759.18 00:19:11.693 lat (usec): min=6197, max=33792, avg=11809.07, stdev=2799.54 00:19:11.693 clat percentiles (usec): 00:19:11.693 | 1.00th=[ 6456], 5.00th=[ 8029], 10.00th=[ 8848], 20.00th=[10421], 00:19:11.693 | 30.00th=[10814], 40.00th=[11207], 50.00th=[11338], 60.00th=[11600], 00:19:11.693 | 70.00th=[12125], 80.00th=[12911], 90.00th=[14222], 95.00th=[15664], 00:19:11.693 | 99.00th=[24511], 99.50th=[29230], 99.90th=[30802], 99.95th=[33817], 00:19:11.693 | 99.99th=[33817] 00:19:11.693 write: IOPS=5106, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec); 0 zone resets 00:19:11.693 slat (usec): min=3, max=5681, avg=94.35, stdev=432.62 00:19:11.693 clat (usec): min=501, max=33790, avg=13043.65, stdev=3308.23 00:19:11.693 lat (usec): min=6120, max=33797, avg=13138.00, stdev=3332.08 00:19:11.693 clat percentiles (usec): 00:19:11.693 | 1.00th=[ 7373], 5.00th=[ 9241], 10.00th=[10683], 20.00th=[11600], 00:19:11.693 | 30.00th=[11994], 40.00th=[12256], 50.00th=[12387], 60.00th=[12387], 00:19:11.693 | 70.00th=[12518], 80.00th=[13173], 90.00th=[16581], 95.00th=[22414], 00:19:11.693 | 99.00th=[22938], 99.50th=[25035], 99.90th=[26084], 99.95th=[26870], 00:19:11.693 | 99.99th=[33817] 00:19:11.693 bw ( KiB/s): min=19600, max=21402, per=29.40%, avg=20501.00, stdev=1274.21, samples=2 00:19:11.693 iops : min= 4900, max= 5350, avg=5125.00, stdev=318.20, samples=2 00:19:11.693 lat (usec) : 750=0.01% 00:19:11.693 lat (msec) : 10=11.91%, 20=83.18%, 50=4.90% 00:19:11.693 cpu : usr=5.49%, sys=7.58%, ctx=614, majf=0, minf=1 00:19:11.693 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:11.693 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:11.693 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:11.693 issued rwts: total=5120,5122,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:11.693 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:11.693 job3: (groupid=0, jobs=1): err= 0: pid=1221445: Mon Nov 18 02:01:45 2024 00:19:11.693 read: IOPS=4230, BW=16.5MiB/s (17.3MB/s)(16.5MiB/1001msec) 00:19:11.693 slat (usec): min=2, max=14936, avg=105.40, stdev=673.18 00:19:11.693 clat (usec): min=489, max=42981, avg=13370.50, stdev=4070.06 00:19:11.693 lat (usec): min=6351, max=49307, avg=13475.90, stdev=4124.90 00:19:11.693 clat percentiles (usec): 00:19:11.693 | 1.00th=[ 6783], 5.00th=[ 9110], 10.00th=[10552], 20.00th=[11338], 00:19:11.693 | 30.00th=[11600], 40.00th=[11863], 50.00th=[11994], 60.00th=[12649], 00:19:11.693 | 70.00th=[13566], 80.00th=[15139], 90.00th=[16909], 95.00th=[21890], 00:19:11.693 | 99.00th=[30278], 99.50th=[36439], 99.90th=[39584], 99.95th=[39584], 00:19:11.693 | 99.99th=[42730] 00:19:11.693 write: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec); 0 zone resets 00:19:11.693 slat (usec): min=3, max=7160, avg=115.07, stdev=656.75 00:19:11.693 clat (usec): min=6302, max=53465, avg=15154.98, stdev=7608.65 00:19:11.693 lat (usec): min=6330, max=57195, avg=15270.05, stdev=7672.35 00:19:11.693 clat percentiles (usec): 00:19:11.693 | 1.00th=[ 6325], 5.00th=[ 8717], 10.00th=[10814], 20.00th=[11863], 00:19:11.693 | 30.00th=[12125], 40.00th=[12387], 50.00th=[12518], 60.00th=[12911], 00:19:11.693 | 70.00th=[13304], 80.00th=[15139], 90.00th=[25822], 95.00th=[34341], 00:19:11.693 | 99.00th=[46924], 99.50th=[47449], 99.90th=[53216], 99.95th=[53216], 00:19:11.693 | 99.99th=[53216] 00:19:11.693 bw ( KiB/s): min=17208, max=19656, per=26.43%, avg=18432.00, stdev=1731.00, samples=2 00:19:11.693 iops : min= 4302, max= 4914, avg=4608.00, stdev=432.75, samples=2 00:19:11.693 lat (usec) : 500=0.01% 00:19:11.693 lat (msec) : 10=7.98%, 20=81.56%, 50=10.19%, 100=0.26% 00:19:11.693 cpu : usr=2.70%, sys=4.70%, ctx=360, majf=0, minf=1 00:19:11.693 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:11.693 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:11.693 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:11.693 issued rwts: total=4235,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:11.693 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:11.693 00:19:11.693 Run status group 0 (all jobs): 00:19:11.693 READ: bw=64.4MiB/s (67.5MB/s), 12.1MiB/s-19.9MiB/s (12.7MB/s-20.9MB/s), io=64.7MiB (67.9MB), run=1001-1005msec 00:19:11.693 WRITE: bw=68.1MiB/s (71.4MB/s), 13.9MiB/s-19.9MiB/s (14.6MB/s-20.9MB/s), io=68.4MiB (71.8MB), run=1001-1005msec 00:19:11.693 00:19:11.693 Disk stats (read/write): 00:19:11.693 nvme0n1: ios=2350/2560, merge=0/0, ticks=16535/27530, in_queue=44065, util=86.87% 00:19:11.693 nvme0n2: ios=3584/3896, merge=0/0, ticks=38019/60844, in_queue=98863, util=86.60% 00:19:11.693 nvme0n3: ios=4492/4608, merge=0/0, ticks=26054/25555, in_queue=51609, util=97.29% 00:19:11.693 nvme0n4: ios=3607/3695, merge=0/0, ticks=24699/27959, in_queue=52658, util=98.00% 00:19:11.693 02:01:45 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:11.693 [global] 00:19:11.693 thread=1 00:19:11.693 invalidate=1 00:19:11.693 rw=randwrite 00:19:11.693 time_based=1 00:19:11.693 runtime=1 00:19:11.693 ioengine=libaio 00:19:11.693 direct=1 00:19:11.693 bs=4096 00:19:11.693 iodepth=128 00:19:11.693 norandommap=0 00:19:11.693 numjobs=1 00:19:11.693 00:19:11.693 verify_dump=1 00:19:11.693 verify_backlog=512 00:19:11.693 verify_state_save=0 00:19:11.693 do_verify=1 00:19:11.693 verify=crc32c-intel 00:19:11.693 [job0] 00:19:11.693 filename=/dev/nvme0n1 00:19:11.693 [job1] 00:19:11.693 filename=/dev/nvme0n2 00:19:11.693 [job2] 00:19:11.693 filename=/dev/nvme0n3 00:19:11.693 [job3] 00:19:11.693 filename=/dev/nvme0n4 00:19:11.693 Could not set queue depth (nvme0n1) 00:19:11.693 Could not set queue depth (nvme0n2) 00:19:11.693 Could not set queue depth (nvme0n3) 00:19:11.693 Could not set queue depth (nvme0n4) 00:19:11.693 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:11.693 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:11.693 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:11.693 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:11.693 fio-3.35 00:19:11.693 Starting 4 threads 00:19:13.072 00:19:13.072 job0: (groupid=0, jobs=1): err= 0: pid=1221678: Mon Nov 18 02:01:47 2024 00:19:13.072 read: IOPS=5069, BW=19.8MiB/s (20.8MB/s)(20.0MiB/1010msec) 00:19:13.072 slat (usec): min=2, max=25881, avg=86.32, stdev=674.46 00:19:13.072 clat (usec): min=1762, max=42753, avg=11391.35, stdev=4907.57 00:19:13.072 lat (usec): min=1925, max=52707, avg=11477.67, stdev=4961.00 00:19:13.072 clat percentiles (usec): 00:19:13.072 | 1.00th=[ 4228], 5.00th=[ 7177], 10.00th=[ 8225], 20.00th=[ 9503], 00:19:13.072 | 30.00th=[ 9765], 40.00th=[ 9896], 50.00th=[10028], 60.00th=[10290], 00:19:13.072 | 70.00th=[11076], 80.00th=[12911], 90.00th=[15533], 95.00th=[16909], 00:19:13.072 | 99.00th=[39060], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:19:13.072 | 99.99th=[42730] 00:19:13.072 write: IOPS=5376, BW=21.0MiB/s (22.0MB/s)(21.2MiB/1010msec); 0 zone resets 00:19:13.072 slat (usec): min=3, max=40397, avg=92.61, stdev=938.46 00:19:13.072 clat (usec): min=1870, max=67575, avg=12771.52, stdev=8046.88 00:19:13.072 lat (usec): min=1875, max=67589, avg=12864.13, stdev=8108.19 00:19:13.072 clat percentiles (usec): 00:19:13.072 | 1.00th=[ 3949], 5.00th=[ 5866], 10.00th=[ 7767], 20.00th=[ 9634], 00:19:13.072 | 30.00th=[10028], 40.00th=[10290], 50.00th=[10421], 60.00th=[10683], 00:19:13.072 | 70.00th=[10945], 80.00th=[11600], 90.00th=[27132], 95.00th=[29492], 00:19:13.072 | 99.00th=[42730], 99.50th=[43254], 99.90th=[44827], 99.95th=[46400], 00:19:13.072 | 99.99th=[67634] 00:19:13.072 bw ( KiB/s): min=20480, max=21944, per=31.10%, avg=21212.00, stdev=1035.20, samples=2 00:19:13.072 iops : min= 5120, max= 5486, avg=5303.00, stdev=258.80, samples=2 00:19:13.072 lat (msec) : 2=0.08%, 4=0.80%, 10=38.58%, 20=52.72%, 50=7.81% 00:19:13.072 lat (msec) : 100=0.02% 00:19:13.072 cpu : usr=5.45%, sys=7.63%, ctx=473, majf=0, minf=1 00:19:13.072 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:13.072 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:13.072 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:13.072 issued rwts: total=5120,5430,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:13.072 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:13.072 job1: (groupid=0, jobs=1): err= 0: pid=1221679: Mon Nov 18 02:01:47 2024 00:19:13.072 read: IOPS=3050, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1007msec) 00:19:13.072 slat (usec): min=2, max=16612, avg=143.06, stdev=1076.70 00:19:13.072 clat (usec): min=5562, max=47501, avg=17942.77, stdev=7829.22 00:19:13.072 lat (usec): min=5567, max=50130, avg=18085.83, stdev=7910.12 00:19:13.072 clat percentiles (usec): 00:19:13.072 | 1.00th=[ 6325], 5.00th=[ 9765], 10.00th=[ 9896], 20.00th=[11338], 00:19:13.072 | 30.00th=[11994], 40.00th=[12649], 50.00th=[16057], 60.00th=[20317], 00:19:13.072 | 70.00th=[21365], 80.00th=[23462], 90.00th=[29492], 95.00th=[32900], 00:19:13.072 | 99.00th=[40109], 99.50th=[44827], 99.90th=[44827], 99.95th=[44827], 00:19:13.072 | 99.99th=[47449] 00:19:13.072 write: IOPS=3085, BW=12.1MiB/s (12.6MB/s)(12.1MiB/1007msec); 0 zone resets 00:19:13.072 slat (usec): min=3, max=29353, avg=172.22, stdev=1284.47 00:19:13.072 clat (usec): min=2803, max=76432, avg=23339.96, stdev=12454.52 00:19:13.072 lat (usec): min=2812, max=78106, avg=23512.18, stdev=12553.27 00:19:13.072 clat percentiles (usec): 00:19:13.072 | 1.00th=[ 5407], 5.00th=[ 6587], 10.00th=[ 9896], 20.00th=[11863], 00:19:13.072 | 30.00th=[16057], 40.00th=[20317], 50.00th=[23200], 60.00th=[23987], 00:19:13.072 | 70.00th=[27132], 80.00th=[30016], 90.00th=[35914], 95.00th=[51119], 00:19:13.072 | 99.00th=[66323], 99.50th=[74974], 99.90th=[76022], 99.95th=[76022], 00:19:13.072 | 99.99th=[76022] 00:19:13.072 bw ( KiB/s): min=10256, max=14320, per=18.01%, avg=12288.00, stdev=2873.68, samples=2 00:19:13.072 iops : min= 2564, max= 3580, avg=3072.00, stdev=718.42, samples=2 00:19:13.072 lat (msec) : 4=0.32%, 10=10.10%, 20=36.06%, 50=50.41%, 100=3.11% 00:19:13.072 cpu : usr=2.19%, sys=5.77%, ctx=264, majf=0, minf=1 00:19:13.072 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:13.072 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:13.072 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:13.072 issued rwts: total=3072,3107,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:13.072 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:13.072 job2: (groupid=0, jobs=1): err= 0: pid=1221680: Mon Nov 18 02:01:47 2024 00:19:13.072 read: IOPS=5434, BW=21.2MiB/s (22.3MB/s)(21.4MiB/1009msec) 00:19:13.072 slat (usec): min=2, max=11432, avg=96.39, stdev=688.81 00:19:13.072 clat (usec): min=3427, max=22494, avg=12095.49, stdev=3250.92 00:19:13.072 lat (usec): min=3433, max=22509, avg=12191.87, stdev=3293.00 00:19:13.072 clat percentiles (usec): 00:19:13.073 | 1.00th=[ 5342], 5.00th=[ 7767], 10.00th=[ 8848], 20.00th=[ 9896], 00:19:13.073 | 30.00th=[10552], 40.00th=[10945], 50.00th=[11338], 60.00th=[11469], 00:19:13.073 | 70.00th=[12649], 80.00th=[14353], 90.00th=[16909], 95.00th=[19268], 00:19:13.073 | 99.00th=[21365], 99.50th=[21890], 99.90th=[22414], 99.95th=[22414], 00:19:13.073 | 99.99th=[22414] 00:19:13.073 write: IOPS=5581, BW=21.8MiB/s (22.9MB/s)(22.0MiB/1009msec); 0 zone resets 00:19:13.073 slat (usec): min=3, max=10137, avg=75.53, stdev=399.56 00:19:13.073 clat (usec): min=1595, max=22497, avg=10954.96, stdev=2602.13 00:19:13.073 lat (usec): min=1609, max=22503, avg=11030.48, stdev=2630.20 00:19:13.073 clat percentiles (usec): 00:19:13.073 | 1.00th=[ 3392], 5.00th=[ 5276], 10.00th=[ 7046], 20.00th=[ 9372], 00:19:13.073 | 30.00th=[10290], 40.00th=[11338], 50.00th=[11994], 60.00th=[12256], 00:19:13.073 | 70.00th=[12387], 80.00th=[12649], 90.00th=[12911], 95.00th=[13304], 00:19:13.073 | 99.00th=[15795], 99.50th=[17695], 99.90th=[22152], 99.95th=[22414], 00:19:13.073 | 99.99th=[22414] 00:19:13.073 bw ( KiB/s): min=20496, max=24560, per=33.03%, avg=22528.00, stdev=2873.68, samples=2 00:19:13.073 iops : min= 5124, max= 6140, avg=5632.00, stdev=718.42, samples=2 00:19:13.073 lat (msec) : 2=0.07%, 4=1.21%, 10=22.32%, 20=74.44%, 50=1.95% 00:19:13.073 cpu : usr=6.65%, sys=8.53%, ctx=605, majf=0, minf=1 00:19:13.073 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:13.073 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:13.073 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:13.073 issued rwts: total=5483,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:13.073 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:13.073 job3: (groupid=0, jobs=1): err= 0: pid=1221681: Mon Nov 18 02:01:47 2024 00:19:13.073 read: IOPS=2797, BW=10.9MiB/s (11.5MB/s)(11.0MiB/1011msec) 00:19:13.073 slat (usec): min=2, max=25696, avg=152.06, stdev=1368.43 00:19:13.073 clat (usec): min=1195, max=80649, avg=21188.14, stdev=11362.53 00:19:13.073 lat (usec): min=1201, max=80655, avg=21340.21, stdev=11471.13 00:19:13.073 clat percentiles (usec): 00:19:13.073 | 1.00th=[ 1926], 5.00th=[ 6652], 10.00th=[10945], 20.00th=[12518], 00:19:13.073 | 30.00th=[13173], 40.00th=[17433], 50.00th=[20579], 60.00th=[21365], 00:19:13.073 | 70.00th=[23987], 80.00th=[26608], 90.00th=[36963], 95.00th=[41157], 00:19:13.073 | 99.00th=[76022], 99.50th=[78119], 99.90th=[80217], 99.95th=[80217], 00:19:13.073 | 99.99th=[80217] 00:19:13.073 write: IOPS=3038, BW=11.9MiB/s (12.4MB/s)(12.0MiB/1011msec); 0 zone resets 00:19:13.073 slat (usec): min=3, max=22030, avg=159.62, stdev=1194.92 00:19:13.073 clat (usec): min=4134, max=81211, avg=22243.27, stdev=12871.38 00:19:13.073 lat (usec): min=4138, max=81217, avg=22402.90, stdev=12959.40 00:19:13.073 clat percentiles (usec): 00:19:13.073 | 1.00th=[ 5014], 5.00th=[ 8455], 10.00th=[10421], 20.00th=[13173], 00:19:13.073 | 30.00th=[14615], 40.00th=[18482], 50.00th=[21365], 60.00th=[23462], 00:19:13.073 | 70.00th=[24249], 80.00th=[27132], 90.00th=[30278], 95.00th=[47973], 00:19:13.073 | 99.00th=[76022], 99.50th=[80217], 99.90th=[81265], 99.95th=[81265], 00:19:13.073 | 99.99th=[81265] 00:19:13.073 bw ( KiB/s): min=11056, max=13520, per=18.01%, avg=12288.00, stdev=1742.31, samples=2 00:19:13.073 iops : min= 2764, max= 3380, avg=3072.00, stdev=435.58, samples=2 00:19:13.073 lat (msec) : 2=0.59%, 4=0.46%, 10=6.95%, 20=36.20%, 50=52.68% 00:19:13.073 lat (msec) : 100=3.12% 00:19:13.073 cpu : usr=1.88%, sys=3.07%, ctx=213, majf=0, minf=1 00:19:13.073 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:13.073 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:13.073 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:13.073 issued rwts: total=2828,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:13.073 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:13.073 00:19:13.073 Run status group 0 (all jobs): 00:19:13.073 READ: bw=63.8MiB/s (66.9MB/s), 10.9MiB/s-21.2MiB/s (11.5MB/s-22.3MB/s), io=64.5MiB (67.6MB), run=1007-1011msec 00:19:13.073 WRITE: bw=66.6MiB/s (69.8MB/s), 11.9MiB/s-21.8MiB/s (12.4MB/s-22.9MB/s), io=67.3MiB (70.6MB), run=1007-1011msec 00:19:13.073 00:19:13.073 Disk stats (read/write): 00:19:13.073 nvme0n1: ios=4446/4608, merge=0/0, ticks=26964/31943, in_queue=58907, util=98.90% 00:19:13.073 nvme0n2: ios=2590/2615, merge=0/0, ticks=47475/57374, in_queue=104849, util=87.31% 00:19:13.073 nvme0n3: ios=4608/4839, merge=0/0, ticks=52555/50739, in_queue=103294, util=88.96% 00:19:13.073 nvme0n4: ios=2197/2560, merge=0/0, ticks=42926/61271, in_queue=104197, util=89.71% 00:19:13.073 02:01:47 -- target/fio.sh@55 -- # sync 00:19:13.073 02:01:47 -- target/fio.sh@59 -- # fio_pid=1221827 00:19:13.073 02:01:47 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:13.073 02:01:47 -- target/fio.sh@61 -- # sleep 3 00:19:13.073 [global] 00:19:13.073 thread=1 00:19:13.073 invalidate=1 00:19:13.073 rw=read 00:19:13.073 time_based=1 00:19:13.073 runtime=10 00:19:13.073 ioengine=libaio 00:19:13.073 direct=1 00:19:13.073 bs=4096 00:19:13.073 iodepth=1 00:19:13.073 norandommap=1 00:19:13.073 numjobs=1 00:19:13.073 00:19:13.073 [job0] 00:19:13.073 filename=/dev/nvme0n1 00:19:13.073 [job1] 00:19:13.073 filename=/dev/nvme0n2 00:19:13.073 [job2] 00:19:13.073 filename=/dev/nvme0n3 00:19:13.073 [job3] 00:19:13.073 filename=/dev/nvme0n4 00:19:13.073 Could not set queue depth (nvme0n1) 00:19:13.073 Could not set queue depth (nvme0n2) 00:19:13.073 Could not set queue depth (nvme0n3) 00:19:13.073 Could not set queue depth (nvme0n4) 00:19:13.330 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:13.330 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:13.330 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:13.330 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:13.330 fio-3.35 00:19:13.330 Starting 4 threads 00:19:15.854 02:01:50 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:16.418 02:01:50 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:16.418 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=26628096, buflen=4096 00:19:16.418 fio: pid=1221920, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:16.418 02:01:50 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:16.418 02:01:50 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:16.418 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=7254016, buflen=4096 00:19:16.418 fio: pid=1221919, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:16.676 02:01:51 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:16.676 02:01:51 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:16.676 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=54841344, buflen=4096 00:19:16.676 fio: pid=1221917, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:16.933 02:01:51 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:16.933 02:01:51 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:17.192 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=28688384, buflen=4096 00:19:17.192 fio: pid=1221918, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:19:17.192 00:19:17.192 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1221917: Mon Nov 18 02:01:51 2024 00:19:17.192 read: IOPS=3889, BW=15.2MiB/s (15.9MB/s)(52.3MiB/3443msec) 00:19:17.192 slat (usec): min=3, max=35748, avg=12.61, stdev=320.33 00:19:17.192 clat (usec): min=151, max=42014, avg=240.84, stdev=940.63 00:19:17.192 lat (usec): min=155, max=47940, avg=253.45, stdev=1012.41 00:19:17.192 clat percentiles (usec): 00:19:17.192 | 1.00th=[ 163], 5.00th=[ 176], 10.00th=[ 184], 20.00th=[ 192], 00:19:17.192 | 30.00th=[ 198], 40.00th=[ 204], 50.00th=[ 210], 60.00th=[ 217], 00:19:17.192 | 70.00th=[ 227], 80.00th=[ 239], 90.00th=[ 262], 95.00th=[ 293], 00:19:17.192 | 99.00th=[ 363], 99.50th=[ 388], 99.90th=[ 537], 99.95th=[40633], 00:19:17.192 | 99.99th=[41157] 00:19:17.192 bw ( KiB/s): min=15504, max=18368, per=54.17%, avg=16718.67, stdev=1006.53, samples=6 00:19:17.192 iops : min= 3876, max= 4592, avg=4179.67, stdev=251.63, samples=6 00:19:17.192 lat (usec) : 250=86.62%, 500=13.26%, 750=0.02%, 1000=0.01% 00:19:17.192 lat (msec) : 2=0.02%, 10=0.01%, 50=0.05% 00:19:17.192 cpu : usr=1.42%, sys=4.10%, ctx=13394, majf=0, minf=1 00:19:17.192 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:17.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.192 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.192 issued rwts: total=13390,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.192 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:17.192 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=1221918: Mon Nov 18 02:01:51 2024 00:19:17.192 read: IOPS=1885, BW=7541KiB/s (7722kB/s)(27.4MiB/3715msec) 00:19:17.192 slat (usec): min=4, max=16903, avg=18.94, stdev=250.35 00:19:17.192 clat (usec): min=167, max=42037, avg=508.00, stdev=2731.70 00:19:17.192 lat (usec): min=172, max=58001, avg=526.00, stdev=2808.35 00:19:17.192 clat percentiles (usec): 00:19:17.192 | 1.00th=[ 176], 5.00th=[ 184], 10.00th=[ 190], 20.00th=[ 206], 00:19:17.192 | 30.00th=[ 253], 40.00th=[ 297], 50.00th=[ 318], 60.00th=[ 334], 00:19:17.192 | 70.00th=[ 379], 80.00th=[ 416], 90.00th=[ 490], 95.00th=[ 537], 00:19:17.192 | 99.00th=[ 619], 99.50th=[ 824], 99.90th=[42206], 99.95th=[42206], 00:19:17.192 | 99.99th=[42206] 00:19:17.192 bw ( KiB/s): min= 92, max=14600, per=25.91%, avg=7998.29, stdev=5656.84, samples=7 00:19:17.192 iops : min= 23, max= 3650, avg=1999.57, stdev=1414.21, samples=7 00:19:17.192 lat (usec) : 250=29.52%, 500=61.81%, 750=8.12%, 1000=0.04% 00:19:17.192 lat (msec) : 2=0.01%, 4=0.03%, 50=0.44% 00:19:17.192 cpu : usr=1.62%, sys=3.45%, ctx=7010, majf=0, minf=1 00:19:17.192 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:17.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.192 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.192 issued rwts: total=7005,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.192 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:17.192 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1221919: Mon Nov 18 02:01:51 2024 00:19:17.192 read: IOPS=560, BW=2241KiB/s (2295kB/s)(7084KiB/3161msec) 00:19:17.192 slat (nsec): min=5480, max=68651, avg=12393.86, stdev=6845.24 00:19:17.192 clat (usec): min=187, max=44851, avg=1756.48, stdev=7567.02 00:19:17.192 lat (usec): min=193, max=44864, avg=1768.87, stdev=7566.87 00:19:17.192 clat percentiles (usec): 00:19:17.193 | 1.00th=[ 202], 5.00th=[ 212], 10.00th=[ 219], 20.00th=[ 229], 00:19:17.193 | 30.00th=[ 239], 40.00th=[ 255], 50.00th=[ 281], 60.00th=[ 359], 00:19:17.193 | 70.00th=[ 383], 80.00th=[ 408], 90.00th=[ 478], 95.00th=[ 529], 00:19:17.193 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[44827], 00:19:17.193 | 99.99th=[44827] 00:19:17.193 bw ( KiB/s): min= 96, max=12368, per=7.63%, avg=2356.00, stdev=4931.43, samples=6 00:19:17.193 iops : min= 24, max= 3092, avg=589.00, stdev=1232.86, samples=6 00:19:17.193 lat (usec) : 250=37.42%, 500=55.81%, 750=3.16%, 1000=0.06% 00:19:17.193 lat (msec) : 50=3.50% 00:19:17.193 cpu : usr=0.35%, sys=0.85%, ctx=1772, majf=0, minf=2 00:19:17.193 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:17.193 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.193 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.193 issued rwts: total=1772,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.193 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:17.193 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1221920: Mon Nov 18 02:01:51 2024 00:19:17.193 read: IOPS=2245, BW=8982KiB/s (9198kB/s)(25.4MiB/2895msec) 00:19:17.193 slat (nsec): min=4387, max=74208, avg=16581.80, stdev=10877.33 00:19:17.193 clat (usec): min=186, max=42290, avg=421.40, stdev=2108.91 00:19:17.193 lat (usec): min=191, max=42295, avg=437.98, stdev=2109.25 00:19:17.193 clat percentiles (usec): 00:19:17.193 | 1.00th=[ 198], 5.00th=[ 208], 10.00th=[ 215], 20.00th=[ 231], 00:19:17.193 | 30.00th=[ 253], 40.00th=[ 289], 50.00th=[ 314], 60.00th=[ 334], 00:19:17.193 | 70.00th=[ 359], 80.00th=[ 379], 90.00th=[ 400], 95.00th=[ 461], 00:19:17.193 | 99.00th=[ 553], 99.50th=[ 570], 99.90th=[42206], 99.95th=[42206], 00:19:17.193 | 99.99th=[42206] 00:19:17.193 bw ( KiB/s): min= 472, max=12192, per=27.36%, avg=8444.80, stdev=4905.18, samples=5 00:19:17.193 iops : min= 118, max= 3048, avg=2111.20, stdev=1226.30, samples=5 00:19:17.193 lat (usec) : 250=29.21%, 500=67.76%, 750=2.75% 00:19:17.193 lat (msec) : 50=0.26% 00:19:17.193 cpu : usr=1.76%, sys=3.97%, ctx=6503, majf=0, minf=1 00:19:17.193 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:17.193 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.193 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.193 issued rwts: total=6502,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.193 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:17.193 00:19:17.193 Run status group 0 (all jobs): 00:19:17.193 READ: bw=30.1MiB/s (31.6MB/s), 2241KiB/s-15.2MiB/s (2295kB/s-15.9MB/s), io=112MiB (117MB), run=2895-3715msec 00:19:17.193 00:19:17.193 Disk stats (read/write): 00:19:17.193 nvme0n1: ios=13387/0, merge=0/0, ticks=3048/0, in_queue=3048, util=94.74% 00:19:17.193 nvme0n2: ios=7001/0, merge=0/0, ticks=3315/0, in_queue=3315, util=96.30% 00:19:17.193 nvme0n3: ios=1770/0, merge=0/0, ticks=3047/0, in_queue=3047, util=96.82% 00:19:17.193 nvme0n4: ios=6491/0, merge=0/0, ticks=2811/0, in_queue=2811, util=99.70% 00:19:17.451 02:01:51 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:17.451 02:01:51 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:17.710 02:01:51 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:17.710 02:01:51 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:17.710 02:01:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:17.710 02:01:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:18.275 02:01:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:18.275 02:01:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:18.275 02:01:52 -- target/fio.sh@69 -- # fio_status=0 00:19:18.275 02:01:52 -- target/fio.sh@70 -- # wait 1221827 00:19:18.275 02:01:52 -- target/fio.sh@70 -- # fio_status=4 00:19:18.275 02:01:52 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:18.533 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:18.533 02:01:52 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:18.533 02:01:52 -- common/autotest_common.sh@1208 -- # local i=0 00:19:18.533 02:01:52 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:18.533 02:01:52 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:18.534 02:01:52 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:18.534 02:01:52 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:18.534 02:01:52 -- common/autotest_common.sh@1220 -- # return 0 00:19:18.534 02:01:52 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:18.534 02:01:52 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:18.534 nvmf hotplug test: fio failed as expected 00:19:18.534 02:01:52 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:18.791 02:01:53 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:18.791 02:01:53 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:18.791 02:01:53 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:18.792 02:01:53 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:18.792 02:01:53 -- target/fio.sh@91 -- # nvmftestfini 00:19:18.792 02:01:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:18.792 02:01:53 -- nvmf/common.sh@116 -- # sync 00:19:18.792 02:01:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:18.792 02:01:53 -- nvmf/common.sh@119 -- # set +e 00:19:18.792 02:01:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:18.792 02:01:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:18.792 rmmod nvme_tcp 00:19:18.792 rmmod nvme_fabrics 00:19:18.792 rmmod nvme_keyring 00:19:18.792 02:01:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:18.792 02:01:53 -- nvmf/common.sh@123 -- # set -e 00:19:18.792 02:01:53 -- nvmf/common.sh@124 -- # return 0 00:19:18.792 02:01:53 -- nvmf/common.sh@477 -- # '[' -n 1219742 ']' 00:19:18.792 02:01:53 -- nvmf/common.sh@478 -- # killprocess 1219742 00:19:18.792 02:01:53 -- common/autotest_common.sh@936 -- # '[' -z 1219742 ']' 00:19:18.792 02:01:53 -- common/autotest_common.sh@940 -- # kill -0 1219742 00:19:18.792 02:01:53 -- common/autotest_common.sh@941 -- # uname 00:19:18.792 02:01:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:18.792 02:01:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1219742 00:19:18.792 02:01:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:18.792 02:01:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:18.792 02:01:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1219742' 00:19:18.792 killing process with pid 1219742 00:19:18.792 02:01:53 -- common/autotest_common.sh@955 -- # kill 1219742 00:19:18.792 02:01:53 -- common/autotest_common.sh@960 -- # wait 1219742 00:19:19.050 02:01:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:19.050 02:01:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:19.050 02:01:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:19.050 02:01:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:19.050 02:01:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:19.050 02:01:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:19.050 02:01:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:19.050 02:01:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:21.586 02:01:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:21.586 00:19:21.586 real 0m24.205s 00:19:21.586 user 1m24.852s 00:19:21.586 sys 0m7.150s 00:19:21.586 02:01:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:21.586 02:01:55 -- common/autotest_common.sh@10 -- # set +x 00:19:21.586 ************************************ 00:19:21.586 END TEST nvmf_fio_target 00:19:21.586 ************************************ 00:19:21.586 02:01:55 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:21.586 02:01:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:21.586 02:01:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:21.586 02:01:55 -- common/autotest_common.sh@10 -- # set +x 00:19:21.586 ************************************ 00:19:21.586 START TEST nvmf_bdevio 00:19:21.586 ************************************ 00:19:21.586 02:01:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:21.587 * Looking for test storage... 00:19:21.587 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:21.587 02:01:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:21.587 02:01:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:21.587 02:01:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:21.587 02:01:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:21.587 02:01:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:21.587 02:01:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:21.587 02:01:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:21.587 02:01:55 -- scripts/common.sh@335 -- # IFS=.-: 00:19:21.587 02:01:55 -- scripts/common.sh@335 -- # read -ra ver1 00:19:21.587 02:01:55 -- scripts/common.sh@336 -- # IFS=.-: 00:19:21.587 02:01:55 -- scripts/common.sh@336 -- # read -ra ver2 00:19:21.587 02:01:55 -- scripts/common.sh@337 -- # local 'op=<' 00:19:21.587 02:01:55 -- scripts/common.sh@339 -- # ver1_l=2 00:19:21.587 02:01:55 -- scripts/common.sh@340 -- # ver2_l=1 00:19:21.587 02:01:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:21.587 02:01:55 -- scripts/common.sh@343 -- # case "$op" in 00:19:21.587 02:01:55 -- scripts/common.sh@344 -- # : 1 00:19:21.587 02:01:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:21.587 02:01:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:21.587 02:01:55 -- scripts/common.sh@364 -- # decimal 1 00:19:21.587 02:01:55 -- scripts/common.sh@352 -- # local d=1 00:19:21.587 02:01:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:21.587 02:01:55 -- scripts/common.sh@354 -- # echo 1 00:19:21.587 02:01:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:21.587 02:01:55 -- scripts/common.sh@365 -- # decimal 2 00:19:21.587 02:01:55 -- scripts/common.sh@352 -- # local d=2 00:19:21.587 02:01:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:21.587 02:01:55 -- scripts/common.sh@354 -- # echo 2 00:19:21.587 02:01:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:21.587 02:01:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:21.587 02:01:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:21.587 02:01:55 -- scripts/common.sh@367 -- # return 0 00:19:21.587 02:01:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:21.587 02:01:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:21.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:21.587 --rc genhtml_branch_coverage=1 00:19:21.587 --rc genhtml_function_coverage=1 00:19:21.587 --rc genhtml_legend=1 00:19:21.587 --rc geninfo_all_blocks=1 00:19:21.587 --rc geninfo_unexecuted_blocks=1 00:19:21.587 00:19:21.587 ' 00:19:21.587 02:01:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:21.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:21.587 --rc genhtml_branch_coverage=1 00:19:21.587 --rc genhtml_function_coverage=1 00:19:21.587 --rc genhtml_legend=1 00:19:21.587 --rc geninfo_all_blocks=1 00:19:21.587 --rc geninfo_unexecuted_blocks=1 00:19:21.587 00:19:21.587 ' 00:19:21.587 02:01:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:21.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:21.587 --rc genhtml_branch_coverage=1 00:19:21.587 --rc genhtml_function_coverage=1 00:19:21.587 --rc genhtml_legend=1 00:19:21.587 --rc geninfo_all_blocks=1 00:19:21.587 --rc geninfo_unexecuted_blocks=1 00:19:21.587 00:19:21.587 ' 00:19:21.587 02:01:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:21.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:21.587 --rc genhtml_branch_coverage=1 00:19:21.587 --rc genhtml_function_coverage=1 00:19:21.587 --rc genhtml_legend=1 00:19:21.587 --rc geninfo_all_blocks=1 00:19:21.587 --rc geninfo_unexecuted_blocks=1 00:19:21.587 00:19:21.587 ' 00:19:21.587 02:01:55 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:21.587 02:01:55 -- nvmf/common.sh@7 -- # uname -s 00:19:21.587 02:01:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:21.587 02:01:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:21.587 02:01:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:21.587 02:01:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:21.587 02:01:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:21.587 02:01:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:21.587 02:01:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:21.587 02:01:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:21.587 02:01:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:21.587 02:01:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:21.587 02:01:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:21.587 02:01:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:21.587 02:01:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:21.587 02:01:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:21.587 02:01:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:21.587 02:01:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:21.587 02:01:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:21.587 02:01:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:21.587 02:01:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:21.587 02:01:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:21.587 02:01:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:21.587 02:01:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:21.587 02:01:55 -- paths/export.sh@5 -- # export PATH 00:19:21.587 02:01:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:21.587 02:01:55 -- nvmf/common.sh@46 -- # : 0 00:19:21.587 02:01:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:21.587 02:01:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:21.587 02:01:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:21.587 02:01:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:21.587 02:01:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:21.587 02:01:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:21.587 02:01:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:21.587 02:01:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:21.587 02:01:55 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:21.587 02:01:55 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:21.587 02:01:55 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:21.587 02:01:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:21.587 02:01:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:21.588 02:01:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:21.588 02:01:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:21.588 02:01:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:21.588 02:01:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:21.588 02:01:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:21.588 02:01:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:21.588 02:01:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:21.588 02:01:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:21.588 02:01:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:21.588 02:01:55 -- common/autotest_common.sh@10 -- # set +x 00:19:23.489 02:01:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:23.489 02:01:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:23.489 02:01:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:23.489 02:01:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:23.489 02:01:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:23.489 02:01:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:23.489 02:01:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:23.489 02:01:57 -- nvmf/common.sh@294 -- # net_devs=() 00:19:23.489 02:01:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:23.489 02:01:57 -- nvmf/common.sh@295 -- # e810=() 00:19:23.489 02:01:57 -- nvmf/common.sh@295 -- # local -ga e810 00:19:23.489 02:01:57 -- nvmf/common.sh@296 -- # x722=() 00:19:23.489 02:01:57 -- nvmf/common.sh@296 -- # local -ga x722 00:19:23.489 02:01:57 -- nvmf/common.sh@297 -- # mlx=() 00:19:23.489 02:01:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:23.489 02:01:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:23.489 02:01:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:23.489 02:01:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:23.489 02:01:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:23.489 02:01:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:23.489 02:01:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:23.489 02:01:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:23.489 02:01:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:23.489 02:01:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:23.489 02:01:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:23.489 02:01:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:23.489 02:01:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:23.489 02:01:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:23.489 02:01:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:23.489 02:01:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:23.489 02:01:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:23.489 02:01:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:23.489 02:01:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:23.489 02:01:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:23.489 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:23.489 02:01:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:23.489 02:01:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:23.490 02:01:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:23.490 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:23.490 02:01:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:23.490 02:01:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:23.490 02:01:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:23.490 02:01:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:23.490 02:01:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:23.490 02:01:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:23.490 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:23.490 02:01:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:23.490 02:01:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:23.490 02:01:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:23.490 02:01:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:23.490 02:01:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:23.490 02:01:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:23.490 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:23.490 02:01:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:23.490 02:01:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:23.490 02:01:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:23.490 02:01:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:23.490 02:01:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:23.490 02:01:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:23.490 02:01:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:23.490 02:01:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:23.490 02:01:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:23.490 02:01:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:23.490 02:01:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:23.490 02:01:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:23.490 02:01:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:23.490 02:01:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:23.490 02:01:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:23.490 02:01:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:23.490 02:01:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:23.490 02:01:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:23.490 02:01:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:23.490 02:01:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:23.490 02:01:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:23.490 02:01:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:23.490 02:01:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:23.490 02:01:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:23.749 02:01:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:23.749 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:23.749 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.162 ms 00:19:23.749 00:19:23.749 --- 10.0.0.2 ping statistics --- 00:19:23.749 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:23.749 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:19:23.749 02:01:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:23.749 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:23.749 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:19:23.749 00:19:23.749 --- 10.0.0.1 ping statistics --- 00:19:23.749 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:23.749 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:19:23.749 02:01:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:23.749 02:01:57 -- nvmf/common.sh@410 -- # return 0 00:19:23.749 02:01:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:23.749 02:01:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:23.749 02:01:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:23.749 02:01:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:23.749 02:01:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:23.749 02:01:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:23.749 02:01:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:23.749 02:01:57 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:23.749 02:01:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:23.749 02:01:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:23.749 02:01:57 -- common/autotest_common.sh@10 -- # set +x 00:19:23.749 02:01:57 -- nvmf/common.sh@469 -- # nvmfpid=1224580 00:19:23.749 02:01:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:23.749 02:01:57 -- nvmf/common.sh@470 -- # waitforlisten 1224580 00:19:23.749 02:01:57 -- common/autotest_common.sh@829 -- # '[' -z 1224580 ']' 00:19:23.749 02:01:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:23.749 02:01:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:23.749 02:01:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:23.749 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:23.749 02:01:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:23.749 02:01:57 -- common/autotest_common.sh@10 -- # set +x 00:19:23.749 [2024-11-18 02:01:57.971151] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:23.749 [2024-11-18 02:01:57.971238] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:23.749 EAL: No free 2048 kB hugepages reported on node 1 00:19:23.749 [2024-11-18 02:01:58.039634] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:23.749 [2024-11-18 02:01:58.129231] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:23.749 [2024-11-18 02:01:58.129408] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:23.749 [2024-11-18 02:01:58.129438] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:23.749 [2024-11-18 02:01:58.129450] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:23.749 [2024-11-18 02:01:58.129542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:23.749 [2024-11-18 02:01:58.129609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:23.749 [2024-11-18 02:01:58.129692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:23.749 [2024-11-18 02:01:58.129695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:24.681 02:01:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:24.681 02:01:58 -- common/autotest_common.sh@862 -- # return 0 00:19:24.681 02:01:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:24.681 02:01:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:24.681 02:01:58 -- common/autotest_common.sh@10 -- # set +x 00:19:24.681 02:01:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:24.681 02:01:59 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:24.681 02:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:24.681 02:01:59 -- common/autotest_common.sh@10 -- # set +x 00:19:24.681 [2024-11-18 02:01:59.027161] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:24.681 02:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:24.681 02:01:59 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:24.681 02:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:24.681 02:01:59 -- common/autotest_common.sh@10 -- # set +x 00:19:24.681 Malloc0 00:19:24.681 02:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:24.681 02:01:59 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:24.681 02:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:24.681 02:01:59 -- common/autotest_common.sh@10 -- # set +x 00:19:24.681 02:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:24.681 02:01:59 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:24.681 02:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:24.681 02:01:59 -- common/autotest_common.sh@10 -- # set +x 00:19:24.681 02:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:24.681 02:01:59 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:24.681 02:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:24.681 02:01:59 -- common/autotest_common.sh@10 -- # set +x 00:19:24.681 [2024-11-18 02:01:59.080464] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:24.940 02:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:24.940 02:01:59 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:24.940 02:01:59 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:24.940 02:01:59 -- nvmf/common.sh@520 -- # config=() 00:19:24.940 02:01:59 -- nvmf/common.sh@520 -- # local subsystem config 00:19:24.940 02:01:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:24.940 02:01:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:24.940 { 00:19:24.940 "params": { 00:19:24.940 "name": "Nvme$subsystem", 00:19:24.940 "trtype": "$TEST_TRANSPORT", 00:19:24.940 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:24.940 "adrfam": "ipv4", 00:19:24.940 "trsvcid": "$NVMF_PORT", 00:19:24.940 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:24.940 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:24.940 "hdgst": ${hdgst:-false}, 00:19:24.940 "ddgst": ${ddgst:-false} 00:19:24.940 }, 00:19:24.940 "method": "bdev_nvme_attach_controller" 00:19:24.940 } 00:19:24.940 EOF 00:19:24.940 )") 00:19:24.940 02:01:59 -- nvmf/common.sh@542 -- # cat 00:19:24.940 02:01:59 -- nvmf/common.sh@544 -- # jq . 00:19:24.940 02:01:59 -- nvmf/common.sh@545 -- # IFS=, 00:19:24.940 02:01:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:24.940 "params": { 00:19:24.940 "name": "Nvme1", 00:19:24.940 "trtype": "tcp", 00:19:24.940 "traddr": "10.0.0.2", 00:19:24.940 "adrfam": "ipv4", 00:19:24.940 "trsvcid": "4420", 00:19:24.940 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:24.940 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:24.940 "hdgst": false, 00:19:24.940 "ddgst": false 00:19:24.940 }, 00:19:24.940 "method": "bdev_nvme_attach_controller" 00:19:24.940 }' 00:19:24.940 [2024-11-18 02:01:59.123554] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:24.940 [2024-11-18 02:01:59.123645] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1224760 ] 00:19:24.940 EAL: No free 2048 kB hugepages reported on node 1 00:19:24.940 [2024-11-18 02:01:59.188583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:24.940 [2024-11-18 02:01:59.275220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:24.940 [2024-11-18 02:01:59.275271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:24.940 [2024-11-18 02:01:59.275274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:25.197 [2024-11-18 02:01:59.561591] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:25.197 [2024-11-18 02:01:59.561652] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:25.197 I/O targets: 00:19:25.197 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:25.197 00:19:25.197 00:19:25.197 CUnit - A unit testing framework for C - Version 2.1-3 00:19:25.197 http://cunit.sourceforge.net/ 00:19:25.197 00:19:25.197 00:19:25.197 Suite: bdevio tests on: Nvme1n1 00:19:25.455 Test: blockdev write read block ...passed 00:19:25.455 Test: blockdev write zeroes read block ...passed 00:19:25.455 Test: blockdev write zeroes read no split ...passed 00:19:25.455 Test: blockdev write zeroes read split ...passed 00:19:25.455 Test: blockdev write zeroes read split partial ...passed 00:19:25.455 Test: blockdev reset ...[2024-11-18 02:01:59.715961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:25.455 [2024-11-18 02:01:59.716058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c3e40 (9): Bad file descriptor 00:19:25.455 [2024-11-18 02:01:59.772479] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:25.455 passed 00:19:25.455 Test: blockdev write read 8 blocks ...passed 00:19:25.455 Test: blockdev write read size > 128k ...passed 00:19:25.455 Test: blockdev write read invalid size ...passed 00:19:25.455 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:25.455 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:25.455 Test: blockdev write read max offset ...passed 00:19:25.712 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:25.712 Test: blockdev writev readv 8 blocks ...passed 00:19:25.712 Test: blockdev writev readv 30 x 1block ...passed 00:19:25.713 Test: blockdev writev readv block ...passed 00:19:25.713 Test: blockdev writev readv size > 128k ...passed 00:19:25.713 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:25.713 Test: blockdev comparev and writev ...[2024-11-18 02:02:00.069255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:25.713 [2024-11-18 02:02:00.069293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:25.713 [2024-11-18 02:02:00.069324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:25.713 [2024-11-18 02:02:00.069354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:25.713 [2024-11-18 02:02:00.069713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:25.713 [2024-11-18 02:02:00.069737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:25.713 [2024-11-18 02:02:00.069760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:25.713 [2024-11-18 02:02:00.069785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:25.713 [2024-11-18 02:02:00.070139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:25.713 [2024-11-18 02:02:00.070163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:25.713 [2024-11-18 02:02:00.070184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:25.713 [2024-11-18 02:02:00.070200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:25.713 [2024-11-18 02:02:00.070570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:25.713 [2024-11-18 02:02:00.070606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:25.713 [2024-11-18 02:02:00.070626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:25.713 [2024-11-18 02:02:00.070643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:25.713 passed 00:19:25.970 Test: blockdev nvme passthru rw ...passed 00:19:25.970 Test: blockdev nvme passthru vendor specific ...[2024-11-18 02:02:00.153593] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:25.970 [2024-11-18 02:02:00.153620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:25.970 [2024-11-18 02:02:00.153754] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:25.970 [2024-11-18 02:02:00.153776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:25.970 [2024-11-18 02:02:00.153905] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:25.970 [2024-11-18 02:02:00.153927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:25.970 [2024-11-18 02:02:00.154053] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:25.970 [2024-11-18 02:02:00.154075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:25.970 passed 00:19:25.970 Test: blockdev nvme admin passthru ...passed 00:19:25.970 Test: blockdev copy ...passed 00:19:25.970 00:19:25.970 Run Summary: Type Total Ran Passed Failed Inactive 00:19:25.970 suites 1 1 n/a 0 0 00:19:25.970 tests 23 23 23 0 0 00:19:25.970 asserts 152 152 152 0 n/a 00:19:25.970 00:19:25.970 Elapsed time = 1.294 seconds 00:19:26.228 02:02:00 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:26.228 02:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.228 02:02:00 -- common/autotest_common.sh@10 -- # set +x 00:19:26.228 02:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.228 02:02:00 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:26.228 02:02:00 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:26.228 02:02:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:26.228 02:02:00 -- nvmf/common.sh@116 -- # sync 00:19:26.228 02:02:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:26.228 02:02:00 -- nvmf/common.sh@119 -- # set +e 00:19:26.228 02:02:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:26.228 02:02:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:26.228 rmmod nvme_tcp 00:19:26.228 rmmod nvme_fabrics 00:19:26.228 rmmod nvme_keyring 00:19:26.228 02:02:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:26.228 02:02:00 -- nvmf/common.sh@123 -- # set -e 00:19:26.228 02:02:00 -- nvmf/common.sh@124 -- # return 0 00:19:26.228 02:02:00 -- nvmf/common.sh@477 -- # '[' -n 1224580 ']' 00:19:26.228 02:02:00 -- nvmf/common.sh@478 -- # killprocess 1224580 00:19:26.228 02:02:00 -- common/autotest_common.sh@936 -- # '[' -z 1224580 ']' 00:19:26.228 02:02:00 -- common/autotest_common.sh@940 -- # kill -0 1224580 00:19:26.228 02:02:00 -- common/autotest_common.sh@941 -- # uname 00:19:26.228 02:02:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:26.228 02:02:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1224580 00:19:26.228 02:02:00 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:26.228 02:02:00 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:26.228 02:02:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1224580' 00:19:26.228 killing process with pid 1224580 00:19:26.228 02:02:00 -- common/autotest_common.sh@955 -- # kill 1224580 00:19:26.228 02:02:00 -- common/autotest_common.sh@960 -- # wait 1224580 00:19:26.487 02:02:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:26.487 02:02:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:26.487 02:02:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:26.487 02:02:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:26.487 02:02:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:26.487 02:02:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:26.487 02:02:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:26.487 02:02:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:28.405 02:02:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:28.405 00:19:28.405 real 0m7.370s 00:19:28.405 user 0m14.006s 00:19:28.405 sys 0m2.152s 00:19:28.405 02:02:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:28.405 02:02:02 -- common/autotest_common.sh@10 -- # set +x 00:19:28.405 ************************************ 00:19:28.405 END TEST nvmf_bdevio 00:19:28.405 ************************************ 00:19:28.405 02:02:02 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:28.405 02:02:02 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:28.405 02:02:02 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:19:28.405 02:02:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:28.405 02:02:02 -- common/autotest_common.sh@10 -- # set +x 00:19:28.664 ************************************ 00:19:28.664 START TEST nvmf_bdevio_no_huge 00:19:28.664 ************************************ 00:19:28.664 02:02:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:28.664 * Looking for test storage... 00:19:28.664 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:28.664 02:02:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:28.664 02:02:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:28.664 02:02:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:28.664 02:02:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:28.664 02:02:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:28.664 02:02:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:28.664 02:02:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:28.664 02:02:02 -- scripts/common.sh@335 -- # IFS=.-: 00:19:28.664 02:02:02 -- scripts/common.sh@335 -- # read -ra ver1 00:19:28.664 02:02:02 -- scripts/common.sh@336 -- # IFS=.-: 00:19:28.664 02:02:02 -- scripts/common.sh@336 -- # read -ra ver2 00:19:28.664 02:02:02 -- scripts/common.sh@337 -- # local 'op=<' 00:19:28.664 02:02:02 -- scripts/common.sh@339 -- # ver1_l=2 00:19:28.664 02:02:02 -- scripts/common.sh@340 -- # ver2_l=1 00:19:28.664 02:02:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:28.664 02:02:02 -- scripts/common.sh@343 -- # case "$op" in 00:19:28.664 02:02:02 -- scripts/common.sh@344 -- # : 1 00:19:28.664 02:02:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:28.664 02:02:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:28.664 02:02:02 -- scripts/common.sh@364 -- # decimal 1 00:19:28.664 02:02:02 -- scripts/common.sh@352 -- # local d=1 00:19:28.664 02:02:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:28.664 02:02:02 -- scripts/common.sh@354 -- # echo 1 00:19:28.664 02:02:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:28.664 02:02:02 -- scripts/common.sh@365 -- # decimal 2 00:19:28.664 02:02:02 -- scripts/common.sh@352 -- # local d=2 00:19:28.664 02:02:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:28.664 02:02:02 -- scripts/common.sh@354 -- # echo 2 00:19:28.664 02:02:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:28.664 02:02:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:28.664 02:02:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:28.664 02:02:02 -- scripts/common.sh@367 -- # return 0 00:19:28.664 02:02:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:28.664 02:02:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:28.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:28.664 --rc genhtml_branch_coverage=1 00:19:28.664 --rc genhtml_function_coverage=1 00:19:28.664 --rc genhtml_legend=1 00:19:28.664 --rc geninfo_all_blocks=1 00:19:28.664 --rc geninfo_unexecuted_blocks=1 00:19:28.664 00:19:28.664 ' 00:19:28.664 02:02:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:28.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:28.664 --rc genhtml_branch_coverage=1 00:19:28.664 --rc genhtml_function_coverage=1 00:19:28.664 --rc genhtml_legend=1 00:19:28.664 --rc geninfo_all_blocks=1 00:19:28.664 --rc geninfo_unexecuted_blocks=1 00:19:28.664 00:19:28.664 ' 00:19:28.664 02:02:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:28.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:28.664 --rc genhtml_branch_coverage=1 00:19:28.664 --rc genhtml_function_coverage=1 00:19:28.664 --rc genhtml_legend=1 00:19:28.664 --rc geninfo_all_blocks=1 00:19:28.664 --rc geninfo_unexecuted_blocks=1 00:19:28.664 00:19:28.664 ' 00:19:28.664 02:02:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:28.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:28.664 --rc genhtml_branch_coverage=1 00:19:28.664 --rc genhtml_function_coverage=1 00:19:28.664 --rc genhtml_legend=1 00:19:28.664 --rc geninfo_all_blocks=1 00:19:28.664 --rc geninfo_unexecuted_blocks=1 00:19:28.664 00:19:28.664 ' 00:19:28.664 02:02:02 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:28.664 02:02:02 -- nvmf/common.sh@7 -- # uname -s 00:19:28.664 02:02:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:28.664 02:02:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:28.664 02:02:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:28.664 02:02:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:28.664 02:02:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:28.664 02:02:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:28.664 02:02:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:28.664 02:02:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:28.664 02:02:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:28.664 02:02:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:28.664 02:02:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:28.664 02:02:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:28.664 02:02:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:28.664 02:02:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:28.664 02:02:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:28.664 02:02:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:28.664 02:02:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:28.664 02:02:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:28.664 02:02:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:28.664 02:02:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.665 02:02:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.665 02:02:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.665 02:02:02 -- paths/export.sh@5 -- # export PATH 00:19:28.665 02:02:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.665 02:02:02 -- nvmf/common.sh@46 -- # : 0 00:19:28.665 02:02:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:28.665 02:02:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:28.665 02:02:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:28.665 02:02:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:28.665 02:02:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:28.665 02:02:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:28.665 02:02:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:28.665 02:02:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:28.665 02:02:02 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:28.665 02:02:02 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:28.665 02:02:02 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:28.665 02:02:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:28.665 02:02:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:28.665 02:02:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:28.665 02:02:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:28.665 02:02:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:28.665 02:02:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:28.665 02:02:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:28.665 02:02:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:28.665 02:02:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:28.665 02:02:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:28.665 02:02:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:28.665 02:02:02 -- common/autotest_common.sh@10 -- # set +x 00:19:30.629 02:02:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:30.629 02:02:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:30.629 02:02:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:30.629 02:02:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:30.629 02:02:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:30.629 02:02:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:30.629 02:02:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:30.629 02:02:04 -- nvmf/common.sh@294 -- # net_devs=() 00:19:30.629 02:02:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:30.629 02:02:04 -- nvmf/common.sh@295 -- # e810=() 00:19:30.629 02:02:04 -- nvmf/common.sh@295 -- # local -ga e810 00:19:30.629 02:02:04 -- nvmf/common.sh@296 -- # x722=() 00:19:30.629 02:02:04 -- nvmf/common.sh@296 -- # local -ga x722 00:19:30.629 02:02:04 -- nvmf/common.sh@297 -- # mlx=() 00:19:30.629 02:02:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:30.629 02:02:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:30.629 02:02:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:30.629 02:02:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:30.629 02:02:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:30.629 02:02:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:30.629 02:02:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:30.629 02:02:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:30.629 02:02:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:30.629 02:02:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:30.629 02:02:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:30.629 02:02:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:30.629 02:02:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:30.630 02:02:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:30.630 02:02:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:30.630 02:02:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:30.630 02:02:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:30.630 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:30.630 02:02:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:30.630 02:02:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:30.630 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:30.630 02:02:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:30.630 02:02:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:30.630 02:02:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:30.630 02:02:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:30.630 02:02:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:30.630 02:02:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:30.630 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:30.630 02:02:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:30.630 02:02:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:30.630 02:02:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:30.630 02:02:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:30.630 02:02:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:30.630 02:02:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:30.630 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:30.630 02:02:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:30.630 02:02:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:30.630 02:02:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:30.630 02:02:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:30.630 02:02:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:30.630 02:02:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:30.630 02:02:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:30.630 02:02:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:30.630 02:02:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:30.630 02:02:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:30.630 02:02:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:30.630 02:02:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:30.630 02:02:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:30.630 02:02:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:30.630 02:02:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:30.630 02:02:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:30.630 02:02:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:30.630 02:02:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:30.630 02:02:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:30.630 02:02:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:30.889 02:02:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:30.889 02:02:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:30.889 02:02:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:30.889 02:02:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:30.889 02:02:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:30.889 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:30.889 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:19:30.889 00:19:30.889 --- 10.0.0.2 ping statistics --- 00:19:30.889 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:30.889 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:19:30.889 02:02:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:30.889 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:30.889 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.178 ms 00:19:30.889 00:19:30.889 --- 10.0.0.1 ping statistics --- 00:19:30.889 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:30.889 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:19:30.889 02:02:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:30.889 02:02:05 -- nvmf/common.sh@410 -- # return 0 00:19:30.889 02:02:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:30.889 02:02:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:30.889 02:02:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:30.889 02:02:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:30.889 02:02:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:30.889 02:02:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:30.889 02:02:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:30.889 02:02:05 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:30.889 02:02:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:30.889 02:02:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:30.889 02:02:05 -- common/autotest_common.sh@10 -- # set +x 00:19:30.889 02:02:05 -- nvmf/common.sh@469 -- # nvmfpid=1226950 00:19:30.889 02:02:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:30.889 02:02:05 -- nvmf/common.sh@470 -- # waitforlisten 1226950 00:19:30.889 02:02:05 -- common/autotest_common.sh@829 -- # '[' -z 1226950 ']' 00:19:30.889 02:02:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:30.889 02:02:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:30.889 02:02:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:30.889 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:30.889 02:02:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:30.889 02:02:05 -- common/autotest_common.sh@10 -- # set +x 00:19:30.889 [2024-11-18 02:02:05.184089] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:30.889 [2024-11-18 02:02:05.184171] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:30.889 [2024-11-18 02:02:05.254904] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:31.147 [2024-11-18 02:02:05.341828] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:31.147 [2024-11-18 02:02:05.341987] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:31.147 [2024-11-18 02:02:05.342005] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:31.147 [2024-11-18 02:02:05.342017] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:31.147 [2024-11-18 02:02:05.342105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:31.147 [2024-11-18 02:02:05.342197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:31.147 [2024-11-18 02:02:05.342296] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:31.147 [2024-11-18 02:02:05.342299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:32.081 02:02:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:32.081 02:02:06 -- common/autotest_common.sh@862 -- # return 0 00:19:32.081 02:02:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:32.081 02:02:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:32.081 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:19:32.081 02:02:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:32.081 02:02:06 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:32.081 02:02:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.081 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:19:32.081 [2024-11-18 02:02:06.186412] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:32.081 02:02:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.081 02:02:06 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:32.081 02:02:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.081 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:19:32.081 Malloc0 00:19:32.081 02:02:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.081 02:02:06 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:32.081 02:02:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.081 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:19:32.081 02:02:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.081 02:02:06 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:32.081 02:02:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.081 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:19:32.081 02:02:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.081 02:02:06 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:32.081 02:02:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.081 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:19:32.081 [2024-11-18 02:02:06.224784] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:32.081 02:02:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.081 02:02:06 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:32.081 02:02:06 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:32.081 02:02:06 -- nvmf/common.sh@520 -- # config=() 00:19:32.081 02:02:06 -- nvmf/common.sh@520 -- # local subsystem config 00:19:32.081 02:02:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:32.081 02:02:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:32.081 { 00:19:32.081 "params": { 00:19:32.081 "name": "Nvme$subsystem", 00:19:32.081 "trtype": "$TEST_TRANSPORT", 00:19:32.081 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:32.081 "adrfam": "ipv4", 00:19:32.081 "trsvcid": "$NVMF_PORT", 00:19:32.081 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:32.081 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:32.081 "hdgst": ${hdgst:-false}, 00:19:32.081 "ddgst": ${ddgst:-false} 00:19:32.081 }, 00:19:32.081 "method": "bdev_nvme_attach_controller" 00:19:32.081 } 00:19:32.081 EOF 00:19:32.081 )") 00:19:32.081 02:02:06 -- nvmf/common.sh@542 -- # cat 00:19:32.081 02:02:06 -- nvmf/common.sh@544 -- # jq . 00:19:32.081 02:02:06 -- nvmf/common.sh@545 -- # IFS=, 00:19:32.081 02:02:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:32.081 "params": { 00:19:32.081 "name": "Nvme1", 00:19:32.081 "trtype": "tcp", 00:19:32.081 "traddr": "10.0.0.2", 00:19:32.081 "adrfam": "ipv4", 00:19:32.081 "trsvcid": "4420", 00:19:32.081 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:32.081 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:32.081 "hdgst": false, 00:19:32.081 "ddgst": false 00:19:32.082 }, 00:19:32.082 "method": "bdev_nvme_attach_controller" 00:19:32.082 }' 00:19:32.082 [2024-11-18 02:02:06.268373] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:32.082 [2024-11-18 02:02:06.268442] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid1227112 ] 00:19:32.082 [2024-11-18 02:02:06.329680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:32.082 [2024-11-18 02:02:06.416203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:32.082 [2024-11-18 02:02:06.416256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:32.082 [2024-11-18 02:02:06.416258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:32.339 [2024-11-18 02:02:06.568779] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:32.339 [2024-11-18 02:02:06.568830] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:32.339 I/O targets: 00:19:32.339 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:32.339 00:19:32.339 00:19:32.339 CUnit - A unit testing framework for C - Version 2.1-3 00:19:32.339 http://cunit.sourceforge.net/ 00:19:32.339 00:19:32.339 00:19:32.340 Suite: bdevio tests on: Nvme1n1 00:19:32.340 Test: blockdev write read block ...passed 00:19:32.340 Test: blockdev write zeroes read block ...passed 00:19:32.340 Test: blockdev write zeroes read no split ...passed 00:19:32.340 Test: blockdev write zeroes read split ...passed 00:19:32.340 Test: blockdev write zeroes read split partial ...passed 00:19:32.340 Test: blockdev reset ...[2024-11-18 02:02:06.688702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:32.340 [2024-11-18 02:02:06.688811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7347c0 (9): Bad file descriptor 00:19:32.340 [2024-11-18 02:02:06.718446] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:32.340 passed 00:19:32.340 Test: blockdev write read 8 blocks ...passed 00:19:32.340 Test: blockdev write read size > 128k ...passed 00:19:32.340 Test: blockdev write read invalid size ...passed 00:19:32.597 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:32.597 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:32.597 Test: blockdev write read max offset ...passed 00:19:32.597 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:32.597 Test: blockdev writev readv 8 blocks ...passed 00:19:32.597 Test: blockdev writev readv 30 x 1block ...passed 00:19:32.597 Test: blockdev writev readv block ...passed 00:19:32.597 Test: blockdev writev readv size > 128k ...passed 00:19:32.597 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:32.597 Test: blockdev comparev and writev ...[2024-11-18 02:02:06.889307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:32.597 [2024-11-18 02:02:06.889349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:32.597 [2024-11-18 02:02:06.889374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:32.597 [2024-11-18 02:02:06.889391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:32.597 [2024-11-18 02:02:06.889726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:32.597 [2024-11-18 02:02:06.889752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:32.597 [2024-11-18 02:02:06.889775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:32.597 [2024-11-18 02:02:06.889791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:32.597 [2024-11-18 02:02:06.890127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:32.597 [2024-11-18 02:02:06.890151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:32.597 [2024-11-18 02:02:06.890172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:32.597 [2024-11-18 02:02:06.890188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:32.597 [2024-11-18 02:02:06.890518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:32.597 [2024-11-18 02:02:06.890548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:32.597 [2024-11-18 02:02:06.890574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:32.597 [2024-11-18 02:02:06.890591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:32.597 passed 00:19:32.597 Test: blockdev nvme passthru rw ...passed 00:19:32.597 Test: blockdev nvme passthru vendor specific ...[2024-11-18 02:02:06.972578] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:32.598 [2024-11-18 02:02:06.972607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:32.598 [2024-11-18 02:02:06.972755] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:32.598 [2024-11-18 02:02:06.972778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:32.598 [2024-11-18 02:02:06.972918] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:32.598 [2024-11-18 02:02:06.972942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:32.598 [2024-11-18 02:02:06.973085] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:32.598 [2024-11-18 02:02:06.973108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:32.598 passed 00:19:32.598 Test: blockdev nvme admin passthru ...passed 00:19:32.856 Test: blockdev copy ...passed 00:19:32.856 00:19:32.856 Run Summary: Type Total Ran Passed Failed Inactive 00:19:32.856 suites 1 1 n/a 0 0 00:19:32.856 tests 23 23 23 0 0 00:19:32.856 asserts 152 152 152 0 n/a 00:19:32.856 00:19:32.856 Elapsed time = 0.922 seconds 00:19:33.114 02:02:07 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:33.114 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:33.114 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:19:33.114 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:33.114 02:02:07 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:33.114 02:02:07 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:33.114 02:02:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:33.114 02:02:07 -- nvmf/common.sh@116 -- # sync 00:19:33.114 02:02:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:33.114 02:02:07 -- nvmf/common.sh@119 -- # set +e 00:19:33.114 02:02:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:33.114 02:02:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:33.114 rmmod nvme_tcp 00:19:33.114 rmmod nvme_fabrics 00:19:33.114 rmmod nvme_keyring 00:19:33.114 02:02:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:33.114 02:02:07 -- nvmf/common.sh@123 -- # set -e 00:19:33.114 02:02:07 -- nvmf/common.sh@124 -- # return 0 00:19:33.114 02:02:07 -- nvmf/common.sh@477 -- # '[' -n 1226950 ']' 00:19:33.114 02:02:07 -- nvmf/common.sh@478 -- # killprocess 1226950 00:19:33.114 02:02:07 -- common/autotest_common.sh@936 -- # '[' -z 1226950 ']' 00:19:33.114 02:02:07 -- common/autotest_common.sh@940 -- # kill -0 1226950 00:19:33.114 02:02:07 -- common/autotest_common.sh@941 -- # uname 00:19:33.114 02:02:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:33.114 02:02:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1226950 00:19:33.114 02:02:07 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:33.114 02:02:07 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:33.114 02:02:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1226950' 00:19:33.114 killing process with pid 1226950 00:19:33.114 02:02:07 -- common/autotest_common.sh@955 -- # kill 1226950 00:19:33.114 02:02:07 -- common/autotest_common.sh@960 -- # wait 1226950 00:19:33.680 02:02:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:33.680 02:02:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:33.680 02:02:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:33.680 02:02:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:33.680 02:02:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:33.680 02:02:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:33.680 02:02:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:33.680 02:02:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:35.582 02:02:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:35.582 00:19:35.582 real 0m7.077s 00:19:35.582 user 0m12.329s 00:19:35.582 sys 0m2.577s 00:19:35.582 02:02:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:35.582 02:02:09 -- common/autotest_common.sh@10 -- # set +x 00:19:35.582 ************************************ 00:19:35.582 END TEST nvmf_bdevio_no_huge 00:19:35.582 ************************************ 00:19:35.582 02:02:09 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:35.582 02:02:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:35.582 02:02:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:35.582 02:02:09 -- common/autotest_common.sh@10 -- # set +x 00:19:35.582 ************************************ 00:19:35.582 START TEST nvmf_tls 00:19:35.582 ************************************ 00:19:35.582 02:02:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:35.582 * Looking for test storage... 00:19:35.582 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:35.582 02:02:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:35.582 02:02:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:35.582 02:02:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:35.841 02:02:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:35.841 02:02:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:35.841 02:02:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:35.841 02:02:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:35.841 02:02:10 -- scripts/common.sh@335 -- # IFS=.-: 00:19:35.841 02:02:10 -- scripts/common.sh@335 -- # read -ra ver1 00:19:35.841 02:02:10 -- scripts/common.sh@336 -- # IFS=.-: 00:19:35.841 02:02:10 -- scripts/common.sh@336 -- # read -ra ver2 00:19:35.841 02:02:10 -- scripts/common.sh@337 -- # local 'op=<' 00:19:35.841 02:02:10 -- scripts/common.sh@339 -- # ver1_l=2 00:19:35.841 02:02:10 -- scripts/common.sh@340 -- # ver2_l=1 00:19:35.841 02:02:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:35.841 02:02:10 -- scripts/common.sh@343 -- # case "$op" in 00:19:35.841 02:02:10 -- scripts/common.sh@344 -- # : 1 00:19:35.841 02:02:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:35.841 02:02:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:35.841 02:02:10 -- scripts/common.sh@364 -- # decimal 1 00:19:35.841 02:02:10 -- scripts/common.sh@352 -- # local d=1 00:19:35.841 02:02:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:35.841 02:02:10 -- scripts/common.sh@354 -- # echo 1 00:19:35.841 02:02:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:35.841 02:02:10 -- scripts/common.sh@365 -- # decimal 2 00:19:35.841 02:02:10 -- scripts/common.sh@352 -- # local d=2 00:19:35.841 02:02:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:35.841 02:02:10 -- scripts/common.sh@354 -- # echo 2 00:19:35.841 02:02:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:35.841 02:02:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:35.841 02:02:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:35.841 02:02:10 -- scripts/common.sh@367 -- # return 0 00:19:35.841 02:02:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:35.841 02:02:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:35.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:35.841 --rc genhtml_branch_coverage=1 00:19:35.841 --rc genhtml_function_coverage=1 00:19:35.841 --rc genhtml_legend=1 00:19:35.841 --rc geninfo_all_blocks=1 00:19:35.841 --rc geninfo_unexecuted_blocks=1 00:19:35.841 00:19:35.841 ' 00:19:35.841 02:02:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:35.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:35.841 --rc genhtml_branch_coverage=1 00:19:35.841 --rc genhtml_function_coverage=1 00:19:35.841 --rc genhtml_legend=1 00:19:35.841 --rc geninfo_all_blocks=1 00:19:35.841 --rc geninfo_unexecuted_blocks=1 00:19:35.841 00:19:35.841 ' 00:19:35.841 02:02:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:35.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:35.841 --rc genhtml_branch_coverage=1 00:19:35.841 --rc genhtml_function_coverage=1 00:19:35.841 --rc genhtml_legend=1 00:19:35.841 --rc geninfo_all_blocks=1 00:19:35.841 --rc geninfo_unexecuted_blocks=1 00:19:35.841 00:19:35.841 ' 00:19:35.841 02:02:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:35.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:35.841 --rc genhtml_branch_coverage=1 00:19:35.841 --rc genhtml_function_coverage=1 00:19:35.841 --rc genhtml_legend=1 00:19:35.841 --rc geninfo_all_blocks=1 00:19:35.841 --rc geninfo_unexecuted_blocks=1 00:19:35.841 00:19:35.841 ' 00:19:35.841 02:02:10 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:35.841 02:02:10 -- nvmf/common.sh@7 -- # uname -s 00:19:35.841 02:02:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:35.841 02:02:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:35.841 02:02:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:35.841 02:02:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:35.841 02:02:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:35.841 02:02:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:35.841 02:02:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:35.841 02:02:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:35.841 02:02:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:35.841 02:02:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:35.841 02:02:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:35.841 02:02:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:35.841 02:02:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:35.841 02:02:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:35.841 02:02:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:35.842 02:02:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:35.842 02:02:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:35.842 02:02:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:35.842 02:02:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:35.842 02:02:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:35.842 02:02:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:35.842 02:02:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:35.842 02:02:10 -- paths/export.sh@5 -- # export PATH 00:19:35.842 02:02:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:35.842 02:02:10 -- nvmf/common.sh@46 -- # : 0 00:19:35.842 02:02:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:35.842 02:02:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:35.842 02:02:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:35.842 02:02:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:35.842 02:02:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:35.842 02:02:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:35.842 02:02:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:35.842 02:02:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:35.842 02:02:10 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:35.842 02:02:10 -- target/tls.sh@71 -- # nvmftestinit 00:19:35.842 02:02:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:35.842 02:02:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:35.842 02:02:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:35.842 02:02:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:35.842 02:02:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:35.842 02:02:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:35.842 02:02:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:35.842 02:02:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:35.842 02:02:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:35.842 02:02:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:35.842 02:02:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:35.842 02:02:10 -- common/autotest_common.sh@10 -- # set +x 00:19:37.744 02:02:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:37.744 02:02:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:37.744 02:02:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:37.744 02:02:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:37.744 02:02:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:37.744 02:02:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:37.744 02:02:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:37.744 02:02:12 -- nvmf/common.sh@294 -- # net_devs=() 00:19:37.744 02:02:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:37.744 02:02:12 -- nvmf/common.sh@295 -- # e810=() 00:19:37.744 02:02:12 -- nvmf/common.sh@295 -- # local -ga e810 00:19:37.744 02:02:12 -- nvmf/common.sh@296 -- # x722=() 00:19:37.744 02:02:12 -- nvmf/common.sh@296 -- # local -ga x722 00:19:37.744 02:02:12 -- nvmf/common.sh@297 -- # mlx=() 00:19:37.744 02:02:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:37.744 02:02:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:37.744 02:02:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:37.744 02:02:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:37.744 02:02:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:37.744 02:02:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:37.744 02:02:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:37.744 02:02:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:37.744 02:02:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:37.744 02:02:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:37.744 02:02:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:37.744 02:02:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:37.744 02:02:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:37.744 02:02:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:37.744 02:02:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:37.744 02:02:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:37.744 02:02:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:37.744 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:37.744 02:02:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:37.744 02:02:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:37.744 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:37.744 02:02:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:37.744 02:02:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:37.744 02:02:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:37.744 02:02:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:37.744 02:02:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:37.744 02:02:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:37.744 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:37.744 02:02:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:37.744 02:02:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:37.744 02:02:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:37.744 02:02:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:37.744 02:02:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:37.744 02:02:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:37.744 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:37.744 02:02:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:37.744 02:02:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:37.744 02:02:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:37.744 02:02:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:37.744 02:02:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:37.744 02:02:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:37.744 02:02:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:37.744 02:02:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:37.744 02:02:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:37.744 02:02:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:37.744 02:02:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:37.744 02:02:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:37.744 02:02:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:37.744 02:02:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:37.744 02:02:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:37.744 02:02:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:37.744 02:02:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:37.744 02:02:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:37.744 02:02:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:37.744 02:02:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:37.744 02:02:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:37.744 02:02:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:38.003 02:02:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:38.003 02:02:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:38.003 02:02:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:38.003 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:38.003 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.241 ms 00:19:38.003 00:19:38.003 --- 10.0.0.2 ping statistics --- 00:19:38.003 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:38.003 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:19:38.003 02:02:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:38.003 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:38.003 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:19:38.003 00:19:38.003 --- 10.0.0.1 ping statistics --- 00:19:38.003 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:38.003 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:19:38.003 02:02:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:38.003 02:02:12 -- nvmf/common.sh@410 -- # return 0 00:19:38.003 02:02:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:38.003 02:02:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:38.003 02:02:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:38.003 02:02:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:38.003 02:02:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:38.003 02:02:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:38.003 02:02:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:38.003 02:02:12 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:19:38.003 02:02:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:38.003 02:02:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:38.003 02:02:12 -- common/autotest_common.sh@10 -- # set +x 00:19:38.003 02:02:12 -- nvmf/common.sh@469 -- # nvmfpid=1229207 00:19:38.003 02:02:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:19:38.003 02:02:12 -- nvmf/common.sh@470 -- # waitforlisten 1229207 00:19:38.003 02:02:12 -- common/autotest_common.sh@829 -- # '[' -z 1229207 ']' 00:19:38.003 02:02:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:38.003 02:02:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:38.003 02:02:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:38.003 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:38.003 02:02:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:38.003 02:02:12 -- common/autotest_common.sh@10 -- # set +x 00:19:38.003 [2024-11-18 02:02:12.271117] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:38.003 [2024-11-18 02:02:12.271201] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:38.003 EAL: No free 2048 kB hugepages reported on node 1 00:19:38.003 [2024-11-18 02:02:12.341940] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:38.261 [2024-11-18 02:02:12.431485] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:38.261 [2024-11-18 02:02:12.431643] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:38.261 [2024-11-18 02:02:12.431663] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:38.261 [2024-11-18 02:02:12.431677] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:38.261 [2024-11-18 02:02:12.431709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:38.261 02:02:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:38.261 02:02:12 -- common/autotest_common.sh@862 -- # return 0 00:19:38.261 02:02:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:38.261 02:02:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:38.261 02:02:12 -- common/autotest_common.sh@10 -- # set +x 00:19:38.261 02:02:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:38.261 02:02:12 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:19:38.261 02:02:12 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:19:38.519 true 00:19:38.519 02:02:12 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:38.519 02:02:12 -- target/tls.sh@82 -- # jq -r .tls_version 00:19:38.778 02:02:13 -- target/tls.sh@82 -- # version=0 00:19:38.778 02:02:13 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:19:38.778 02:02:13 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:39.036 02:02:13 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:39.036 02:02:13 -- target/tls.sh@90 -- # jq -r .tls_version 00:19:39.293 02:02:13 -- target/tls.sh@90 -- # version=13 00:19:39.293 02:02:13 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:19:39.293 02:02:13 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:19:39.551 02:02:13 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:39.551 02:02:13 -- target/tls.sh@98 -- # jq -r .tls_version 00:19:39.809 02:02:14 -- target/tls.sh@98 -- # version=7 00:19:39.809 02:02:14 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:19:39.809 02:02:14 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:19:39.809 02:02:14 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:40.067 02:02:14 -- target/tls.sh@105 -- # ktls=false 00:19:40.067 02:02:14 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:19:40.067 02:02:14 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:19:40.325 02:02:14 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:40.325 02:02:14 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:19:40.583 02:02:14 -- target/tls.sh@113 -- # ktls=true 00:19:40.583 02:02:14 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:19:40.583 02:02:14 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:19:40.841 02:02:15 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:40.841 02:02:15 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:19:41.098 02:02:15 -- target/tls.sh@121 -- # ktls=false 00:19:41.098 02:02:15 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:19:41.098 02:02:15 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:19:41.098 02:02:15 -- target/tls.sh@49 -- # local key hash crc 00:19:41.098 02:02:15 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:19:41.098 02:02:15 -- target/tls.sh@51 -- # hash=01 00:19:41.098 02:02:15 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:19:41.099 02:02:15 -- target/tls.sh@52 -- # gzip -1 -c 00:19:41.099 02:02:15 -- target/tls.sh@52 -- # tail -c8 00:19:41.099 02:02:15 -- target/tls.sh@52 -- # head -c 4 00:19:41.099 02:02:15 -- target/tls.sh@52 -- # crc='p$H�' 00:19:41.099 02:02:15 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:41.099 02:02:15 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:19:41.099 02:02:15 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:41.099 02:02:15 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:41.099 02:02:15 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:19:41.099 02:02:15 -- target/tls.sh@49 -- # local key hash crc 00:19:41.099 02:02:15 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:19:41.099 02:02:15 -- target/tls.sh@51 -- # hash=01 00:19:41.099 02:02:15 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:19:41.099 02:02:15 -- target/tls.sh@52 -- # gzip -1 -c 00:19:41.099 02:02:15 -- target/tls.sh@52 -- # tail -c8 00:19:41.099 02:02:15 -- target/tls.sh@52 -- # head -c 4 00:19:41.099 02:02:15 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:19:41.099 02:02:15 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:41.099 02:02:15 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:19:41.099 02:02:15 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:41.099 02:02:15 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:41.099 02:02:15 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:41.099 02:02:15 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:41.099 02:02:15 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:41.099 02:02:15 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:41.099 02:02:15 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:41.099 02:02:15 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:41.099 02:02:15 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:41.356 02:02:15 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:19:41.922 02:02:16 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:41.922 02:02:16 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:41.922 02:02:16 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:41.922 [2024-11-18 02:02:16.321049] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:42.179 02:02:16 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:42.437 02:02:16 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:42.695 [2024-11-18 02:02:16.866564] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:42.695 [2024-11-18 02:02:16.866841] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:42.695 02:02:16 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:42.953 malloc0 00:19:42.953 02:02:17 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:43.211 02:02:17 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:43.469 02:02:17 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:43.469 EAL: No free 2048 kB hugepages reported on node 1 00:19:53.436 Initializing NVMe Controllers 00:19:53.436 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:53.436 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:53.436 Initialization complete. Launching workers. 00:19:53.436 ======================================================== 00:19:53.436 Latency(us) 00:19:53.436 Device Information : IOPS MiB/s Average min max 00:19:53.436 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7655.26 29.90 8363.04 1099.93 10229.20 00:19:53.436 ======================================================== 00:19:53.436 Total : 7655.26 29.90 8363.04 1099.93 10229.20 00:19:53.436 00:19:53.436 02:02:27 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:53.436 02:02:27 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:53.436 02:02:27 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:53.436 02:02:27 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:53.436 02:02:27 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:19:53.436 02:02:27 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:53.436 02:02:27 -- target/tls.sh@28 -- # bdevperf_pid=1231170 00:19:53.436 02:02:27 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:53.436 02:02:27 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:53.436 02:02:27 -- target/tls.sh@31 -- # waitforlisten 1231170 /var/tmp/bdevperf.sock 00:19:53.436 02:02:27 -- common/autotest_common.sh@829 -- # '[' -z 1231170 ']' 00:19:53.436 02:02:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:53.436 02:02:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:53.436 02:02:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:53.436 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:53.436 02:02:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:53.436 02:02:27 -- common/autotest_common.sh@10 -- # set +x 00:19:53.436 [2024-11-18 02:02:27.775067] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:53.436 [2024-11-18 02:02:27.775142] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1231170 ] 00:19:53.436 EAL: No free 2048 kB hugepages reported on node 1 00:19:53.436 [2024-11-18 02:02:27.833160] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:53.694 [2024-11-18 02:02:27.922775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:54.627 02:02:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:54.627 02:02:28 -- common/autotest_common.sh@862 -- # return 0 00:19:54.627 02:02:28 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:54.885 [2024-11-18 02:02:29.031639] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:54.885 TLSTESTn1 00:19:54.885 02:02:29 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:19:54.885 Running I/O for 10 seconds... 00:20:07.083 00:20:07.083 Latency(us) 00:20:07.083 [2024-11-18T01:02:41.485Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:07.083 [2024-11-18T01:02:41.485Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:07.083 Verification LBA range: start 0x0 length 0x2000 00:20:07.083 TLSTESTn1 : 10.02 4570.52 17.85 0.00 0.00 27967.91 4247.70 44079.03 00:20:07.083 [2024-11-18T01:02:41.485Z] =================================================================================================================== 00:20:07.083 [2024-11-18T01:02:41.485Z] Total : 4570.52 17.85 0.00 0.00 27967.91 4247.70 44079.03 00:20:07.083 0 00:20:07.083 02:02:39 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:07.083 02:02:39 -- target/tls.sh@45 -- # killprocess 1231170 00:20:07.083 02:02:39 -- common/autotest_common.sh@936 -- # '[' -z 1231170 ']' 00:20:07.083 02:02:39 -- common/autotest_common.sh@940 -- # kill -0 1231170 00:20:07.083 02:02:39 -- common/autotest_common.sh@941 -- # uname 00:20:07.083 02:02:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:07.083 02:02:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1231170 00:20:07.083 02:02:39 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:07.083 02:02:39 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:07.083 02:02:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1231170' 00:20:07.083 killing process with pid 1231170 00:20:07.083 02:02:39 -- common/autotest_common.sh@955 -- # kill 1231170 00:20:07.083 Received shutdown signal, test time was about 10.000000 seconds 00:20:07.083 00:20:07.083 Latency(us) 00:20:07.083 [2024-11-18T01:02:41.485Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:07.083 [2024-11-18T01:02:41.485Z] =================================================================================================================== 00:20:07.083 [2024-11-18T01:02:41.485Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:07.083 02:02:39 -- common/autotest_common.sh@960 -- # wait 1231170 00:20:07.083 02:02:39 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:07.083 02:02:39 -- common/autotest_common.sh@650 -- # local es=0 00:20:07.083 02:02:39 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:07.083 02:02:39 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:07.083 02:02:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:07.083 02:02:39 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:07.083 02:02:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:07.083 02:02:39 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:07.083 02:02:39 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:07.083 02:02:39 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:07.083 02:02:39 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:07.083 02:02:39 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:07.083 02:02:39 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:07.083 02:02:39 -- target/tls.sh@28 -- # bdevperf_pid=1232544 00:20:07.083 02:02:39 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:07.083 02:02:39 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:07.083 02:02:39 -- target/tls.sh@31 -- # waitforlisten 1232544 /var/tmp/bdevperf.sock 00:20:07.083 02:02:39 -- common/autotest_common.sh@829 -- # '[' -z 1232544 ']' 00:20:07.083 02:02:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:07.083 02:02:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:07.083 02:02:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:07.083 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:07.083 02:02:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:07.083 02:02:39 -- common/autotest_common.sh@10 -- # set +x 00:20:07.083 [2024-11-18 02:02:39.588771] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:07.083 [2024-11-18 02:02:39.588839] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1232544 ] 00:20:07.083 EAL: No free 2048 kB hugepages reported on node 1 00:20:07.083 [2024-11-18 02:02:39.647912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:07.083 [2024-11-18 02:02:39.738707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:07.083 02:02:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:07.083 02:02:40 -- common/autotest_common.sh@862 -- # return 0 00:20:07.083 02:02:40 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:07.083 [2024-11-18 02:02:40.796653] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:07.083 [2024-11-18 02:02:40.806591] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:07.083 [2024-11-18 02:02:40.807441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1090840 (107): Transport endpoint is not connected 00:20:07.083 [2024-11-18 02:02:40.808433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1090840 (9): Bad file descriptor 00:20:07.083 [2024-11-18 02:02:40.809431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:07.083 [2024-11-18 02:02:40.809452] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:07.083 [2024-11-18 02:02:40.809466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:07.083 request: 00:20:07.083 { 00:20:07.083 "name": "TLSTEST", 00:20:07.083 "trtype": "tcp", 00:20:07.083 "traddr": "10.0.0.2", 00:20:07.083 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:07.083 "adrfam": "ipv4", 00:20:07.083 "trsvcid": "4420", 00:20:07.083 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:07.083 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:07.083 "method": "bdev_nvme_attach_controller", 00:20:07.083 "req_id": 1 00:20:07.083 } 00:20:07.083 Got JSON-RPC error response 00:20:07.083 response: 00:20:07.083 { 00:20:07.083 "code": -32602, 00:20:07.083 "message": "Invalid parameters" 00:20:07.083 } 00:20:07.083 02:02:40 -- target/tls.sh@36 -- # killprocess 1232544 00:20:07.083 02:02:40 -- common/autotest_common.sh@936 -- # '[' -z 1232544 ']' 00:20:07.083 02:02:40 -- common/autotest_common.sh@940 -- # kill -0 1232544 00:20:07.083 02:02:40 -- common/autotest_common.sh@941 -- # uname 00:20:07.083 02:02:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:07.083 02:02:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1232544 00:20:07.083 02:02:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:07.083 02:02:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:07.083 02:02:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1232544' 00:20:07.083 killing process with pid 1232544 00:20:07.083 02:02:40 -- common/autotest_common.sh@955 -- # kill 1232544 00:20:07.083 Received shutdown signal, test time was about 10.000000 seconds 00:20:07.083 00:20:07.083 Latency(us) 00:20:07.083 [2024-11-18T01:02:41.485Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:07.083 [2024-11-18T01:02:41.485Z] =================================================================================================================== 00:20:07.083 [2024-11-18T01:02:41.485Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:07.083 02:02:40 -- common/autotest_common.sh@960 -- # wait 1232544 00:20:07.083 02:02:41 -- target/tls.sh@37 -- # return 1 00:20:07.083 02:02:41 -- common/autotest_common.sh@653 -- # es=1 00:20:07.083 02:02:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:07.083 02:02:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:07.083 02:02:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:07.083 02:02:41 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:07.083 02:02:41 -- common/autotest_common.sh@650 -- # local es=0 00:20:07.083 02:02:41 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:07.083 02:02:41 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:07.083 02:02:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:07.083 02:02:41 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:07.083 02:02:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:07.083 02:02:41 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:07.084 02:02:41 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:07.084 02:02:41 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:07.084 02:02:41 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:07.084 02:02:41 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:07.084 02:02:41 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:07.084 02:02:41 -- target/tls.sh@28 -- # bdevperf_pid=1232705 00:20:07.084 02:02:41 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:07.084 02:02:41 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:07.084 02:02:41 -- target/tls.sh@31 -- # waitforlisten 1232705 /var/tmp/bdevperf.sock 00:20:07.084 02:02:41 -- common/autotest_common.sh@829 -- # '[' -z 1232705 ']' 00:20:07.084 02:02:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:07.084 02:02:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:07.084 02:02:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:07.084 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:07.084 02:02:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:07.084 02:02:41 -- common/autotest_common.sh@10 -- # set +x 00:20:07.084 [2024-11-18 02:02:41.134981] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:07.084 [2024-11-18 02:02:41.135062] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1232705 ] 00:20:07.084 EAL: No free 2048 kB hugepages reported on node 1 00:20:07.084 [2024-11-18 02:02:41.194469] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:07.084 [2024-11-18 02:02:41.277346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:08.018 02:02:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:08.018 02:02:42 -- common/autotest_common.sh@862 -- # return 0 00:20:08.018 02:02:42 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:08.018 [2024-11-18 02:02:42.383805] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:08.018 [2024-11-18 02:02:42.390754] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:08.018 [2024-11-18 02:02:42.390790] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:08.018 [2024-11-18 02:02:42.390846] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:08.018 [2024-11-18 02:02:42.391598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b00840 (107): Transport endpoint is not connected 00:20:08.018 [2024-11-18 02:02:42.392572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b00840 (9): Bad file descriptor 00:20:08.018 [2024-11-18 02:02:42.393571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:08.018 [2024-11-18 02:02:42.393603] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:08.018 [2024-11-18 02:02:42.393618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:08.018 request: 00:20:08.018 { 00:20:08.018 "name": "TLSTEST", 00:20:08.018 "trtype": "tcp", 00:20:08.018 "traddr": "10.0.0.2", 00:20:08.018 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:08.018 "adrfam": "ipv4", 00:20:08.018 "trsvcid": "4420", 00:20:08.018 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:08.018 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:08.018 "method": "bdev_nvme_attach_controller", 00:20:08.018 "req_id": 1 00:20:08.018 } 00:20:08.018 Got JSON-RPC error response 00:20:08.018 response: 00:20:08.018 { 00:20:08.018 "code": -32602, 00:20:08.018 "message": "Invalid parameters" 00:20:08.018 } 00:20:08.018 02:02:42 -- target/tls.sh@36 -- # killprocess 1232705 00:20:08.018 02:02:42 -- common/autotest_common.sh@936 -- # '[' -z 1232705 ']' 00:20:08.018 02:02:42 -- common/autotest_common.sh@940 -- # kill -0 1232705 00:20:08.018 02:02:42 -- common/autotest_common.sh@941 -- # uname 00:20:08.018 02:02:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:08.018 02:02:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1232705 00:20:08.277 02:02:42 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:08.277 02:02:42 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:08.277 02:02:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1232705' 00:20:08.277 killing process with pid 1232705 00:20:08.277 02:02:42 -- common/autotest_common.sh@955 -- # kill 1232705 00:20:08.277 Received shutdown signal, test time was about 10.000000 seconds 00:20:08.277 00:20:08.277 Latency(us) 00:20:08.277 [2024-11-18T01:02:42.679Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:08.277 [2024-11-18T01:02:42.679Z] =================================================================================================================== 00:20:08.277 [2024-11-18T01:02:42.679Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:08.277 02:02:42 -- common/autotest_common.sh@960 -- # wait 1232705 00:20:08.277 02:02:42 -- target/tls.sh@37 -- # return 1 00:20:08.277 02:02:42 -- common/autotest_common.sh@653 -- # es=1 00:20:08.277 02:02:42 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:08.277 02:02:42 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:08.277 02:02:42 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:08.277 02:02:42 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:08.277 02:02:42 -- common/autotest_common.sh@650 -- # local es=0 00:20:08.277 02:02:42 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:08.277 02:02:42 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:08.277 02:02:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:08.277 02:02:42 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:08.277 02:02:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:08.277 02:02:42 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:08.277 02:02:42 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:08.536 02:02:42 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:08.536 02:02:42 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:08.536 02:02:42 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:08.536 02:02:42 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:08.536 02:02:42 -- target/tls.sh@28 -- # bdevperf_pid=1232972 00:20:08.536 02:02:42 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:08.536 02:02:42 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:08.536 02:02:42 -- target/tls.sh@31 -- # waitforlisten 1232972 /var/tmp/bdevperf.sock 00:20:08.536 02:02:42 -- common/autotest_common.sh@829 -- # '[' -z 1232972 ']' 00:20:08.536 02:02:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:08.536 02:02:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:08.536 02:02:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:08.536 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:08.536 02:02:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:08.536 02:02:42 -- common/autotest_common.sh@10 -- # set +x 00:20:08.536 [2024-11-18 02:02:42.721039] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:08.536 [2024-11-18 02:02:42.721118] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1232972 ] 00:20:08.536 EAL: No free 2048 kB hugepages reported on node 1 00:20:08.536 [2024-11-18 02:02:42.778198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:08.536 [2024-11-18 02:02:42.857737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:09.469 02:02:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:09.470 02:02:43 -- common/autotest_common.sh@862 -- # return 0 00:20:09.470 02:02:43 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:09.728 [2024-11-18 02:02:43.972000] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:09.729 [2024-11-18 02:02:43.977129] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:09.729 [2024-11-18 02:02:43.977165] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:09.729 [2024-11-18 02:02:43.977221] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:09.729 [2024-11-18 02:02:43.977688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2270840 (107): Transport endpoint is not connected 00:20:09.729 [2024-11-18 02:02:43.978676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2270840 (9): Bad file descriptor 00:20:09.729 [2024-11-18 02:02:43.979674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:09.729 [2024-11-18 02:02:43.979693] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:09.729 [2024-11-18 02:02:43.979706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:09.729 request: 00:20:09.729 { 00:20:09.729 "name": "TLSTEST", 00:20:09.729 "trtype": "tcp", 00:20:09.729 "traddr": "10.0.0.2", 00:20:09.729 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:09.729 "adrfam": "ipv4", 00:20:09.729 "trsvcid": "4420", 00:20:09.729 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:09.729 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:09.729 "method": "bdev_nvme_attach_controller", 00:20:09.729 "req_id": 1 00:20:09.729 } 00:20:09.729 Got JSON-RPC error response 00:20:09.729 response: 00:20:09.729 { 00:20:09.729 "code": -32602, 00:20:09.729 "message": "Invalid parameters" 00:20:09.729 } 00:20:09.729 02:02:43 -- target/tls.sh@36 -- # killprocess 1232972 00:20:09.729 02:02:43 -- common/autotest_common.sh@936 -- # '[' -z 1232972 ']' 00:20:09.729 02:02:43 -- common/autotest_common.sh@940 -- # kill -0 1232972 00:20:09.729 02:02:43 -- common/autotest_common.sh@941 -- # uname 00:20:09.729 02:02:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:09.729 02:02:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1232972 00:20:09.729 02:02:44 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:09.729 02:02:44 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:09.729 02:02:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1232972' 00:20:09.729 killing process with pid 1232972 00:20:09.729 02:02:44 -- common/autotest_common.sh@955 -- # kill 1232972 00:20:09.729 Received shutdown signal, test time was about 10.000000 seconds 00:20:09.729 00:20:09.729 Latency(us) 00:20:09.729 [2024-11-18T01:02:44.131Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:09.729 [2024-11-18T01:02:44.131Z] =================================================================================================================== 00:20:09.729 [2024-11-18T01:02:44.131Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:09.729 02:02:44 -- common/autotest_common.sh@960 -- # wait 1232972 00:20:09.987 02:02:44 -- target/tls.sh@37 -- # return 1 00:20:09.987 02:02:44 -- common/autotest_common.sh@653 -- # es=1 00:20:09.987 02:02:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:09.987 02:02:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:09.987 02:02:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:09.987 02:02:44 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:09.987 02:02:44 -- common/autotest_common.sh@650 -- # local es=0 00:20:09.987 02:02:44 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:09.987 02:02:44 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:09.987 02:02:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:09.987 02:02:44 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:09.987 02:02:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:09.987 02:02:44 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:09.987 02:02:44 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:09.987 02:02:44 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:09.987 02:02:44 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:09.987 02:02:44 -- target/tls.sh@23 -- # psk= 00:20:09.987 02:02:44 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:09.987 02:02:44 -- target/tls.sh@28 -- # bdevperf_pid=1233130 00:20:09.987 02:02:44 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:09.987 02:02:44 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:09.987 02:02:44 -- target/tls.sh@31 -- # waitforlisten 1233130 /var/tmp/bdevperf.sock 00:20:09.987 02:02:44 -- common/autotest_common.sh@829 -- # '[' -z 1233130 ']' 00:20:09.987 02:02:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:09.987 02:02:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:09.987 02:02:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:09.987 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:09.987 02:02:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:09.987 02:02:44 -- common/autotest_common.sh@10 -- # set +x 00:20:09.987 [2024-11-18 02:02:44.289729] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:09.987 [2024-11-18 02:02:44.289812] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1233130 ] 00:20:09.987 EAL: No free 2048 kB hugepages reported on node 1 00:20:09.987 [2024-11-18 02:02:44.346534] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:10.246 [2024-11-18 02:02:44.426127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:11.180 02:02:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:11.180 02:02:45 -- common/autotest_common.sh@862 -- # return 0 00:20:11.180 02:02:45 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:11.180 [2024-11-18 02:02:45.478784] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:11.180 [2024-11-18 02:02:45.480601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bf8dd0 (9): Bad file descriptor 00:20:11.180 [2024-11-18 02:02:45.481582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:11.180 [2024-11-18 02:02:45.481616] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:11.180 [2024-11-18 02:02:45.481629] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:11.180 request: 00:20:11.180 { 00:20:11.180 "name": "TLSTEST", 00:20:11.180 "trtype": "tcp", 00:20:11.180 "traddr": "10.0.0.2", 00:20:11.180 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:11.180 "adrfam": "ipv4", 00:20:11.180 "trsvcid": "4420", 00:20:11.180 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:11.181 "method": "bdev_nvme_attach_controller", 00:20:11.181 "req_id": 1 00:20:11.181 } 00:20:11.181 Got JSON-RPC error response 00:20:11.181 response: 00:20:11.181 { 00:20:11.181 "code": -32602, 00:20:11.181 "message": "Invalid parameters" 00:20:11.181 } 00:20:11.181 02:02:45 -- target/tls.sh@36 -- # killprocess 1233130 00:20:11.181 02:02:45 -- common/autotest_common.sh@936 -- # '[' -z 1233130 ']' 00:20:11.181 02:02:45 -- common/autotest_common.sh@940 -- # kill -0 1233130 00:20:11.181 02:02:45 -- common/autotest_common.sh@941 -- # uname 00:20:11.181 02:02:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:11.181 02:02:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1233130 00:20:11.181 02:02:45 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:11.181 02:02:45 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:11.181 02:02:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1233130' 00:20:11.181 killing process with pid 1233130 00:20:11.181 02:02:45 -- common/autotest_common.sh@955 -- # kill 1233130 00:20:11.181 Received shutdown signal, test time was about 10.000000 seconds 00:20:11.181 00:20:11.181 Latency(us) 00:20:11.181 [2024-11-18T01:02:45.583Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:11.181 [2024-11-18T01:02:45.583Z] =================================================================================================================== 00:20:11.181 [2024-11-18T01:02:45.583Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:11.181 02:02:45 -- common/autotest_common.sh@960 -- # wait 1233130 00:20:11.439 02:02:45 -- target/tls.sh@37 -- # return 1 00:20:11.439 02:02:45 -- common/autotest_common.sh@653 -- # es=1 00:20:11.439 02:02:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:11.439 02:02:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:11.439 02:02:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:11.439 02:02:45 -- target/tls.sh@167 -- # killprocess 1229207 00:20:11.439 02:02:45 -- common/autotest_common.sh@936 -- # '[' -z 1229207 ']' 00:20:11.439 02:02:45 -- common/autotest_common.sh@940 -- # kill -0 1229207 00:20:11.439 02:02:45 -- common/autotest_common.sh@941 -- # uname 00:20:11.439 02:02:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:11.439 02:02:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1229207 00:20:11.439 02:02:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:11.439 02:02:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:11.439 02:02:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1229207' 00:20:11.439 killing process with pid 1229207 00:20:11.439 02:02:45 -- common/autotest_common.sh@955 -- # kill 1229207 00:20:11.439 02:02:45 -- common/autotest_common.sh@960 -- # wait 1229207 00:20:11.698 02:02:46 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:11.698 02:02:46 -- target/tls.sh@49 -- # local key hash crc 00:20:11.698 02:02:46 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:11.698 02:02:46 -- target/tls.sh@51 -- # hash=02 00:20:11.698 02:02:46 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:11.698 02:02:46 -- target/tls.sh@52 -- # gzip -1 -c 00:20:11.698 02:02:46 -- target/tls.sh@52 -- # tail -c8 00:20:11.698 02:02:46 -- target/tls.sh@52 -- # head -c 4 00:20:11.698 02:02:46 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:11.698 02:02:46 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:11.698 02:02:46 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:11.698 02:02:46 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:11.698 02:02:46 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:11.698 02:02:46 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:11.698 02:02:46 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:11.698 02:02:46 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:11.698 02:02:46 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:11.698 02:02:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:11.698 02:02:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:11.698 02:02:46 -- common/autotest_common.sh@10 -- # set +x 00:20:11.698 02:02:46 -- nvmf/common.sh@469 -- # nvmfpid=1233418 00:20:11.698 02:02:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:11.698 02:02:46 -- nvmf/common.sh@470 -- # waitforlisten 1233418 00:20:11.698 02:02:46 -- common/autotest_common.sh@829 -- # '[' -z 1233418 ']' 00:20:11.698 02:02:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:11.698 02:02:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:11.698 02:02:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:11.698 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:11.698 02:02:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:11.698 02:02:46 -- common/autotest_common.sh@10 -- # set +x 00:20:11.957 [2024-11-18 02:02:46.104076] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:11.957 [2024-11-18 02:02:46.104166] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:11.957 EAL: No free 2048 kB hugepages reported on node 1 00:20:11.957 [2024-11-18 02:02:46.168412] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:11.957 [2024-11-18 02:02:46.252005] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:11.957 [2024-11-18 02:02:46.252164] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:11.957 [2024-11-18 02:02:46.252182] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:11.957 [2024-11-18 02:02:46.252193] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:11.957 [2024-11-18 02:02:46.252233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:12.892 02:02:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:12.892 02:02:47 -- common/autotest_common.sh@862 -- # return 0 00:20:12.892 02:02:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:12.892 02:02:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:12.892 02:02:47 -- common/autotest_common.sh@10 -- # set +x 00:20:12.892 02:02:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:12.892 02:02:47 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:12.892 02:02:47 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:12.892 02:02:47 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:13.150 [2024-11-18 02:02:47.385106] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:13.150 02:02:47 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:13.408 02:02:47 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:13.665 [2024-11-18 02:02:47.890451] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:13.665 [2024-11-18 02:02:47.890719] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:13.665 02:02:47 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:13.924 malloc0 00:20:13.924 02:02:48 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:14.182 02:02:48 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:14.466 02:02:48 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:14.466 02:02:48 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:14.466 02:02:48 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:14.466 02:02:48 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:14.466 02:02:48 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:14.466 02:02:48 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:14.466 02:02:48 -- target/tls.sh@28 -- # bdevperf_pid=1233722 00:20:14.466 02:02:48 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:14.466 02:02:48 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:14.466 02:02:48 -- target/tls.sh@31 -- # waitforlisten 1233722 /var/tmp/bdevperf.sock 00:20:14.466 02:02:48 -- common/autotest_common.sh@829 -- # '[' -z 1233722 ']' 00:20:14.466 02:02:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:14.466 02:02:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:14.466 02:02:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:14.466 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:14.466 02:02:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:14.466 02:02:48 -- common/autotest_common.sh@10 -- # set +x 00:20:14.466 [2024-11-18 02:02:48.706736] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:14.466 [2024-11-18 02:02:48.706814] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1233722 ] 00:20:14.466 EAL: No free 2048 kB hugepages reported on node 1 00:20:14.466 [2024-11-18 02:02:48.762693] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:14.466 [2024-11-18 02:02:48.844802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:15.426 02:02:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:15.426 02:02:49 -- common/autotest_common.sh@862 -- # return 0 00:20:15.426 02:02:49 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:15.684 [2024-11-18 02:02:49.885263] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:15.684 TLSTESTn1 00:20:15.684 02:02:49 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:15.684 Running I/O for 10 seconds... 00:20:27.878 00:20:27.878 Latency(us) 00:20:27.878 [2024-11-18T01:03:02.280Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:27.878 [2024-11-18T01:03:02.280Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:27.878 Verification LBA range: start 0x0 length 0x2000 00:20:27.878 TLSTESTn1 : 10.02 4512.68 17.63 0.00 0.00 28317.95 5097.24 44467.39 00:20:27.878 [2024-11-18T01:03:02.280Z] =================================================================================================================== 00:20:27.878 [2024-11-18T01:03:02.280Z] Total : 4512.68 17.63 0.00 0.00 28317.95 5097.24 44467.39 00:20:27.878 0 00:20:27.878 02:03:00 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:27.878 02:03:00 -- target/tls.sh@45 -- # killprocess 1233722 00:20:27.878 02:03:00 -- common/autotest_common.sh@936 -- # '[' -z 1233722 ']' 00:20:27.878 02:03:00 -- common/autotest_common.sh@940 -- # kill -0 1233722 00:20:27.878 02:03:00 -- common/autotest_common.sh@941 -- # uname 00:20:27.878 02:03:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:27.878 02:03:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1233722 00:20:27.878 02:03:00 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:27.878 02:03:00 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:27.878 02:03:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1233722' 00:20:27.878 killing process with pid 1233722 00:20:27.878 02:03:00 -- common/autotest_common.sh@955 -- # kill 1233722 00:20:27.878 Received shutdown signal, test time was about 10.000000 seconds 00:20:27.878 00:20:27.878 Latency(us) 00:20:27.878 [2024-11-18T01:03:02.280Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:27.878 [2024-11-18T01:03:02.280Z] =================================================================================================================== 00:20:27.878 [2024-11-18T01:03:02.280Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:27.878 02:03:00 -- common/autotest_common.sh@960 -- # wait 1233722 00:20:27.878 02:03:00 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:27.878 02:03:00 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:27.878 02:03:00 -- common/autotest_common.sh@650 -- # local es=0 00:20:27.878 02:03:00 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:27.878 02:03:00 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:27.878 02:03:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:27.878 02:03:00 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:27.878 02:03:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:27.878 02:03:00 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:27.878 02:03:00 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:27.878 02:03:00 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:27.878 02:03:00 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:27.878 02:03:00 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:27.878 02:03:00 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:27.878 02:03:00 -- target/tls.sh@28 -- # bdevperf_pid=1235132 00:20:27.878 02:03:00 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:27.878 02:03:00 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:27.878 02:03:00 -- target/tls.sh@31 -- # waitforlisten 1235132 /var/tmp/bdevperf.sock 00:20:27.878 02:03:00 -- common/autotest_common.sh@829 -- # '[' -z 1235132 ']' 00:20:27.878 02:03:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:27.878 02:03:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:27.878 02:03:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:27.878 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:27.878 02:03:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:27.878 02:03:00 -- common/autotest_common.sh@10 -- # set +x 00:20:27.879 [2024-11-18 02:03:00.434401] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:27.879 [2024-11-18 02:03:00.434485] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1235132 ] 00:20:27.879 EAL: No free 2048 kB hugepages reported on node 1 00:20:27.879 [2024-11-18 02:03:00.500233] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:27.879 [2024-11-18 02:03:00.592662] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:27.879 02:03:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:27.879 02:03:01 -- common/autotest_common.sh@862 -- # return 0 00:20:27.879 02:03:01 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:27.879 [2024-11-18 02:03:01.681764] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:27.879 [2024-11-18 02:03:01.681828] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:27.879 request: 00:20:27.879 { 00:20:27.879 "name": "TLSTEST", 00:20:27.879 "trtype": "tcp", 00:20:27.879 "traddr": "10.0.0.2", 00:20:27.879 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:27.879 "adrfam": "ipv4", 00:20:27.879 "trsvcid": "4420", 00:20:27.879 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:27.879 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:27.879 "method": "bdev_nvme_attach_controller", 00:20:27.879 "req_id": 1 00:20:27.879 } 00:20:27.879 Got JSON-RPC error response 00:20:27.879 response: 00:20:27.879 { 00:20:27.879 "code": -22, 00:20:27.879 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:27.879 } 00:20:27.879 02:03:01 -- target/tls.sh@36 -- # killprocess 1235132 00:20:27.879 02:03:01 -- common/autotest_common.sh@936 -- # '[' -z 1235132 ']' 00:20:27.879 02:03:01 -- common/autotest_common.sh@940 -- # kill -0 1235132 00:20:27.879 02:03:01 -- common/autotest_common.sh@941 -- # uname 00:20:27.879 02:03:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:27.879 02:03:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1235132 00:20:27.879 02:03:01 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:27.879 02:03:01 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:27.879 02:03:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1235132' 00:20:27.879 killing process with pid 1235132 00:20:27.879 02:03:01 -- common/autotest_common.sh@955 -- # kill 1235132 00:20:27.879 Received shutdown signal, test time was about 10.000000 seconds 00:20:27.879 00:20:27.879 Latency(us) 00:20:27.879 [2024-11-18T01:03:02.281Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:27.879 [2024-11-18T01:03:02.281Z] =================================================================================================================== 00:20:27.879 [2024-11-18T01:03:02.281Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:27.879 02:03:01 -- common/autotest_common.sh@960 -- # wait 1235132 00:20:27.879 02:03:01 -- target/tls.sh@37 -- # return 1 00:20:27.879 02:03:01 -- common/autotest_common.sh@653 -- # es=1 00:20:27.879 02:03:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:27.879 02:03:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:27.879 02:03:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:27.879 02:03:01 -- target/tls.sh@183 -- # killprocess 1233418 00:20:27.879 02:03:01 -- common/autotest_common.sh@936 -- # '[' -z 1233418 ']' 00:20:27.879 02:03:01 -- common/autotest_common.sh@940 -- # kill -0 1233418 00:20:27.879 02:03:01 -- common/autotest_common.sh@941 -- # uname 00:20:27.879 02:03:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:27.879 02:03:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1233418 00:20:27.879 02:03:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:27.879 02:03:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:27.879 02:03:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1233418' 00:20:27.879 killing process with pid 1233418 00:20:27.879 02:03:01 -- common/autotest_common.sh@955 -- # kill 1233418 00:20:27.879 02:03:01 -- common/autotest_common.sh@960 -- # wait 1233418 00:20:27.879 02:03:02 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:27.879 02:03:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:27.879 02:03:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:27.879 02:03:02 -- common/autotest_common.sh@10 -- # set +x 00:20:27.879 02:03:02 -- nvmf/common.sh@469 -- # nvmfpid=1235491 00:20:27.879 02:03:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:27.879 02:03:02 -- nvmf/common.sh@470 -- # waitforlisten 1235491 00:20:27.879 02:03:02 -- common/autotest_common.sh@829 -- # '[' -z 1235491 ']' 00:20:27.879 02:03:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:27.879 02:03:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:27.879 02:03:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:27.879 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:27.879 02:03:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:27.879 02:03:02 -- common/autotest_common.sh@10 -- # set +x 00:20:28.137 [2024-11-18 02:03:02.297486] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:28.137 [2024-11-18 02:03:02.297582] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:28.137 EAL: No free 2048 kB hugepages reported on node 1 00:20:28.137 [2024-11-18 02:03:02.365008] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:28.137 [2024-11-18 02:03:02.454820] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:28.137 [2024-11-18 02:03:02.454977] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:28.137 [2024-11-18 02:03:02.454996] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:28.138 [2024-11-18 02:03:02.455011] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:28.138 [2024-11-18 02:03:02.455058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:29.071 02:03:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:29.071 02:03:03 -- common/autotest_common.sh@862 -- # return 0 00:20:29.071 02:03:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:29.071 02:03:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:29.071 02:03:03 -- common/autotest_common.sh@10 -- # set +x 00:20:29.071 02:03:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:29.071 02:03:03 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:29.071 02:03:03 -- common/autotest_common.sh@650 -- # local es=0 00:20:29.071 02:03:03 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:29.071 02:03:03 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:29.071 02:03:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:29.071 02:03:03 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:29.071 02:03:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:29.071 02:03:03 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:29.071 02:03:03 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:29.071 02:03:03 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:29.330 [2024-11-18 02:03:03.613759] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:29.330 02:03:03 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:29.588 02:03:03 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:29.846 [2024-11-18 02:03:04.131151] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:29.846 [2024-11-18 02:03:04.131448] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:29.846 02:03:04 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:30.103 malloc0 00:20:30.103 02:03:04 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:30.361 02:03:04 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.619 [2024-11-18 02:03:04.904679] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:30.619 [2024-11-18 02:03:04.904719] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:30.619 [2024-11-18 02:03:04.904744] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:30.619 request: 00:20:30.619 { 00:20:30.619 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:30.619 "host": "nqn.2016-06.io.spdk:host1", 00:20:30.619 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:30.619 "method": "nvmf_subsystem_add_host", 00:20:30.619 "req_id": 1 00:20:30.619 } 00:20:30.619 Got JSON-RPC error response 00:20:30.619 response: 00:20:30.619 { 00:20:30.619 "code": -32603, 00:20:30.619 "message": "Internal error" 00:20:30.619 } 00:20:30.619 02:03:04 -- common/autotest_common.sh@653 -- # es=1 00:20:30.619 02:03:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:30.619 02:03:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:30.619 02:03:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:30.619 02:03:04 -- target/tls.sh@189 -- # killprocess 1235491 00:20:30.619 02:03:04 -- common/autotest_common.sh@936 -- # '[' -z 1235491 ']' 00:20:30.619 02:03:04 -- common/autotest_common.sh@940 -- # kill -0 1235491 00:20:30.619 02:03:04 -- common/autotest_common.sh@941 -- # uname 00:20:30.619 02:03:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:30.619 02:03:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1235491 00:20:30.619 02:03:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:30.619 02:03:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:30.619 02:03:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1235491' 00:20:30.619 killing process with pid 1235491 00:20:30.619 02:03:04 -- common/autotest_common.sh@955 -- # kill 1235491 00:20:30.619 02:03:04 -- common/autotest_common.sh@960 -- # wait 1235491 00:20:30.877 02:03:05 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.877 02:03:05 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:30.877 02:03:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:30.877 02:03:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:30.877 02:03:05 -- common/autotest_common.sh@10 -- # set +x 00:20:30.877 02:03:05 -- nvmf/common.sh@469 -- # nvmfpid=1235924 00:20:30.877 02:03:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:30.877 02:03:05 -- nvmf/common.sh@470 -- # waitforlisten 1235924 00:20:30.877 02:03:05 -- common/autotest_common.sh@829 -- # '[' -z 1235924 ']' 00:20:30.877 02:03:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:30.877 02:03:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:30.877 02:03:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:30.877 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:30.877 02:03:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:30.877 02:03:05 -- common/autotest_common.sh@10 -- # set +x 00:20:30.877 [2024-11-18 02:03:05.261771] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:30.877 [2024-11-18 02:03:05.261858] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:31.135 EAL: No free 2048 kB hugepages reported on node 1 00:20:31.135 [2024-11-18 02:03:05.326741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:31.135 [2024-11-18 02:03:05.410496] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:31.135 [2024-11-18 02:03:05.410654] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:31.135 [2024-11-18 02:03:05.410672] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:31.135 [2024-11-18 02:03:05.410685] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:31.135 [2024-11-18 02:03:05.410722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:32.069 02:03:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:32.069 02:03:06 -- common/autotest_common.sh@862 -- # return 0 00:20:32.069 02:03:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:32.069 02:03:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:32.069 02:03:06 -- common/autotest_common.sh@10 -- # set +x 00:20:32.069 02:03:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:32.069 02:03:06 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:32.069 02:03:06 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:32.069 02:03:06 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:32.327 [2024-11-18 02:03:06.516727] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:32.327 02:03:06 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:32.585 02:03:06 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:32.843 [2024-11-18 02:03:07.086282] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:32.843 [2024-11-18 02:03:07.086567] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:32.843 02:03:07 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:33.102 malloc0 00:20:33.102 02:03:07 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:33.360 02:03:07 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:33.618 02:03:07 -- target/tls.sh@197 -- # bdevperf_pid=1236540 00:20:33.618 02:03:07 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:33.618 02:03:07 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:33.618 02:03:07 -- target/tls.sh@200 -- # waitforlisten 1236540 /var/tmp/bdevperf.sock 00:20:33.618 02:03:07 -- common/autotest_common.sh@829 -- # '[' -z 1236540 ']' 00:20:33.618 02:03:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:33.618 02:03:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:33.618 02:03:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:33.618 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:33.618 02:03:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:33.618 02:03:07 -- common/autotest_common.sh@10 -- # set +x 00:20:33.618 [2024-11-18 02:03:07.965825] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:33.618 [2024-11-18 02:03:07.965909] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1236540 ] 00:20:33.618 EAL: No free 2048 kB hugepages reported on node 1 00:20:33.877 [2024-11-18 02:03:08.029837] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:33.877 [2024-11-18 02:03:08.122554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:34.811 02:03:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:34.811 02:03:08 -- common/autotest_common.sh@862 -- # return 0 00:20:34.811 02:03:08 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:34.811 [2024-11-18 02:03:09.170216] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:35.068 TLSTESTn1 00:20:35.068 02:03:09 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:20:35.326 02:03:09 -- target/tls.sh@205 -- # tgtconf='{ 00:20:35.326 "subsystems": [ 00:20:35.326 { 00:20:35.326 "subsystem": "iobuf", 00:20:35.326 "config": [ 00:20:35.326 { 00:20:35.326 "method": "iobuf_set_options", 00:20:35.326 "params": { 00:20:35.326 "small_pool_count": 8192, 00:20:35.326 "large_pool_count": 1024, 00:20:35.326 "small_bufsize": 8192, 00:20:35.326 "large_bufsize": 135168 00:20:35.326 } 00:20:35.326 } 00:20:35.326 ] 00:20:35.326 }, 00:20:35.326 { 00:20:35.326 "subsystem": "sock", 00:20:35.326 "config": [ 00:20:35.326 { 00:20:35.326 "method": "sock_impl_set_options", 00:20:35.326 "params": { 00:20:35.326 "impl_name": "posix", 00:20:35.326 "recv_buf_size": 2097152, 00:20:35.326 "send_buf_size": 2097152, 00:20:35.326 "enable_recv_pipe": true, 00:20:35.326 "enable_quickack": false, 00:20:35.326 "enable_placement_id": 0, 00:20:35.326 "enable_zerocopy_send_server": true, 00:20:35.326 "enable_zerocopy_send_client": false, 00:20:35.326 "zerocopy_threshold": 0, 00:20:35.326 "tls_version": 0, 00:20:35.326 "enable_ktls": false 00:20:35.326 } 00:20:35.326 }, 00:20:35.326 { 00:20:35.326 "method": "sock_impl_set_options", 00:20:35.326 "params": { 00:20:35.326 "impl_name": "ssl", 00:20:35.326 "recv_buf_size": 4096, 00:20:35.326 "send_buf_size": 4096, 00:20:35.326 "enable_recv_pipe": true, 00:20:35.326 "enable_quickack": false, 00:20:35.326 "enable_placement_id": 0, 00:20:35.326 "enable_zerocopy_send_server": true, 00:20:35.326 "enable_zerocopy_send_client": false, 00:20:35.326 "zerocopy_threshold": 0, 00:20:35.326 "tls_version": 0, 00:20:35.326 "enable_ktls": false 00:20:35.326 } 00:20:35.326 } 00:20:35.326 ] 00:20:35.326 }, 00:20:35.326 { 00:20:35.326 "subsystem": "vmd", 00:20:35.326 "config": [] 00:20:35.326 }, 00:20:35.326 { 00:20:35.326 "subsystem": "accel", 00:20:35.326 "config": [ 00:20:35.326 { 00:20:35.326 "method": "accel_set_options", 00:20:35.326 "params": { 00:20:35.326 "small_cache_size": 128, 00:20:35.326 "large_cache_size": 16, 00:20:35.326 "task_count": 2048, 00:20:35.326 "sequence_count": 2048, 00:20:35.326 "buf_count": 2048 00:20:35.326 } 00:20:35.326 } 00:20:35.326 ] 00:20:35.326 }, 00:20:35.326 { 00:20:35.326 "subsystem": "bdev", 00:20:35.326 "config": [ 00:20:35.326 { 00:20:35.326 "method": "bdev_set_options", 00:20:35.326 "params": { 00:20:35.326 "bdev_io_pool_size": 65535, 00:20:35.326 "bdev_io_cache_size": 256, 00:20:35.326 "bdev_auto_examine": true, 00:20:35.326 "iobuf_small_cache_size": 128, 00:20:35.326 "iobuf_large_cache_size": 16 00:20:35.326 } 00:20:35.326 }, 00:20:35.326 { 00:20:35.326 "method": "bdev_raid_set_options", 00:20:35.326 "params": { 00:20:35.326 "process_window_size_kb": 1024 00:20:35.326 } 00:20:35.326 }, 00:20:35.326 { 00:20:35.326 "method": "bdev_iscsi_set_options", 00:20:35.326 "params": { 00:20:35.326 "timeout_sec": 30 00:20:35.326 } 00:20:35.326 }, 00:20:35.326 { 00:20:35.326 "method": "bdev_nvme_set_options", 00:20:35.326 "params": { 00:20:35.326 "action_on_timeout": "none", 00:20:35.326 "timeout_us": 0, 00:20:35.326 "timeout_admin_us": 0, 00:20:35.326 "keep_alive_timeout_ms": 10000, 00:20:35.326 "transport_retry_count": 4, 00:20:35.326 "arbitration_burst": 0, 00:20:35.326 "low_priority_weight": 0, 00:20:35.326 "medium_priority_weight": 0, 00:20:35.326 "high_priority_weight": 0, 00:20:35.326 "nvme_adminq_poll_period_us": 10000, 00:20:35.326 "nvme_ioq_poll_period_us": 0, 00:20:35.326 "io_queue_requests": 0, 00:20:35.326 "delay_cmd_submit": true, 00:20:35.326 "bdev_retry_count": 3, 00:20:35.326 "transport_ack_timeout": 0, 00:20:35.326 "ctrlr_loss_timeout_sec": 0, 00:20:35.326 "reconnect_delay_sec": 0, 00:20:35.326 "fast_io_fail_timeout_sec": 0, 00:20:35.326 "generate_uuids": false, 00:20:35.326 "transport_tos": 0, 00:20:35.326 "io_path_stat": false, 00:20:35.326 "allow_accel_sequence": false 00:20:35.326 } 00:20:35.326 }, 00:20:35.326 { 00:20:35.326 "method": "bdev_nvme_set_hotplug", 00:20:35.326 "params": { 00:20:35.326 "period_us": 100000, 00:20:35.326 "enable": false 00:20:35.326 } 00:20:35.326 }, 00:20:35.326 { 00:20:35.326 "method": "bdev_malloc_create", 00:20:35.326 "params": { 00:20:35.326 "name": "malloc0", 00:20:35.326 "num_blocks": 8192, 00:20:35.326 "block_size": 4096, 00:20:35.326 "physical_block_size": 4096, 00:20:35.326 "uuid": "edf29955-b6ee-4783-ada3-00bfddf2670a", 00:20:35.326 "optimal_io_boundary": 0 00:20:35.326 } 00:20:35.326 }, 00:20:35.326 { 00:20:35.327 "method": "bdev_wait_for_examine" 00:20:35.327 } 00:20:35.327 ] 00:20:35.327 }, 00:20:35.327 { 00:20:35.327 "subsystem": "nbd", 00:20:35.327 "config": [] 00:20:35.327 }, 00:20:35.327 { 00:20:35.327 "subsystem": "scheduler", 00:20:35.327 "config": [ 00:20:35.327 { 00:20:35.327 "method": "framework_set_scheduler", 00:20:35.327 "params": { 00:20:35.327 "name": "static" 00:20:35.327 } 00:20:35.327 } 00:20:35.327 ] 00:20:35.327 }, 00:20:35.327 { 00:20:35.327 "subsystem": "nvmf", 00:20:35.327 "config": [ 00:20:35.327 { 00:20:35.327 "method": "nvmf_set_config", 00:20:35.327 "params": { 00:20:35.327 "discovery_filter": "match_any", 00:20:35.327 "admin_cmd_passthru": { 00:20:35.327 "identify_ctrlr": false 00:20:35.327 } 00:20:35.327 } 00:20:35.327 }, 00:20:35.327 { 00:20:35.327 "method": "nvmf_set_max_subsystems", 00:20:35.327 "params": { 00:20:35.327 "max_subsystems": 1024 00:20:35.327 } 00:20:35.327 }, 00:20:35.327 { 00:20:35.327 "method": "nvmf_set_crdt", 00:20:35.327 "params": { 00:20:35.327 "crdt1": 0, 00:20:35.327 "crdt2": 0, 00:20:35.327 "crdt3": 0 00:20:35.327 } 00:20:35.327 }, 00:20:35.327 { 00:20:35.327 "method": "nvmf_create_transport", 00:20:35.327 "params": { 00:20:35.327 "trtype": "TCP", 00:20:35.327 "max_queue_depth": 128, 00:20:35.327 "max_io_qpairs_per_ctrlr": 127, 00:20:35.327 "in_capsule_data_size": 4096, 00:20:35.327 "max_io_size": 131072, 00:20:35.327 "io_unit_size": 131072, 00:20:35.327 "max_aq_depth": 128, 00:20:35.327 "num_shared_buffers": 511, 00:20:35.327 "buf_cache_size": 4294967295, 00:20:35.327 "dif_insert_or_strip": false, 00:20:35.327 "zcopy": false, 00:20:35.327 "c2h_success": false, 00:20:35.327 "sock_priority": 0, 00:20:35.327 "abort_timeout_sec": 1 00:20:35.327 } 00:20:35.327 }, 00:20:35.327 { 00:20:35.327 "method": "nvmf_create_subsystem", 00:20:35.327 "params": { 00:20:35.327 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.327 "allow_any_host": false, 00:20:35.327 "serial_number": "SPDK00000000000001", 00:20:35.327 "model_number": "SPDK bdev Controller", 00:20:35.327 "max_namespaces": 10, 00:20:35.327 "min_cntlid": 1, 00:20:35.327 "max_cntlid": 65519, 00:20:35.327 "ana_reporting": false 00:20:35.327 } 00:20:35.327 }, 00:20:35.327 { 00:20:35.327 "method": "nvmf_subsystem_add_host", 00:20:35.327 "params": { 00:20:35.327 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.327 "host": "nqn.2016-06.io.spdk:host1", 00:20:35.327 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:35.327 } 00:20:35.327 }, 00:20:35.327 { 00:20:35.327 "method": "nvmf_subsystem_add_ns", 00:20:35.327 "params": { 00:20:35.327 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.327 "namespace": { 00:20:35.327 "nsid": 1, 00:20:35.327 "bdev_name": "malloc0", 00:20:35.327 "nguid": "EDF29955B6EE4783ADA300BFDDF2670A", 00:20:35.327 "uuid": "edf29955-b6ee-4783-ada3-00bfddf2670a" 00:20:35.327 } 00:20:35.327 } 00:20:35.327 }, 00:20:35.327 { 00:20:35.327 "method": "nvmf_subsystem_add_listener", 00:20:35.327 "params": { 00:20:35.327 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.327 "listen_address": { 00:20:35.327 "trtype": "TCP", 00:20:35.327 "adrfam": "IPv4", 00:20:35.327 "traddr": "10.0.0.2", 00:20:35.327 "trsvcid": "4420" 00:20:35.327 }, 00:20:35.327 "secure_channel": true 00:20:35.327 } 00:20:35.327 } 00:20:35.327 ] 00:20:35.327 } 00:20:35.327 ] 00:20:35.327 }' 00:20:35.327 02:03:09 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:35.585 02:03:09 -- target/tls.sh@206 -- # bdevperfconf='{ 00:20:35.585 "subsystems": [ 00:20:35.585 { 00:20:35.585 "subsystem": "iobuf", 00:20:35.585 "config": [ 00:20:35.585 { 00:20:35.585 "method": "iobuf_set_options", 00:20:35.585 "params": { 00:20:35.585 "small_pool_count": 8192, 00:20:35.585 "large_pool_count": 1024, 00:20:35.585 "small_bufsize": 8192, 00:20:35.585 "large_bufsize": 135168 00:20:35.585 } 00:20:35.585 } 00:20:35.585 ] 00:20:35.585 }, 00:20:35.585 { 00:20:35.585 "subsystem": "sock", 00:20:35.585 "config": [ 00:20:35.585 { 00:20:35.585 "method": "sock_impl_set_options", 00:20:35.585 "params": { 00:20:35.585 "impl_name": "posix", 00:20:35.585 "recv_buf_size": 2097152, 00:20:35.585 "send_buf_size": 2097152, 00:20:35.585 "enable_recv_pipe": true, 00:20:35.585 "enable_quickack": false, 00:20:35.585 "enable_placement_id": 0, 00:20:35.585 "enable_zerocopy_send_server": true, 00:20:35.585 "enable_zerocopy_send_client": false, 00:20:35.585 "zerocopy_threshold": 0, 00:20:35.585 "tls_version": 0, 00:20:35.585 "enable_ktls": false 00:20:35.585 } 00:20:35.585 }, 00:20:35.585 { 00:20:35.585 "method": "sock_impl_set_options", 00:20:35.585 "params": { 00:20:35.585 "impl_name": "ssl", 00:20:35.585 "recv_buf_size": 4096, 00:20:35.585 "send_buf_size": 4096, 00:20:35.585 "enable_recv_pipe": true, 00:20:35.585 "enable_quickack": false, 00:20:35.585 "enable_placement_id": 0, 00:20:35.585 "enable_zerocopy_send_server": true, 00:20:35.585 "enable_zerocopy_send_client": false, 00:20:35.585 "zerocopy_threshold": 0, 00:20:35.585 "tls_version": 0, 00:20:35.585 "enable_ktls": false 00:20:35.585 } 00:20:35.585 } 00:20:35.585 ] 00:20:35.585 }, 00:20:35.585 { 00:20:35.585 "subsystem": "vmd", 00:20:35.585 "config": [] 00:20:35.585 }, 00:20:35.585 { 00:20:35.585 "subsystem": "accel", 00:20:35.585 "config": [ 00:20:35.585 { 00:20:35.585 "method": "accel_set_options", 00:20:35.585 "params": { 00:20:35.585 "small_cache_size": 128, 00:20:35.585 "large_cache_size": 16, 00:20:35.585 "task_count": 2048, 00:20:35.585 "sequence_count": 2048, 00:20:35.585 "buf_count": 2048 00:20:35.585 } 00:20:35.585 } 00:20:35.585 ] 00:20:35.585 }, 00:20:35.585 { 00:20:35.585 "subsystem": "bdev", 00:20:35.585 "config": [ 00:20:35.585 { 00:20:35.585 "method": "bdev_set_options", 00:20:35.585 "params": { 00:20:35.585 "bdev_io_pool_size": 65535, 00:20:35.585 "bdev_io_cache_size": 256, 00:20:35.585 "bdev_auto_examine": true, 00:20:35.585 "iobuf_small_cache_size": 128, 00:20:35.585 "iobuf_large_cache_size": 16 00:20:35.585 } 00:20:35.585 }, 00:20:35.585 { 00:20:35.585 "method": "bdev_raid_set_options", 00:20:35.585 "params": { 00:20:35.585 "process_window_size_kb": 1024 00:20:35.585 } 00:20:35.585 }, 00:20:35.585 { 00:20:35.585 "method": "bdev_iscsi_set_options", 00:20:35.585 "params": { 00:20:35.585 "timeout_sec": 30 00:20:35.585 } 00:20:35.585 }, 00:20:35.585 { 00:20:35.585 "method": "bdev_nvme_set_options", 00:20:35.585 "params": { 00:20:35.585 "action_on_timeout": "none", 00:20:35.585 "timeout_us": 0, 00:20:35.585 "timeout_admin_us": 0, 00:20:35.585 "keep_alive_timeout_ms": 10000, 00:20:35.585 "transport_retry_count": 4, 00:20:35.585 "arbitration_burst": 0, 00:20:35.585 "low_priority_weight": 0, 00:20:35.585 "medium_priority_weight": 0, 00:20:35.585 "high_priority_weight": 0, 00:20:35.585 "nvme_adminq_poll_period_us": 10000, 00:20:35.585 "nvme_ioq_poll_period_us": 0, 00:20:35.585 "io_queue_requests": 512, 00:20:35.585 "delay_cmd_submit": true, 00:20:35.585 "bdev_retry_count": 3, 00:20:35.585 "transport_ack_timeout": 0, 00:20:35.585 "ctrlr_loss_timeout_sec": 0, 00:20:35.585 "reconnect_delay_sec": 0, 00:20:35.585 "fast_io_fail_timeout_sec": 0, 00:20:35.585 "generate_uuids": false, 00:20:35.585 "transport_tos": 0, 00:20:35.585 "io_path_stat": false, 00:20:35.585 "allow_accel_sequence": false 00:20:35.585 } 00:20:35.585 }, 00:20:35.586 { 00:20:35.586 "method": "bdev_nvme_attach_controller", 00:20:35.586 "params": { 00:20:35.586 "name": "TLSTEST", 00:20:35.586 "trtype": "TCP", 00:20:35.586 "adrfam": "IPv4", 00:20:35.586 "traddr": "10.0.0.2", 00:20:35.586 "trsvcid": "4420", 00:20:35.586 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.586 "prchk_reftag": false, 00:20:35.586 "prchk_guard": false, 00:20:35.586 "ctrlr_loss_timeout_sec": 0, 00:20:35.586 "reconnect_delay_sec": 0, 00:20:35.586 "fast_io_fail_timeout_sec": 0, 00:20:35.586 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:35.586 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:35.586 "hdgst": false, 00:20:35.586 "ddgst": false 00:20:35.586 } 00:20:35.586 }, 00:20:35.586 { 00:20:35.586 "method": "bdev_nvme_set_hotplug", 00:20:35.586 "params": { 00:20:35.586 "period_us": 100000, 00:20:35.586 "enable": false 00:20:35.586 } 00:20:35.586 }, 00:20:35.586 { 00:20:35.586 "method": "bdev_wait_for_examine" 00:20:35.586 } 00:20:35.586 ] 00:20:35.586 }, 00:20:35.586 { 00:20:35.586 "subsystem": "nbd", 00:20:35.586 "config": [] 00:20:35.586 } 00:20:35.586 ] 00:20:35.586 }' 00:20:35.586 02:03:09 -- target/tls.sh@208 -- # killprocess 1236540 00:20:35.586 02:03:09 -- common/autotest_common.sh@936 -- # '[' -z 1236540 ']' 00:20:35.586 02:03:09 -- common/autotest_common.sh@940 -- # kill -0 1236540 00:20:35.586 02:03:09 -- common/autotest_common.sh@941 -- # uname 00:20:35.586 02:03:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:35.586 02:03:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1236540 00:20:35.586 02:03:09 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:35.586 02:03:09 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:35.586 02:03:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1236540' 00:20:35.586 killing process with pid 1236540 00:20:35.586 02:03:09 -- common/autotest_common.sh@955 -- # kill 1236540 00:20:35.586 Received shutdown signal, test time was about 10.000000 seconds 00:20:35.586 00:20:35.586 Latency(us) 00:20:35.586 [2024-11-18T01:03:09.988Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:35.586 [2024-11-18T01:03:09.988Z] =================================================================================================================== 00:20:35.586 [2024-11-18T01:03:09.988Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:35.586 02:03:09 -- common/autotest_common.sh@960 -- # wait 1236540 00:20:35.843 02:03:10 -- target/tls.sh@209 -- # killprocess 1235924 00:20:35.843 02:03:10 -- common/autotest_common.sh@936 -- # '[' -z 1235924 ']' 00:20:35.843 02:03:10 -- common/autotest_common.sh@940 -- # kill -0 1235924 00:20:35.843 02:03:10 -- common/autotest_common.sh@941 -- # uname 00:20:35.843 02:03:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:35.843 02:03:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1235924 00:20:35.843 02:03:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:35.843 02:03:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:35.843 02:03:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1235924' 00:20:35.843 killing process with pid 1235924 00:20:35.843 02:03:10 -- common/autotest_common.sh@955 -- # kill 1235924 00:20:35.843 02:03:10 -- common/autotest_common.sh@960 -- # wait 1235924 00:20:36.101 02:03:10 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:20:36.102 02:03:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:36.102 02:03:10 -- target/tls.sh@212 -- # echo '{ 00:20:36.102 "subsystems": [ 00:20:36.102 { 00:20:36.102 "subsystem": "iobuf", 00:20:36.102 "config": [ 00:20:36.102 { 00:20:36.102 "method": "iobuf_set_options", 00:20:36.102 "params": { 00:20:36.102 "small_pool_count": 8192, 00:20:36.102 "large_pool_count": 1024, 00:20:36.102 "small_bufsize": 8192, 00:20:36.102 "large_bufsize": 135168 00:20:36.102 } 00:20:36.102 } 00:20:36.102 ] 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "subsystem": "sock", 00:20:36.102 "config": [ 00:20:36.102 { 00:20:36.102 "method": "sock_impl_set_options", 00:20:36.102 "params": { 00:20:36.102 "impl_name": "posix", 00:20:36.102 "recv_buf_size": 2097152, 00:20:36.102 "send_buf_size": 2097152, 00:20:36.102 "enable_recv_pipe": true, 00:20:36.102 "enable_quickack": false, 00:20:36.102 "enable_placement_id": 0, 00:20:36.102 "enable_zerocopy_send_server": true, 00:20:36.102 "enable_zerocopy_send_client": false, 00:20:36.102 "zerocopy_threshold": 0, 00:20:36.102 "tls_version": 0, 00:20:36.102 "enable_ktls": false 00:20:36.102 } 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "method": "sock_impl_set_options", 00:20:36.102 "params": { 00:20:36.102 "impl_name": "ssl", 00:20:36.102 "recv_buf_size": 4096, 00:20:36.102 "send_buf_size": 4096, 00:20:36.102 "enable_recv_pipe": true, 00:20:36.102 "enable_quickack": false, 00:20:36.102 "enable_placement_id": 0, 00:20:36.102 "enable_zerocopy_send_server": true, 00:20:36.102 "enable_zerocopy_send_client": false, 00:20:36.102 "zerocopy_threshold": 0, 00:20:36.102 "tls_version": 0, 00:20:36.102 "enable_ktls": false 00:20:36.102 } 00:20:36.102 } 00:20:36.102 ] 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "subsystem": "vmd", 00:20:36.102 "config": [] 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "subsystem": "accel", 00:20:36.102 "config": [ 00:20:36.102 { 00:20:36.102 "method": "accel_set_options", 00:20:36.102 "params": { 00:20:36.102 "small_cache_size": 128, 00:20:36.102 "large_cache_size": 16, 00:20:36.102 "task_count": 2048, 00:20:36.102 "sequence_count": 2048, 00:20:36.102 "buf_count": 2048 00:20:36.102 } 00:20:36.102 } 00:20:36.102 ] 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "subsystem": "bdev", 00:20:36.102 "config": [ 00:20:36.102 { 00:20:36.102 "method": "bdev_set_options", 00:20:36.102 "params": { 00:20:36.102 "bdev_io_pool_size": 65535, 00:20:36.102 "bdev_io_cache_size": 256, 00:20:36.102 "bdev_auto_examine": true, 00:20:36.102 "iobuf_small_cache_size": 128, 00:20:36.102 "iobuf_large_cache_size": 16 00:20:36.102 } 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "method": "bdev_raid_set_options", 00:20:36.102 "params": { 00:20:36.102 "process_window_size_kb": 1024 00:20:36.102 } 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "method": "bdev_iscsi_set_options", 00:20:36.102 "params": { 00:20:36.102 "timeout_sec": 30 00:20:36.102 } 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "method": "bdev_nvme_set_options", 00:20:36.102 "params": { 00:20:36.102 "action_on_timeout": "none", 00:20:36.102 "timeout_us": 0, 00:20:36.102 "timeout_admin_us": 0, 00:20:36.102 "keep_alive_timeout_ms": 10000, 00:20:36.102 "transport_retry_count": 4, 00:20:36.102 "arbitration_burst": 0, 00:20:36.102 "low_priority_weight": 0, 00:20:36.102 "medium_priority_weight": 0, 00:20:36.102 "high_priority_weight": 0, 00:20:36.102 "nvme_adminq_poll_period_us": 10000, 00:20:36.102 "nvme_ioq_poll_period_us": 0, 00:20:36.102 "io_queue_requests": 0, 00:20:36.102 "delay_cmd_submit": true, 00:20:36.102 "bdev_retry_count": 3, 00:20:36.102 "transport_ack_timeout": 0, 00:20:36.102 "ctrlr_loss_timeout_sec": 0, 00:20:36.102 "reconnect_delay_sec": 0, 00:20:36.102 "fast_io_fail_timeout_sec": 0, 00:20:36.102 "generate_uuids": false, 00:20:36.102 "transport_tos": 0, 00:20:36.102 "io_path_stat": false, 00:20:36.102 "allow_accel_sequence": false 00:20:36.102 } 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "method": "bdev_nvme_set_hotplug", 00:20:36.102 "params": { 00:20:36.102 "period_us": 100000, 00:20:36.102 "enable": false 00:20:36.102 } 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "method": "bdev_malloc_create", 00:20:36.102 "params": { 00:20:36.102 "name": "malloc0", 00:20:36.102 "num_blocks": 8192, 00:20:36.102 "block_size": 4096, 00:20:36.102 "physical_block_size": 4096, 00:20:36.102 "uuid": "edf29955-b6ee-4783-ada3-00bfddf2670a", 00:20:36.102 "optimal_io_boundary": 0 00:20:36.102 } 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "method": "bdev_wait_for_examine" 00:20:36.102 } 00:20:36.102 ] 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "subsystem": "nbd", 00:20:36.102 "config": [] 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "subsystem": "sch 02:03:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:36.102 eduler", 00:20:36.102 "config": [ 00:20:36.102 { 00:20:36.102 "method": "framework_set_scheduler", 00:20:36.102 "params": { 00:20:36.102 "name": "static" 00:20:36.102 } 00:20:36.102 } 00:20:36.102 ] 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "subsystem": "nvmf", 00:20:36.102 "config": [ 00:20:36.102 { 00:20:36.102 "method": "nvmf_set_config", 00:20:36.102 "params": { 00:20:36.102 "discovery_filter": "match_any", 00:20:36.102 "admin_cmd_passthru": { 00:20:36.102 "identify_ctrlr": false 00:20:36.102 } 00:20:36.102 } 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "method": "nvmf_set_max_subsystems", 00:20:36.102 "params": { 00:20:36.102 "max_subsystems": 1024 00:20:36.102 } 00:20:36.102 }, 00:20:36.102 { 00:20:36.102 "method": "nvmf_set_crdt", 00:20:36.102 "params": { 00:20:36.102 "crdt1": 0, 00:20:36.102 "crdt2": 0, 00:20:36.102 "crdt3": 0 00:20:36.103 } 00:20:36.103 }, 00:20:36.103 { 00:20:36.103 "method": "nvmf_create_transport", 00:20:36.103 "params": { 00:20:36.103 "trtype": "TCP", 00:20:36.103 "max_queue_depth": 128, 00:20:36.103 "max_io_qpairs_per_ctrlr": 127, 00:20:36.103 "in_capsule_data_size": 4096, 00:20:36.103 "max_io_size": 131072, 00:20:36.103 "io_unit_size": 131072, 00:20:36.103 "max_aq_depth": 128, 00:20:36.103 "num_shared_buffers": 511, 00:20:36.103 "buf_cache_size": 4294967295, 00:20:36.103 "dif_insert_or_strip": false, 00:20:36.103 "zcopy": false, 00:20:36.103 "c2h_success": false, 00:20:36.103 "sock_priority": 0, 00:20:36.103 "abort_timeout_sec": 1 00:20:36.103 } 00:20:36.103 }, 00:20:36.103 { 00:20:36.103 "method": "nvmf_create_subsystem", 00:20:36.103 "params": { 00:20:36.103 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.103 "allow_any_host": false, 00:20:36.103 "serial_number": "SPDK00000000000001", 00:20:36.103 "model_number": "SPDK bdev Controller", 00:20:36.103 "max_namespaces": 10, 00:20:36.103 "min_cntlid": 1, 00:20:36.103 "max_cntlid": 65519, 00:20:36.103 "ana_reporting": false 00:20:36.103 } 00:20:36.103 }, 00:20:36.103 { 00:20:36.103 "method": "nvmf_subsystem_add_host", 00:20:36.103 "params": { 00:20:36.103 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.103 "host": "nqn.2016-06.io.spdk:host1", 00:20:36.103 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:36.103 } 00:20:36.103 }, 00:20:36.103 { 00:20:36.103 "method": "nvmf_subsystem_add_ns", 00:20:36.103 "params": { 00:20:36.103 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.103 "namespace": { 00:20:36.103 "nsid": 1, 00:20:36.103 "bdev_name": "malloc0", 00:20:36.103 "nguid": "EDF29955B6EE4783ADA300BFDDF2670A", 00:20:36.103 "uuid": "edf29955-b6ee-4783-ada3-00bfddf2670a" 00:20:36.103 } 00:20:36.103 } 00:20:36.103 }, 00:20:36.103 { 00:20:36.103 "method": "nvmf_subsystem_add_listener", 00:20:36.103 "params": { 00:20:36.103 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.103 "listen_address": { 00:20:36.103 "trtype": "TCP", 00:20:36.103 "adrfam": "IPv4", 00:20:36.103 "traddr": "10.0.0.2", 00:20:36.103 "trsvcid": "4420" 00:20:36.103 }, 00:20:36.103 "secure_channel": true 00:20:36.103 } 00:20:36.103 } 00:20:36.103 ] 00:20:36.103 } 00:20:36.103 ] 00:20:36.103 }' 00:20:36.103 02:03:10 -- common/autotest_common.sh@10 -- # set +x 00:20:36.103 02:03:10 -- nvmf/common.sh@469 -- # nvmfpid=1237027 00:20:36.103 02:03:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:20:36.103 02:03:10 -- nvmf/common.sh@470 -- # waitforlisten 1237027 00:20:36.103 02:03:10 -- common/autotest_common.sh@829 -- # '[' -z 1237027 ']' 00:20:36.103 02:03:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:36.103 02:03:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:36.103 02:03:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:36.103 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:36.103 02:03:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:36.103 02:03:10 -- common/autotest_common.sh@10 -- # set +x 00:20:36.103 [2024-11-18 02:03:10.477634] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:36.103 [2024-11-18 02:03:10.477703] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:36.361 EAL: No free 2048 kB hugepages reported on node 1 00:20:36.361 [2024-11-18 02:03:10.542365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:36.361 [2024-11-18 02:03:10.632158] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:36.361 [2024-11-18 02:03:10.632297] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:36.361 [2024-11-18 02:03:10.632322] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:36.361 [2024-11-18 02:03:10.632359] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:36.361 [2024-11-18 02:03:10.632386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:36.619 [2024-11-18 02:03:10.857959] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:36.619 [2024-11-18 02:03:10.889996] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:36.619 [2024-11-18 02:03:10.890274] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:37.185 02:03:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:37.185 02:03:11 -- common/autotest_common.sh@862 -- # return 0 00:20:37.185 02:03:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:37.185 02:03:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:37.185 02:03:11 -- common/autotest_common.sh@10 -- # set +x 00:20:37.185 02:03:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:37.185 02:03:11 -- target/tls.sh@216 -- # bdevperf_pid=1237179 00:20:37.185 02:03:11 -- target/tls.sh@217 -- # waitforlisten 1237179 /var/tmp/bdevperf.sock 00:20:37.185 02:03:11 -- common/autotest_common.sh@829 -- # '[' -z 1237179 ']' 00:20:37.185 02:03:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:37.185 02:03:11 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:20:37.185 02:03:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:37.185 02:03:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:37.185 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:37.185 02:03:11 -- target/tls.sh@213 -- # echo '{ 00:20:37.185 "subsystems": [ 00:20:37.185 { 00:20:37.185 "subsystem": "iobuf", 00:20:37.185 "config": [ 00:20:37.185 { 00:20:37.185 "method": "iobuf_set_options", 00:20:37.185 "params": { 00:20:37.185 "small_pool_count": 8192, 00:20:37.185 "large_pool_count": 1024, 00:20:37.185 "small_bufsize": 8192, 00:20:37.186 "large_bufsize": 135168 00:20:37.186 } 00:20:37.186 } 00:20:37.186 ] 00:20:37.186 }, 00:20:37.186 { 00:20:37.186 "subsystem": "sock", 00:20:37.186 "config": [ 00:20:37.186 { 00:20:37.186 "method": "sock_impl_set_options", 00:20:37.186 "params": { 00:20:37.186 "impl_name": "posix", 00:20:37.186 "recv_buf_size": 2097152, 00:20:37.186 "send_buf_size": 2097152, 00:20:37.186 "enable_recv_pipe": true, 00:20:37.186 "enable_quickack": false, 00:20:37.186 "enable_placement_id": 0, 00:20:37.186 "enable_zerocopy_send_server": true, 00:20:37.186 "enable_zerocopy_send_client": false, 00:20:37.186 "zerocopy_threshold": 0, 00:20:37.186 "tls_version": 0, 00:20:37.186 "enable_ktls": false 00:20:37.186 } 00:20:37.186 }, 00:20:37.186 { 00:20:37.186 "method": "sock_impl_set_options", 00:20:37.186 "params": { 00:20:37.186 "impl_name": "ssl", 00:20:37.186 "recv_buf_size": 4096, 00:20:37.186 "send_buf_size": 4096, 00:20:37.186 "enable_recv_pipe": true, 00:20:37.186 "enable_quickack": false, 00:20:37.186 "enable_placement_id": 0, 00:20:37.186 "enable_zerocopy_send_server": true, 00:20:37.186 "enable_zerocopy_send_client": false, 00:20:37.186 "zerocopy_threshold": 0, 00:20:37.186 "tls_version": 0, 00:20:37.186 "enable_ktls": false 00:20:37.186 } 00:20:37.186 } 00:20:37.186 ] 00:20:37.186 }, 00:20:37.186 { 00:20:37.186 "subsystem": "vmd", 00:20:37.186 "config": [] 00:20:37.186 }, 00:20:37.186 { 00:20:37.186 "subsystem": "accel", 00:20:37.186 "config": [ 00:20:37.186 { 00:20:37.186 "method": "accel_set_options", 00:20:37.186 "params": { 00:20:37.186 "small_cache_size": 128, 00:20:37.186 "large_cache_size": 16, 00:20:37.186 "task_count": 2048, 00:20:37.186 "sequence_count": 2048, 00:20:37.186 "buf_count": 2048 00:20:37.186 } 00:20:37.186 } 00:20:37.186 ] 00:20:37.186 }, 00:20:37.186 { 00:20:37.186 "subsystem": "bdev", 00:20:37.186 "config": [ 00:20:37.186 { 00:20:37.186 "method": "bdev_set_options", 00:20:37.186 "params": { 00:20:37.186 "bdev_io_pool_size": 65535, 00:20:37.186 "bdev_io_cache_size": 256, 00:20:37.186 "bdev_auto_examine": true, 00:20:37.186 "iobuf_small_cache_size": 128, 00:20:37.186 "iobuf_large_cache_size": 16 00:20:37.186 } 00:20:37.186 }, 00:20:37.186 { 00:20:37.186 "method": "bdev_raid_set_options", 00:20:37.186 "params": { 00:20:37.186 "process_window_size_kb": 1024 00:20:37.186 } 00:20:37.186 }, 00:20:37.186 { 00:20:37.186 "method": "bdev_iscsi_set_options", 00:20:37.186 "params": { 00:20:37.186 "timeout_sec": 30 00:20:37.186 } 00:20:37.186 }, 00:20:37.186 { 00:20:37.186 "method": "bdev_nvme_set_options", 00:20:37.186 "params": { 00:20:37.186 "action_on_timeout": "none", 00:20:37.186 "timeout_us": 0, 00:20:37.186 "timeout_admin_us": 0, 00:20:37.186 "keep_alive_timeout_ms": 10000, 00:20:37.186 "transport_retry_count": 4, 00:20:37.186 "arbitration_burst": 0, 00:20:37.186 "low_priority_weight": 0, 00:20:37.186 "medium_priority_weight": 0, 00:20:37.186 "high_priority_weight": 0, 00:20:37.186 "nvme_adminq_poll_period_us": 10000, 00:20:37.186 "nvme_ioq_poll_period_us": 0, 00:20:37.186 "io_queue_requests": 512, 00:20:37.186 "delay_cmd_submit": true, 00:20:37.186 "bdev_retry_count": 3, 00:20:37.186 "transport_ack_timeout": 0, 00:20:37.186 "ctrlr_loss_timeout_sec": 0, 00:20:37.186 "reconnect_delay_sec": 0, 00:20:37.186 "fast_io_fail_timeout_sec": 0, 00:20:37.186 "generate_uuids": false, 00:20:37.186 "transport_tos": 0, 00:20:37.186 "io_path_stat": false, 00:20:37.186 "allow_accel_sequence": false 00:20:37.186 } 00:20:37.186 }, 00:20:37.186 { 00:20:37.186 "method": "bdev_nvme_attach_controller", 00:20:37.186 "params": { 00:20:37.186 "name": "TLSTEST", 00:20:37.186 "trtype": "TCP", 00:20:37.186 "adrfam": "IPv4", 00:20:37.186 "traddr": "10.0.0.2", 00:20:37.186 "trsvcid": "4420", 00:20:37.186 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.186 "prchk_reftag": false, 00:20:37.186 "prchk_guard": false, 00:20:37.186 "ctrlr_loss_timeout_sec": 0, 00:20:37.186 "reconnect_delay_sec": 0, 00:20:37.186 "fast_io_fail_timeout_sec": 0, 00:20:37.186 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:37.186 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:37.186 "hdgst": false, 00:20:37.186 "ddgst": false 00:20:37.186 } 00:20:37.186 }, 00:20:37.186 { 00:20:37.186 "method": "bdev_nvme_set_hotplug", 00:20:37.186 "params": { 00:20:37.186 "period_us": 100000, 00:20:37.186 "enable": false 00:20:37.186 } 00:20:37.186 }, 00:20:37.186 { 00:20:37.186 "method": "bdev_wait_for_examine" 00:20:37.186 } 00:20:37.186 ] 00:20:37.186 }, 00:20:37.186 { 00:20:37.186 "subsystem": "nbd", 00:20:37.186 "config": [] 00:20:37.186 } 00:20:37.186 ] 00:20:37.186 }' 00:20:37.186 02:03:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:37.186 02:03:11 -- common/autotest_common.sh@10 -- # set +x 00:20:37.186 [2024-11-18 02:03:11.571287] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:37.186 [2024-11-18 02:03:11.571371] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1237179 ] 00:20:37.445 EAL: No free 2048 kB hugepages reported on node 1 00:20:37.445 [2024-11-18 02:03:11.633489] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:37.445 [2024-11-18 02:03:11.728125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:37.703 [2024-11-18 02:03:11.892147] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:38.270 02:03:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:38.270 02:03:12 -- common/autotest_common.sh@862 -- # return 0 00:20:38.270 02:03:12 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:38.270 Running I/O for 10 seconds... 00:20:50.466 00:20:50.466 Latency(us) 00:20:50.466 [2024-11-18T01:03:24.868Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:50.466 [2024-11-18T01:03:24.868Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:50.466 Verification LBA range: start 0x0 length 0x2000 00:20:50.466 TLSTESTn1 : 10.01 4605.24 17.99 0.00 0.00 27760.30 3349.62 46409.20 00:20:50.466 [2024-11-18T01:03:24.868Z] =================================================================================================================== 00:20:50.466 [2024-11-18T01:03:24.868Z] Total : 4605.24 17.99 0.00 0.00 27760.30 3349.62 46409.20 00:20:50.466 0 00:20:50.466 02:03:22 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:50.466 02:03:22 -- target/tls.sh@223 -- # killprocess 1237179 00:20:50.466 02:03:22 -- common/autotest_common.sh@936 -- # '[' -z 1237179 ']' 00:20:50.466 02:03:22 -- common/autotest_common.sh@940 -- # kill -0 1237179 00:20:50.466 02:03:22 -- common/autotest_common.sh@941 -- # uname 00:20:50.466 02:03:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:50.466 02:03:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1237179 00:20:50.466 02:03:22 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:50.466 02:03:22 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:50.466 02:03:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1237179' 00:20:50.466 killing process with pid 1237179 00:20:50.466 02:03:22 -- common/autotest_common.sh@955 -- # kill 1237179 00:20:50.466 Received shutdown signal, test time was about 10.000000 seconds 00:20:50.466 00:20:50.466 Latency(us) 00:20:50.466 [2024-11-18T01:03:24.868Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:50.466 [2024-11-18T01:03:24.868Z] =================================================================================================================== 00:20:50.466 [2024-11-18T01:03:24.868Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:50.466 02:03:22 -- common/autotest_common.sh@960 -- # wait 1237179 00:20:50.466 02:03:22 -- target/tls.sh@224 -- # killprocess 1237027 00:20:50.466 02:03:22 -- common/autotest_common.sh@936 -- # '[' -z 1237027 ']' 00:20:50.466 02:03:22 -- common/autotest_common.sh@940 -- # kill -0 1237027 00:20:50.466 02:03:22 -- common/autotest_common.sh@941 -- # uname 00:20:50.466 02:03:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:50.466 02:03:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1237027 00:20:50.466 02:03:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:50.466 02:03:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:50.466 02:03:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1237027' 00:20:50.466 killing process with pid 1237027 00:20:50.466 02:03:22 -- common/autotest_common.sh@955 -- # kill 1237027 00:20:50.466 02:03:22 -- common/autotest_common.sh@960 -- # wait 1237027 00:20:50.466 02:03:23 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:20:50.466 02:03:23 -- target/tls.sh@227 -- # cleanup 00:20:50.466 02:03:23 -- target/tls.sh@15 -- # process_shm --id 0 00:20:50.466 02:03:23 -- common/autotest_common.sh@806 -- # type=--id 00:20:50.466 02:03:23 -- common/autotest_common.sh@807 -- # id=0 00:20:50.466 02:03:23 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:20:50.466 02:03:23 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:20:50.466 02:03:23 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:20:50.466 02:03:23 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:20:50.466 02:03:23 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:20:50.466 02:03:23 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:20:50.466 nvmf_trace.0 00:20:50.466 02:03:23 -- common/autotest_common.sh@821 -- # return 0 00:20:50.466 02:03:23 -- target/tls.sh@16 -- # killprocess 1237179 00:20:50.466 02:03:23 -- common/autotest_common.sh@936 -- # '[' -z 1237179 ']' 00:20:50.466 02:03:23 -- common/autotest_common.sh@940 -- # kill -0 1237179 00:20:50.466 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1237179) - No such process 00:20:50.466 02:03:23 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1237179 is not found' 00:20:50.466 Process with pid 1237179 is not found 00:20:50.466 02:03:23 -- target/tls.sh@17 -- # nvmftestfini 00:20:50.466 02:03:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:50.466 02:03:23 -- nvmf/common.sh@116 -- # sync 00:20:50.466 02:03:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:50.466 02:03:23 -- nvmf/common.sh@119 -- # set +e 00:20:50.466 02:03:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:50.466 02:03:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:50.466 rmmod nvme_tcp 00:20:50.466 rmmod nvme_fabrics 00:20:50.466 rmmod nvme_keyring 00:20:50.466 02:03:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:50.466 02:03:23 -- nvmf/common.sh@123 -- # set -e 00:20:50.466 02:03:23 -- nvmf/common.sh@124 -- # return 0 00:20:50.466 02:03:23 -- nvmf/common.sh@477 -- # '[' -n 1237027 ']' 00:20:50.466 02:03:23 -- nvmf/common.sh@478 -- # killprocess 1237027 00:20:50.466 02:03:23 -- common/autotest_common.sh@936 -- # '[' -z 1237027 ']' 00:20:50.466 02:03:23 -- common/autotest_common.sh@940 -- # kill -0 1237027 00:20:50.466 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1237027) - No such process 00:20:50.466 02:03:23 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1237027 is not found' 00:20:50.466 Process with pid 1237027 is not found 00:20:50.466 02:03:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:50.466 02:03:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:50.466 02:03:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:50.466 02:03:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:50.466 02:03:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:50.466 02:03:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:50.466 02:03:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:50.466 02:03:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:51.054 02:03:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:51.054 02:03:25 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:51.054 00:20:51.054 real 1m15.452s 00:20:51.054 user 2m2.807s 00:20:51.054 sys 0m22.852s 00:20:51.054 02:03:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:51.054 02:03:25 -- common/autotest_common.sh@10 -- # set +x 00:20:51.054 ************************************ 00:20:51.054 END TEST nvmf_tls 00:20:51.054 ************************************ 00:20:51.054 02:03:25 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:51.054 02:03:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:51.054 02:03:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:51.054 02:03:25 -- common/autotest_common.sh@10 -- # set +x 00:20:51.054 ************************************ 00:20:51.054 START TEST nvmf_fips 00:20:51.054 ************************************ 00:20:51.054 02:03:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:51.054 * Looking for test storage... 00:20:51.054 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:20:51.054 02:03:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:51.054 02:03:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:51.054 02:03:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:51.314 02:03:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:51.314 02:03:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:51.315 02:03:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:51.315 02:03:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:51.315 02:03:25 -- scripts/common.sh@335 -- # IFS=.-: 00:20:51.315 02:03:25 -- scripts/common.sh@335 -- # read -ra ver1 00:20:51.315 02:03:25 -- scripts/common.sh@336 -- # IFS=.-: 00:20:51.315 02:03:25 -- scripts/common.sh@336 -- # read -ra ver2 00:20:51.315 02:03:25 -- scripts/common.sh@337 -- # local 'op=<' 00:20:51.315 02:03:25 -- scripts/common.sh@339 -- # ver1_l=2 00:20:51.315 02:03:25 -- scripts/common.sh@340 -- # ver2_l=1 00:20:51.315 02:03:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:51.315 02:03:25 -- scripts/common.sh@343 -- # case "$op" in 00:20:51.315 02:03:25 -- scripts/common.sh@344 -- # : 1 00:20:51.315 02:03:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:51.315 02:03:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:51.315 02:03:25 -- scripts/common.sh@364 -- # decimal 1 00:20:51.315 02:03:25 -- scripts/common.sh@352 -- # local d=1 00:20:51.315 02:03:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:51.315 02:03:25 -- scripts/common.sh@354 -- # echo 1 00:20:51.315 02:03:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:51.315 02:03:25 -- scripts/common.sh@365 -- # decimal 2 00:20:51.315 02:03:25 -- scripts/common.sh@352 -- # local d=2 00:20:51.315 02:03:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:51.315 02:03:25 -- scripts/common.sh@354 -- # echo 2 00:20:51.315 02:03:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:51.315 02:03:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:51.315 02:03:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:51.315 02:03:25 -- scripts/common.sh@367 -- # return 0 00:20:51.315 02:03:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:51.315 02:03:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:51.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:51.315 --rc genhtml_branch_coverage=1 00:20:51.315 --rc genhtml_function_coverage=1 00:20:51.315 --rc genhtml_legend=1 00:20:51.315 --rc geninfo_all_blocks=1 00:20:51.315 --rc geninfo_unexecuted_blocks=1 00:20:51.315 00:20:51.315 ' 00:20:51.315 02:03:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:51.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:51.315 --rc genhtml_branch_coverage=1 00:20:51.315 --rc genhtml_function_coverage=1 00:20:51.315 --rc genhtml_legend=1 00:20:51.315 --rc geninfo_all_blocks=1 00:20:51.315 --rc geninfo_unexecuted_blocks=1 00:20:51.315 00:20:51.315 ' 00:20:51.315 02:03:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:51.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:51.315 --rc genhtml_branch_coverage=1 00:20:51.315 --rc genhtml_function_coverage=1 00:20:51.315 --rc genhtml_legend=1 00:20:51.315 --rc geninfo_all_blocks=1 00:20:51.315 --rc geninfo_unexecuted_blocks=1 00:20:51.315 00:20:51.315 ' 00:20:51.315 02:03:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:51.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:51.315 --rc genhtml_branch_coverage=1 00:20:51.315 --rc genhtml_function_coverage=1 00:20:51.315 --rc genhtml_legend=1 00:20:51.315 --rc geninfo_all_blocks=1 00:20:51.315 --rc geninfo_unexecuted_blocks=1 00:20:51.315 00:20:51.315 ' 00:20:51.315 02:03:25 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:51.315 02:03:25 -- nvmf/common.sh@7 -- # uname -s 00:20:51.315 02:03:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:51.315 02:03:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:51.315 02:03:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:51.315 02:03:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:51.315 02:03:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:51.315 02:03:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:51.315 02:03:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:51.315 02:03:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:51.315 02:03:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:51.315 02:03:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:51.315 02:03:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:51.315 02:03:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:51.315 02:03:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:51.315 02:03:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:51.315 02:03:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:51.315 02:03:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:51.315 02:03:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:51.315 02:03:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:51.315 02:03:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:51.315 02:03:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:51.315 02:03:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:51.315 02:03:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:51.315 02:03:25 -- paths/export.sh@5 -- # export PATH 00:20:51.315 02:03:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:51.315 02:03:25 -- nvmf/common.sh@46 -- # : 0 00:20:51.315 02:03:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:51.315 02:03:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:51.315 02:03:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:51.315 02:03:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:51.315 02:03:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:51.315 02:03:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:51.315 02:03:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:51.315 02:03:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:51.315 02:03:25 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:51.315 02:03:25 -- fips/fips.sh@89 -- # check_openssl_version 00:20:51.315 02:03:25 -- fips/fips.sh@83 -- # local target=3.0.0 00:20:51.315 02:03:25 -- fips/fips.sh@85 -- # openssl version 00:20:51.315 02:03:25 -- fips/fips.sh@85 -- # awk '{print $2}' 00:20:51.315 02:03:25 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:20:51.315 02:03:25 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:20:51.315 02:03:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:51.315 02:03:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:51.315 02:03:25 -- scripts/common.sh@335 -- # IFS=.-: 00:20:51.315 02:03:25 -- scripts/common.sh@335 -- # read -ra ver1 00:20:51.315 02:03:25 -- scripts/common.sh@336 -- # IFS=.-: 00:20:51.315 02:03:25 -- scripts/common.sh@336 -- # read -ra ver2 00:20:51.315 02:03:25 -- scripts/common.sh@337 -- # local 'op=>=' 00:20:51.315 02:03:25 -- scripts/common.sh@339 -- # ver1_l=3 00:20:51.315 02:03:25 -- scripts/common.sh@340 -- # ver2_l=3 00:20:51.315 02:03:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:51.315 02:03:25 -- scripts/common.sh@343 -- # case "$op" in 00:20:51.315 02:03:25 -- scripts/common.sh@347 -- # : 1 00:20:51.315 02:03:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:51.315 02:03:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:51.315 02:03:25 -- scripts/common.sh@364 -- # decimal 3 00:20:51.315 02:03:25 -- scripts/common.sh@352 -- # local d=3 00:20:51.315 02:03:25 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:51.315 02:03:25 -- scripts/common.sh@354 -- # echo 3 00:20:51.315 02:03:25 -- scripts/common.sh@364 -- # ver1[v]=3 00:20:51.315 02:03:25 -- scripts/common.sh@365 -- # decimal 3 00:20:51.315 02:03:25 -- scripts/common.sh@352 -- # local d=3 00:20:51.315 02:03:25 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:51.315 02:03:25 -- scripts/common.sh@354 -- # echo 3 00:20:51.315 02:03:25 -- scripts/common.sh@365 -- # ver2[v]=3 00:20:51.315 02:03:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:51.315 02:03:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:51.315 02:03:25 -- scripts/common.sh@363 -- # (( v++ )) 00:20:51.315 02:03:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:51.315 02:03:25 -- scripts/common.sh@364 -- # decimal 1 00:20:51.315 02:03:25 -- scripts/common.sh@352 -- # local d=1 00:20:51.315 02:03:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:51.315 02:03:25 -- scripts/common.sh@354 -- # echo 1 00:20:51.315 02:03:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:51.315 02:03:25 -- scripts/common.sh@365 -- # decimal 0 00:20:51.316 02:03:25 -- scripts/common.sh@352 -- # local d=0 00:20:51.316 02:03:25 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:51.316 02:03:25 -- scripts/common.sh@354 -- # echo 0 00:20:51.316 02:03:25 -- scripts/common.sh@365 -- # ver2[v]=0 00:20:51.316 02:03:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:51.316 02:03:25 -- scripts/common.sh@366 -- # return 0 00:20:51.316 02:03:25 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:20:51.316 02:03:25 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:20:51.316 02:03:25 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:20:51.316 02:03:25 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:20:51.316 02:03:25 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:20:51.316 02:03:25 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:20:51.316 02:03:25 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:20:51.316 02:03:25 -- fips/fips.sh@113 -- # build_openssl_config 00:20:51.316 02:03:25 -- fips/fips.sh@37 -- # cat 00:20:51.316 02:03:25 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:20:51.316 02:03:25 -- fips/fips.sh@58 -- # cat - 00:20:51.316 02:03:25 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:20:51.316 02:03:25 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:20:51.316 02:03:25 -- fips/fips.sh@116 -- # mapfile -t providers 00:20:51.316 02:03:25 -- fips/fips.sh@116 -- # openssl list -providers 00:20:51.316 02:03:25 -- fips/fips.sh@116 -- # grep name 00:20:51.316 02:03:25 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:20:51.316 02:03:25 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:20:51.316 02:03:25 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:20:51.316 02:03:25 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:20:51.316 02:03:25 -- fips/fips.sh@127 -- # : 00:20:51.316 02:03:25 -- common/autotest_common.sh@650 -- # local es=0 00:20:51.316 02:03:25 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:20:51.316 02:03:25 -- common/autotest_common.sh@638 -- # local arg=openssl 00:20:51.316 02:03:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:51.316 02:03:25 -- common/autotest_common.sh@642 -- # type -t openssl 00:20:51.316 02:03:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:51.316 02:03:25 -- common/autotest_common.sh@644 -- # type -P openssl 00:20:51.316 02:03:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:51.316 02:03:25 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:20:51.316 02:03:25 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:20:51.316 02:03:25 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:20:51.316 Error setting digest 00:20:51.316 40F2AB5A307F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:20:51.316 40F2AB5A307F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:20:51.316 02:03:25 -- common/autotest_common.sh@653 -- # es=1 00:20:51.316 02:03:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:51.316 02:03:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:51.316 02:03:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:51.316 02:03:25 -- fips/fips.sh@130 -- # nvmftestinit 00:20:51.316 02:03:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:51.316 02:03:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:51.316 02:03:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:51.316 02:03:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:51.316 02:03:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:51.316 02:03:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:51.316 02:03:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:51.316 02:03:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:51.316 02:03:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:51.316 02:03:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:51.316 02:03:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:51.316 02:03:25 -- common/autotest_common.sh@10 -- # set +x 00:20:53.848 02:03:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:53.848 02:03:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:53.848 02:03:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:53.848 02:03:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:53.848 02:03:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:53.848 02:03:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:53.848 02:03:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:53.848 02:03:27 -- nvmf/common.sh@294 -- # net_devs=() 00:20:53.848 02:03:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:53.848 02:03:27 -- nvmf/common.sh@295 -- # e810=() 00:20:53.848 02:03:27 -- nvmf/common.sh@295 -- # local -ga e810 00:20:53.848 02:03:27 -- nvmf/common.sh@296 -- # x722=() 00:20:53.848 02:03:27 -- nvmf/common.sh@296 -- # local -ga x722 00:20:53.848 02:03:27 -- nvmf/common.sh@297 -- # mlx=() 00:20:53.848 02:03:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:53.848 02:03:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:53.848 02:03:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:53.848 02:03:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:53.848 02:03:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:53.848 02:03:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:53.848 02:03:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:53.848 02:03:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:53.849 02:03:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:53.849 02:03:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:53.849 02:03:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:53.849 02:03:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:53.849 02:03:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:53.849 02:03:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:53.849 02:03:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:53.849 02:03:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:53.849 02:03:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:53.849 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:53.849 02:03:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:53.849 02:03:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:53.849 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:53.849 02:03:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:53.849 02:03:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:53.849 02:03:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:53.849 02:03:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:53.849 02:03:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:53.849 02:03:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:53.849 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:53.849 02:03:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:53.849 02:03:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:53.849 02:03:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:53.849 02:03:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:53.849 02:03:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:53.849 02:03:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:53.849 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:53.849 02:03:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:53.849 02:03:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:53.849 02:03:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:53.849 02:03:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:53.849 02:03:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:53.849 02:03:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:53.849 02:03:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:53.849 02:03:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:53.849 02:03:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:53.849 02:03:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:53.849 02:03:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:53.849 02:03:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:53.849 02:03:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:53.849 02:03:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:53.849 02:03:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:53.849 02:03:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:53.849 02:03:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:53.849 02:03:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:53.849 02:03:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:53.849 02:03:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:53.849 02:03:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:53.849 02:03:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:53.849 02:03:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:53.849 02:03:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:53.849 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:53.849 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.154 ms 00:20:53.849 00:20:53.849 --- 10.0.0.2 ping statistics --- 00:20:53.849 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:53.849 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:20:53.849 02:03:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:53.849 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:53.849 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:20:53.849 00:20:53.849 --- 10.0.0.1 ping statistics --- 00:20:53.849 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:53.849 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:20:53.849 02:03:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:53.849 02:03:27 -- nvmf/common.sh@410 -- # return 0 00:20:53.849 02:03:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:53.849 02:03:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:53.849 02:03:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:53.849 02:03:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:53.849 02:03:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:53.849 02:03:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:53.849 02:03:27 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:20:53.849 02:03:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:53.849 02:03:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:53.849 02:03:27 -- common/autotest_common.sh@10 -- # set +x 00:20:53.849 02:03:27 -- nvmf/common.sh@469 -- # nvmfpid=1240641 00:20:53.849 02:03:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:53.849 02:03:27 -- nvmf/common.sh@470 -- # waitforlisten 1240641 00:20:53.849 02:03:27 -- common/autotest_common.sh@829 -- # '[' -z 1240641 ']' 00:20:53.849 02:03:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:53.849 02:03:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:53.849 02:03:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:53.849 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:53.849 02:03:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:53.849 02:03:27 -- common/autotest_common.sh@10 -- # set +x 00:20:53.849 [2024-11-18 02:03:28.061540] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:53.849 [2024-11-18 02:03:28.061642] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:53.849 EAL: No free 2048 kB hugepages reported on node 1 00:20:53.849 [2024-11-18 02:03:28.123204] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:53.849 [2024-11-18 02:03:28.204982] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:53.849 [2024-11-18 02:03:28.205132] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:53.849 [2024-11-18 02:03:28.205164] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:53.849 [2024-11-18 02:03:28.205177] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:53.849 [2024-11-18 02:03:28.205205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:54.781 02:03:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:54.781 02:03:29 -- common/autotest_common.sh@862 -- # return 0 00:20:54.781 02:03:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:54.781 02:03:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:54.781 02:03:29 -- common/autotest_common.sh@10 -- # set +x 00:20:54.781 02:03:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:54.781 02:03:29 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:20:54.781 02:03:29 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:20:54.781 02:03:29 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:54.781 02:03:29 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:20:54.781 02:03:29 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:54.781 02:03:29 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:54.781 02:03:29 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:54.782 02:03:29 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:55.039 [2024-11-18 02:03:29.266888] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:55.039 [2024-11-18 02:03:29.282888] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:55.039 [2024-11-18 02:03:29.283118] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:55.039 malloc0 00:20:55.039 02:03:29 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:55.039 02:03:29 -- fips/fips.sh@147 -- # bdevperf_pid=1240800 00:20:55.039 02:03:29 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:55.039 02:03:29 -- fips/fips.sh@148 -- # waitforlisten 1240800 /var/tmp/bdevperf.sock 00:20:55.039 02:03:29 -- common/autotest_common.sh@829 -- # '[' -z 1240800 ']' 00:20:55.039 02:03:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:55.039 02:03:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:55.039 02:03:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:55.039 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:55.039 02:03:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:55.039 02:03:29 -- common/autotest_common.sh@10 -- # set +x 00:20:55.039 [2024-11-18 02:03:29.405698] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:55.039 [2024-11-18 02:03:29.405795] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1240800 ] 00:20:55.039 EAL: No free 2048 kB hugepages reported on node 1 00:20:55.298 [2024-11-18 02:03:29.468337] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:55.298 [2024-11-18 02:03:29.560914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:56.231 02:03:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:56.231 02:03:30 -- common/autotest_common.sh@862 -- # return 0 00:20:56.231 02:03:30 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:56.231 [2024-11-18 02:03:30.577689] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:56.488 TLSTESTn1 00:20:56.488 02:03:30 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:56.488 Running I/O for 10 seconds... 00:21:06.459 00:21:06.459 Latency(us) 00:21:06.459 [2024-11-18T01:03:40.861Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:06.459 [2024-11-18T01:03:40.861Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:06.459 Verification LBA range: start 0x0 length 0x2000 00:21:06.459 TLSTESTn1 : 10.02 4286.80 16.75 0.00 0.00 29816.79 5170.06 52040.44 00:21:06.459 [2024-11-18T01:03:40.861Z] =================================================================================================================== 00:21:06.459 [2024-11-18T01:03:40.861Z] Total : 4286.80 16.75 0.00 0.00 29816.79 5170.06 52040.44 00:21:06.459 0 00:21:06.459 02:03:40 -- fips/fips.sh@1 -- # cleanup 00:21:06.459 02:03:40 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:06.459 02:03:40 -- common/autotest_common.sh@806 -- # type=--id 00:21:06.459 02:03:40 -- common/autotest_common.sh@807 -- # id=0 00:21:06.459 02:03:40 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:06.459 02:03:40 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:06.459 02:03:40 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:06.459 02:03:40 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:06.459 02:03:40 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:06.459 02:03:40 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:06.459 nvmf_trace.0 00:21:06.717 02:03:40 -- common/autotest_common.sh@821 -- # return 0 00:21:06.717 02:03:40 -- fips/fips.sh@16 -- # killprocess 1240800 00:21:06.717 02:03:40 -- common/autotest_common.sh@936 -- # '[' -z 1240800 ']' 00:21:06.718 02:03:40 -- common/autotest_common.sh@940 -- # kill -0 1240800 00:21:06.718 02:03:40 -- common/autotest_common.sh@941 -- # uname 00:21:06.718 02:03:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:06.718 02:03:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1240800 00:21:06.718 02:03:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:06.718 02:03:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:06.718 02:03:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1240800' 00:21:06.718 killing process with pid 1240800 00:21:06.718 02:03:40 -- common/autotest_common.sh@955 -- # kill 1240800 00:21:06.718 Received shutdown signal, test time was about 10.000000 seconds 00:21:06.718 00:21:06.718 Latency(us) 00:21:06.718 [2024-11-18T01:03:41.120Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:06.718 [2024-11-18T01:03:41.120Z] =================================================================================================================== 00:21:06.718 [2024-11-18T01:03:41.120Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:06.718 02:03:40 -- common/autotest_common.sh@960 -- # wait 1240800 00:21:06.975 02:03:41 -- fips/fips.sh@17 -- # nvmftestfini 00:21:06.975 02:03:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:06.975 02:03:41 -- nvmf/common.sh@116 -- # sync 00:21:06.975 02:03:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:06.975 02:03:41 -- nvmf/common.sh@119 -- # set +e 00:21:06.975 02:03:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:06.975 02:03:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:06.975 rmmod nvme_tcp 00:21:06.975 rmmod nvme_fabrics 00:21:06.975 rmmod nvme_keyring 00:21:06.975 02:03:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:06.975 02:03:41 -- nvmf/common.sh@123 -- # set -e 00:21:06.975 02:03:41 -- nvmf/common.sh@124 -- # return 0 00:21:06.975 02:03:41 -- nvmf/common.sh@477 -- # '[' -n 1240641 ']' 00:21:06.975 02:03:41 -- nvmf/common.sh@478 -- # killprocess 1240641 00:21:06.975 02:03:41 -- common/autotest_common.sh@936 -- # '[' -z 1240641 ']' 00:21:06.975 02:03:41 -- common/autotest_common.sh@940 -- # kill -0 1240641 00:21:06.975 02:03:41 -- common/autotest_common.sh@941 -- # uname 00:21:06.975 02:03:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:06.975 02:03:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1240641 00:21:06.975 02:03:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:06.975 02:03:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:06.975 02:03:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1240641' 00:21:06.975 killing process with pid 1240641 00:21:06.975 02:03:41 -- common/autotest_common.sh@955 -- # kill 1240641 00:21:06.975 02:03:41 -- common/autotest_common.sh@960 -- # wait 1240641 00:21:07.234 02:03:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:07.234 02:03:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:07.234 02:03:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:07.234 02:03:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:07.234 02:03:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:07.234 02:03:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:07.234 02:03:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:07.234 02:03:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:09.142 02:03:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:09.142 02:03:43 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:09.142 00:21:09.142 real 0m18.131s 00:21:09.142 user 0m23.441s 00:21:09.142 sys 0m5.788s 00:21:09.142 02:03:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:09.142 02:03:43 -- common/autotest_common.sh@10 -- # set +x 00:21:09.142 ************************************ 00:21:09.142 END TEST nvmf_fips 00:21:09.142 ************************************ 00:21:09.142 02:03:43 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:09.142 02:03:43 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:09.142 02:03:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:09.142 02:03:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:09.142 02:03:43 -- common/autotest_common.sh@10 -- # set +x 00:21:09.428 ************************************ 00:21:09.428 START TEST nvmf_fuzz 00:21:09.428 ************************************ 00:21:09.428 02:03:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:09.428 * Looking for test storage... 00:21:09.428 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:09.428 02:03:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:09.428 02:03:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:09.428 02:03:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:09.428 02:03:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:09.428 02:03:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:09.428 02:03:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:09.428 02:03:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:09.428 02:03:43 -- scripts/common.sh@335 -- # IFS=.-: 00:21:09.428 02:03:43 -- scripts/common.sh@335 -- # read -ra ver1 00:21:09.428 02:03:43 -- scripts/common.sh@336 -- # IFS=.-: 00:21:09.428 02:03:43 -- scripts/common.sh@336 -- # read -ra ver2 00:21:09.428 02:03:43 -- scripts/common.sh@337 -- # local 'op=<' 00:21:09.428 02:03:43 -- scripts/common.sh@339 -- # ver1_l=2 00:21:09.428 02:03:43 -- scripts/common.sh@340 -- # ver2_l=1 00:21:09.428 02:03:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:09.428 02:03:43 -- scripts/common.sh@343 -- # case "$op" in 00:21:09.428 02:03:43 -- scripts/common.sh@344 -- # : 1 00:21:09.428 02:03:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:09.428 02:03:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:09.428 02:03:43 -- scripts/common.sh@364 -- # decimal 1 00:21:09.428 02:03:43 -- scripts/common.sh@352 -- # local d=1 00:21:09.428 02:03:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:09.428 02:03:43 -- scripts/common.sh@354 -- # echo 1 00:21:09.428 02:03:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:09.428 02:03:43 -- scripts/common.sh@365 -- # decimal 2 00:21:09.428 02:03:43 -- scripts/common.sh@352 -- # local d=2 00:21:09.428 02:03:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:09.428 02:03:43 -- scripts/common.sh@354 -- # echo 2 00:21:09.428 02:03:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:09.428 02:03:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:09.428 02:03:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:09.428 02:03:43 -- scripts/common.sh@367 -- # return 0 00:21:09.428 02:03:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:09.428 02:03:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:09.428 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:09.428 --rc genhtml_branch_coverage=1 00:21:09.428 --rc genhtml_function_coverage=1 00:21:09.428 --rc genhtml_legend=1 00:21:09.428 --rc geninfo_all_blocks=1 00:21:09.428 --rc geninfo_unexecuted_blocks=1 00:21:09.428 00:21:09.428 ' 00:21:09.428 02:03:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:09.428 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:09.428 --rc genhtml_branch_coverage=1 00:21:09.428 --rc genhtml_function_coverage=1 00:21:09.428 --rc genhtml_legend=1 00:21:09.428 --rc geninfo_all_blocks=1 00:21:09.428 --rc geninfo_unexecuted_blocks=1 00:21:09.428 00:21:09.428 ' 00:21:09.428 02:03:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:09.428 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:09.428 --rc genhtml_branch_coverage=1 00:21:09.428 --rc genhtml_function_coverage=1 00:21:09.428 --rc genhtml_legend=1 00:21:09.428 --rc geninfo_all_blocks=1 00:21:09.428 --rc geninfo_unexecuted_blocks=1 00:21:09.428 00:21:09.428 ' 00:21:09.428 02:03:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:09.428 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:09.428 --rc genhtml_branch_coverage=1 00:21:09.428 --rc genhtml_function_coverage=1 00:21:09.428 --rc genhtml_legend=1 00:21:09.428 --rc geninfo_all_blocks=1 00:21:09.428 --rc geninfo_unexecuted_blocks=1 00:21:09.428 00:21:09.428 ' 00:21:09.428 02:03:43 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:09.428 02:03:43 -- nvmf/common.sh@7 -- # uname -s 00:21:09.428 02:03:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:09.428 02:03:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:09.428 02:03:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:09.428 02:03:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:09.428 02:03:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:09.428 02:03:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:09.428 02:03:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:09.428 02:03:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:09.428 02:03:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:09.428 02:03:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:09.428 02:03:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:09.428 02:03:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:09.428 02:03:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:09.428 02:03:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:09.428 02:03:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:09.428 02:03:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:09.428 02:03:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:09.428 02:03:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:09.428 02:03:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:09.428 02:03:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:09.428 02:03:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:09.428 02:03:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:09.428 02:03:43 -- paths/export.sh@5 -- # export PATH 00:21:09.428 02:03:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:09.428 02:03:43 -- nvmf/common.sh@46 -- # : 0 00:21:09.428 02:03:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:09.428 02:03:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:09.428 02:03:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:09.428 02:03:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:09.428 02:03:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:09.428 02:03:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:09.428 02:03:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:09.428 02:03:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:09.428 02:03:43 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:09.429 02:03:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:09.429 02:03:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:09.429 02:03:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:09.429 02:03:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:09.429 02:03:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:09.429 02:03:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:09.429 02:03:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:09.429 02:03:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:09.429 02:03:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:09.429 02:03:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:09.429 02:03:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:09.429 02:03:43 -- common/autotest_common.sh@10 -- # set +x 00:21:11.345 02:03:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:11.345 02:03:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:11.345 02:03:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:11.345 02:03:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:11.345 02:03:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:11.345 02:03:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:11.345 02:03:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:11.345 02:03:45 -- nvmf/common.sh@294 -- # net_devs=() 00:21:11.345 02:03:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:11.345 02:03:45 -- nvmf/common.sh@295 -- # e810=() 00:21:11.345 02:03:45 -- nvmf/common.sh@295 -- # local -ga e810 00:21:11.345 02:03:45 -- nvmf/common.sh@296 -- # x722=() 00:21:11.345 02:03:45 -- nvmf/common.sh@296 -- # local -ga x722 00:21:11.345 02:03:45 -- nvmf/common.sh@297 -- # mlx=() 00:21:11.345 02:03:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:11.345 02:03:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:11.345 02:03:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:11.345 02:03:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:11.345 02:03:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:11.345 02:03:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:11.345 02:03:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:11.345 02:03:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:11.345 02:03:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:11.345 02:03:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:11.345 02:03:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:11.345 02:03:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:11.345 02:03:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:11.345 02:03:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:11.345 02:03:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:11.345 02:03:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:11.345 02:03:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:11.345 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:11.345 02:03:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:11.345 02:03:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:11.345 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:11.345 02:03:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:11.345 02:03:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:11.345 02:03:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:11.345 02:03:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:11.345 02:03:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:11.345 02:03:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:11.345 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:11.345 02:03:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:11.345 02:03:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:11.345 02:03:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:11.345 02:03:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:11.345 02:03:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:11.345 02:03:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:11.345 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:11.345 02:03:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:11.345 02:03:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:11.345 02:03:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:11.345 02:03:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:11.345 02:03:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:11.345 02:03:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:11.345 02:03:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:11.345 02:03:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:11.345 02:03:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:11.345 02:03:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:11.345 02:03:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:11.345 02:03:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:11.345 02:03:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:11.345 02:03:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:11.345 02:03:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:11.345 02:03:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:11.345 02:03:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:11.345 02:03:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:11.345 02:03:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:11.345 02:03:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:11.606 02:03:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:11.606 02:03:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:11.606 02:03:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:11.606 02:03:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:11.606 02:03:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:11.606 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:11.606 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:21:11.606 00:21:11.606 --- 10.0.0.2 ping statistics --- 00:21:11.606 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:11.606 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:21:11.606 02:03:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:11.606 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:11.606 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:21:11.606 00:21:11.606 --- 10.0.0.1 ping statistics --- 00:21:11.606 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:11.606 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:21:11.606 02:03:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:11.606 02:03:45 -- nvmf/common.sh@410 -- # return 0 00:21:11.606 02:03:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:11.606 02:03:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:11.606 02:03:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:11.606 02:03:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:11.606 02:03:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:11.606 02:03:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:11.606 02:03:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:11.606 02:03:45 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=1244242 00:21:11.606 02:03:45 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:11.606 02:03:45 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:11.606 02:03:45 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 1244242 00:21:11.606 02:03:45 -- common/autotest_common.sh@829 -- # '[' -z 1244242 ']' 00:21:11.606 02:03:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:11.606 02:03:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:11.606 02:03:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:11.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:11.606 02:03:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:11.606 02:03:45 -- common/autotest_common.sh@10 -- # set +x 00:21:12.985 02:03:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:12.985 02:03:47 -- common/autotest_common.sh@862 -- # return 0 00:21:12.985 02:03:47 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:12.985 02:03:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:12.985 02:03:47 -- common/autotest_common.sh@10 -- # set +x 00:21:12.985 02:03:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:12.985 02:03:47 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:12.985 02:03:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:12.985 02:03:47 -- common/autotest_common.sh@10 -- # set +x 00:21:12.985 Malloc0 00:21:12.985 02:03:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:12.985 02:03:47 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:12.985 02:03:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:12.985 02:03:47 -- common/autotest_common.sh@10 -- # set +x 00:21:12.985 02:03:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:12.985 02:03:47 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:12.985 02:03:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:12.985 02:03:47 -- common/autotest_common.sh@10 -- # set +x 00:21:12.985 02:03:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:12.985 02:03:47 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:12.985 02:03:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:12.985 02:03:47 -- common/autotest_common.sh@10 -- # set +x 00:21:12.985 02:03:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:12.985 02:03:47 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:12.985 02:03:47 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:21:45.095 Fuzzing completed. Shutting down the fuzz application 00:21:45.095 00:21:45.095 Dumping successful admin opcodes: 00:21:45.095 8, 9, 10, 24, 00:21:45.095 Dumping successful io opcodes: 00:21:45.095 0, 9, 00:21:45.095 NS: 0x200003aeff00 I/O qp, Total commands completed: 468508, total successful commands: 2702, random_seed: 2622722368 00:21:45.095 NS: 0x200003aeff00 admin qp, Total commands completed: 56160, total successful commands: 447, random_seed: 1878343744 00:21:45.095 02:04:17 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:21:45.095 Fuzzing completed. Shutting down the fuzz application 00:21:45.095 00:21:45.095 Dumping successful admin opcodes: 00:21:45.095 24, 00:21:45.095 Dumping successful io opcodes: 00:21:45.095 00:21:45.095 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3614852457 00:21:45.095 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3614990281 00:21:45.095 02:04:19 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:45.095 02:04:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.095 02:04:19 -- common/autotest_common.sh@10 -- # set +x 00:21:45.095 02:04:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.095 02:04:19 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:21:45.095 02:04:19 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:21:45.095 02:04:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:45.095 02:04:19 -- nvmf/common.sh@116 -- # sync 00:21:45.095 02:04:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:45.095 02:04:19 -- nvmf/common.sh@119 -- # set +e 00:21:45.095 02:04:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:45.095 02:04:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:45.095 rmmod nvme_tcp 00:21:45.095 rmmod nvme_fabrics 00:21:45.095 rmmod nvme_keyring 00:21:45.095 02:04:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:45.095 02:04:19 -- nvmf/common.sh@123 -- # set -e 00:21:45.095 02:04:19 -- nvmf/common.sh@124 -- # return 0 00:21:45.095 02:04:19 -- nvmf/common.sh@477 -- # '[' -n 1244242 ']' 00:21:45.095 02:04:19 -- nvmf/common.sh@478 -- # killprocess 1244242 00:21:45.095 02:04:19 -- common/autotest_common.sh@936 -- # '[' -z 1244242 ']' 00:21:45.095 02:04:19 -- common/autotest_common.sh@940 -- # kill -0 1244242 00:21:45.095 02:04:19 -- common/autotest_common.sh@941 -- # uname 00:21:45.095 02:04:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:45.095 02:04:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1244242 00:21:45.095 02:04:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:45.095 02:04:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:45.095 02:04:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1244242' 00:21:45.095 killing process with pid 1244242 00:21:45.095 02:04:19 -- common/autotest_common.sh@955 -- # kill 1244242 00:21:45.095 02:04:19 -- common/autotest_common.sh@960 -- # wait 1244242 00:21:45.095 02:04:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:45.095 02:04:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:45.095 02:04:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:45.095 02:04:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:45.095 02:04:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:45.095 02:04:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:45.095 02:04:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:45.095 02:04:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:47.637 02:04:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:47.637 02:04:21 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:21:47.637 00:21:47.637 real 0m38.006s 00:21:47.637 user 0m52.498s 00:21:47.637 sys 0m14.674s 00:21:47.637 02:04:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:47.637 02:04:21 -- common/autotest_common.sh@10 -- # set +x 00:21:47.637 ************************************ 00:21:47.637 END TEST nvmf_fuzz 00:21:47.637 ************************************ 00:21:47.637 02:04:21 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:47.637 02:04:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:47.637 02:04:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:47.637 02:04:21 -- common/autotest_common.sh@10 -- # set +x 00:21:47.637 ************************************ 00:21:47.637 START TEST nvmf_multiconnection 00:21:47.637 ************************************ 00:21:47.637 02:04:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:47.637 * Looking for test storage... 00:21:47.637 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:47.637 02:04:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:47.637 02:04:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:47.637 02:04:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:47.637 02:04:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:47.637 02:04:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:47.637 02:04:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:47.637 02:04:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:47.637 02:04:21 -- scripts/common.sh@335 -- # IFS=.-: 00:21:47.637 02:04:21 -- scripts/common.sh@335 -- # read -ra ver1 00:21:47.637 02:04:21 -- scripts/common.sh@336 -- # IFS=.-: 00:21:47.637 02:04:21 -- scripts/common.sh@336 -- # read -ra ver2 00:21:47.637 02:04:21 -- scripts/common.sh@337 -- # local 'op=<' 00:21:47.637 02:04:21 -- scripts/common.sh@339 -- # ver1_l=2 00:21:47.637 02:04:21 -- scripts/common.sh@340 -- # ver2_l=1 00:21:47.637 02:04:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:47.637 02:04:21 -- scripts/common.sh@343 -- # case "$op" in 00:21:47.637 02:04:21 -- scripts/common.sh@344 -- # : 1 00:21:47.637 02:04:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:47.637 02:04:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:47.637 02:04:21 -- scripts/common.sh@364 -- # decimal 1 00:21:47.637 02:04:21 -- scripts/common.sh@352 -- # local d=1 00:21:47.637 02:04:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:47.637 02:04:21 -- scripts/common.sh@354 -- # echo 1 00:21:47.637 02:04:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:47.637 02:04:21 -- scripts/common.sh@365 -- # decimal 2 00:21:47.637 02:04:21 -- scripts/common.sh@352 -- # local d=2 00:21:47.637 02:04:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:47.637 02:04:21 -- scripts/common.sh@354 -- # echo 2 00:21:47.637 02:04:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:47.637 02:04:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:47.637 02:04:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:47.637 02:04:21 -- scripts/common.sh@367 -- # return 0 00:21:47.637 02:04:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:47.637 02:04:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:47.637 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:47.637 --rc genhtml_branch_coverage=1 00:21:47.637 --rc genhtml_function_coverage=1 00:21:47.637 --rc genhtml_legend=1 00:21:47.638 --rc geninfo_all_blocks=1 00:21:47.638 --rc geninfo_unexecuted_blocks=1 00:21:47.638 00:21:47.638 ' 00:21:47.638 02:04:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:47.638 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:47.638 --rc genhtml_branch_coverage=1 00:21:47.638 --rc genhtml_function_coverage=1 00:21:47.638 --rc genhtml_legend=1 00:21:47.638 --rc geninfo_all_blocks=1 00:21:47.638 --rc geninfo_unexecuted_blocks=1 00:21:47.638 00:21:47.638 ' 00:21:47.638 02:04:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:47.638 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:47.638 --rc genhtml_branch_coverage=1 00:21:47.638 --rc genhtml_function_coverage=1 00:21:47.638 --rc genhtml_legend=1 00:21:47.638 --rc geninfo_all_blocks=1 00:21:47.638 --rc geninfo_unexecuted_blocks=1 00:21:47.638 00:21:47.638 ' 00:21:47.638 02:04:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:47.638 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:47.638 --rc genhtml_branch_coverage=1 00:21:47.638 --rc genhtml_function_coverage=1 00:21:47.638 --rc genhtml_legend=1 00:21:47.638 --rc geninfo_all_blocks=1 00:21:47.638 --rc geninfo_unexecuted_blocks=1 00:21:47.638 00:21:47.638 ' 00:21:47.638 02:04:21 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:47.638 02:04:21 -- nvmf/common.sh@7 -- # uname -s 00:21:47.638 02:04:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:47.638 02:04:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:47.638 02:04:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:47.638 02:04:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:47.638 02:04:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:47.638 02:04:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:47.638 02:04:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:47.638 02:04:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:47.638 02:04:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:47.638 02:04:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:47.638 02:04:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:47.638 02:04:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:47.638 02:04:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:47.638 02:04:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:47.638 02:04:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:47.638 02:04:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:47.638 02:04:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:47.638 02:04:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:47.638 02:04:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:47.638 02:04:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:47.638 02:04:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:47.638 02:04:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:47.638 02:04:21 -- paths/export.sh@5 -- # export PATH 00:21:47.638 02:04:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:47.638 02:04:21 -- nvmf/common.sh@46 -- # : 0 00:21:47.638 02:04:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:47.638 02:04:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:47.638 02:04:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:47.638 02:04:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:47.638 02:04:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:47.638 02:04:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:47.638 02:04:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:47.638 02:04:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:47.638 02:04:21 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:47.638 02:04:21 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:47.638 02:04:21 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:21:47.638 02:04:21 -- target/multiconnection.sh@16 -- # nvmftestinit 00:21:47.638 02:04:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:47.638 02:04:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:47.638 02:04:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:47.638 02:04:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:47.638 02:04:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:47.638 02:04:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:47.638 02:04:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:47.638 02:04:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:47.638 02:04:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:47.638 02:04:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:47.638 02:04:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:47.638 02:04:21 -- common/autotest_common.sh@10 -- # set +x 00:21:49.542 02:04:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:49.542 02:04:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:49.542 02:04:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:49.542 02:04:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:49.542 02:04:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:49.542 02:04:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:49.542 02:04:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:49.542 02:04:23 -- nvmf/common.sh@294 -- # net_devs=() 00:21:49.542 02:04:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:49.542 02:04:23 -- nvmf/common.sh@295 -- # e810=() 00:21:49.542 02:04:23 -- nvmf/common.sh@295 -- # local -ga e810 00:21:49.542 02:04:23 -- nvmf/common.sh@296 -- # x722=() 00:21:49.542 02:04:23 -- nvmf/common.sh@296 -- # local -ga x722 00:21:49.542 02:04:23 -- nvmf/common.sh@297 -- # mlx=() 00:21:49.542 02:04:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:49.542 02:04:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:49.542 02:04:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:49.542 02:04:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:49.542 02:04:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:49.542 02:04:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:49.542 02:04:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:49.542 02:04:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:49.542 02:04:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:49.542 02:04:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:49.542 02:04:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:49.542 02:04:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:49.542 02:04:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:49.542 02:04:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:49.542 02:04:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:49.542 02:04:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:49.542 02:04:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:49.542 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:49.542 02:04:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:49.542 02:04:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:49.542 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:49.542 02:04:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:49.542 02:04:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:49.542 02:04:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:49.542 02:04:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:49.542 02:04:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:49.542 02:04:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:49.542 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:49.542 02:04:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:49.542 02:04:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:49.542 02:04:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:49.542 02:04:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:49.542 02:04:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:49.542 02:04:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:49.542 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:49.542 02:04:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:49.542 02:04:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:49.542 02:04:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:49.542 02:04:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:49.542 02:04:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:49.542 02:04:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:49.542 02:04:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:49.542 02:04:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:49.542 02:04:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:49.542 02:04:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:49.542 02:04:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:49.542 02:04:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:49.542 02:04:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:49.542 02:04:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:49.542 02:04:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:49.542 02:04:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:49.542 02:04:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:49.542 02:04:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:49.542 02:04:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:49.542 02:04:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:49.542 02:04:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:49.542 02:04:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:49.801 02:04:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:49.801 02:04:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:49.801 02:04:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:49.801 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:49.801 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.168 ms 00:21:49.801 00:21:49.801 --- 10.0.0.2 ping statistics --- 00:21:49.801 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:49.801 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:21:49.801 02:04:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:49.801 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:49.801 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:21:49.801 00:21:49.801 --- 10.0.0.1 ping statistics --- 00:21:49.801 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:49.801 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:21:49.801 02:04:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:49.801 02:04:23 -- nvmf/common.sh@410 -- # return 0 00:21:49.801 02:04:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:49.801 02:04:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:49.801 02:04:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:49.801 02:04:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:49.801 02:04:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:49.801 02:04:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:49.801 02:04:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:49.801 02:04:23 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:21:49.801 02:04:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:49.801 02:04:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:49.801 02:04:23 -- common/autotest_common.sh@10 -- # set +x 00:21:49.801 02:04:23 -- nvmf/common.sh@469 -- # nvmfpid=1250119 00:21:49.801 02:04:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:49.801 02:04:23 -- nvmf/common.sh@470 -- # waitforlisten 1250119 00:21:49.801 02:04:23 -- common/autotest_common.sh@829 -- # '[' -z 1250119 ']' 00:21:49.801 02:04:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:49.801 02:04:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:49.801 02:04:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:49.801 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:49.801 02:04:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:49.801 02:04:23 -- common/autotest_common.sh@10 -- # set +x 00:21:49.801 [2024-11-18 02:04:24.037997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:49.802 [2024-11-18 02:04:24.038086] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:49.802 EAL: No free 2048 kB hugepages reported on node 1 00:21:49.802 [2024-11-18 02:04:24.102748] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:49.802 [2024-11-18 02:04:24.188493] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:49.802 [2024-11-18 02:04:24.188650] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:49.802 [2024-11-18 02:04:24.188666] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:49.802 [2024-11-18 02:04:24.188677] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:49.802 [2024-11-18 02:04:24.188736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:49.802 [2024-11-18 02:04:24.188798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:49.802 [2024-11-18 02:04:24.188865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:49.802 [2024-11-18 02:04:24.188867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:50.738 02:04:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:50.738 02:04:25 -- common/autotest_common.sh@862 -- # return 0 00:21:50.738 02:04:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:50.738 02:04:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:50.738 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.738 02:04:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:50.738 02:04:25 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:50.738 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.738 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.738 [2024-11-18 02:04:25.089327] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:50.738 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.738 02:04:25 -- target/multiconnection.sh@21 -- # seq 1 11 00:21:50.738 02:04:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:50.738 02:04:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:50.738 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.738 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.738 Malloc1 00:21:50.738 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.738 02:04:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:21:50.738 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.738 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.738 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.738 02:04:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:50.738 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.738 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 [2024-11-18 02:04:25.146911] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:50.999 02:04:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 Malloc2 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:50.999 02:04:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 Malloc3 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:50.999 02:04:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 Malloc4 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:50.999 02:04:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 Malloc5 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:50.999 02:04:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:21:50.999 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.999 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:50.999 Malloc6 00:21:50.999 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.999 02:04:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:21:51.000 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.000 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.000 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.000 02:04:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:21:51.000 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.000 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.000 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.000 02:04:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:21:51.000 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.000 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.000 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.000 02:04:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.000 02:04:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:21:51.000 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.000 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 Malloc7 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.259 02:04:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 Malloc8 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.259 02:04:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 Malloc9 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.259 02:04:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 Malloc10 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.259 02:04:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 Malloc11 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:21:51.259 02:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.259 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:21:51.259 02:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.259 02:04:25 -- target/multiconnection.sh@28 -- # seq 1 11 00:21:51.259 02:04:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.259 02:04:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:21:52.195 02:04:26 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:21:52.195 02:04:26 -- common/autotest_common.sh@1187 -- # local i=0 00:21:52.195 02:04:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:52.195 02:04:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:52.195 02:04:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:54.102 02:04:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:54.102 02:04:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:54.102 02:04:28 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:21:54.102 02:04:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:54.102 02:04:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:54.102 02:04:28 -- common/autotest_common.sh@1197 -- # return 0 00:21:54.102 02:04:28 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:54.102 02:04:28 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:21:54.671 02:04:29 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:21:54.671 02:04:29 -- common/autotest_common.sh@1187 -- # local i=0 00:21:54.671 02:04:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:54.671 02:04:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:54.671 02:04:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:57.209 02:04:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:57.209 02:04:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:57.209 02:04:31 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:21:57.209 02:04:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:57.209 02:04:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:57.209 02:04:31 -- common/autotest_common.sh@1197 -- # return 0 00:21:57.209 02:04:31 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.209 02:04:31 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:21:57.469 02:04:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:21:57.469 02:04:31 -- common/autotest_common.sh@1187 -- # local i=0 00:21:57.469 02:04:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:57.469 02:04:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:57.469 02:04:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:59.372 02:04:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:59.372 02:04:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:59.372 02:04:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:21:59.372 02:04:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:59.372 02:04:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:59.372 02:04:33 -- common/autotest_common.sh@1197 -- # return 0 00:21:59.372 02:04:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.372 02:04:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:00.309 02:04:34 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:00.309 02:04:34 -- common/autotest_common.sh@1187 -- # local i=0 00:22:00.309 02:04:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:00.309 02:04:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:00.309 02:04:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:02.218 02:04:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:02.218 02:04:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:02.218 02:04:36 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:02.218 02:04:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:02.218 02:04:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:02.218 02:04:36 -- common/autotest_common.sh@1197 -- # return 0 00:22:02.218 02:04:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:02.218 02:04:36 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:02.788 02:04:37 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:02.788 02:04:37 -- common/autotest_common.sh@1187 -- # local i=0 00:22:02.788 02:04:37 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:02.788 02:04:37 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:02.788 02:04:37 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:05.327 02:04:39 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:05.327 02:04:39 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:05.327 02:04:39 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:05.327 02:04:39 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:05.327 02:04:39 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:05.327 02:04:39 -- common/autotest_common.sh@1197 -- # return 0 00:22:05.327 02:04:39 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:05.327 02:04:39 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:05.585 02:04:39 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:05.585 02:04:39 -- common/autotest_common.sh@1187 -- # local i=0 00:22:05.585 02:04:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:05.585 02:04:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:05.585 02:04:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:08.119 02:04:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:08.119 02:04:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:08.119 02:04:41 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:08.119 02:04:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:08.119 02:04:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:08.119 02:04:41 -- common/autotest_common.sh@1197 -- # return 0 00:22:08.119 02:04:41 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:08.119 02:04:41 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:08.378 02:04:42 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:08.378 02:04:42 -- common/autotest_common.sh@1187 -- # local i=0 00:22:08.378 02:04:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:08.378 02:04:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:08.378 02:04:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:10.912 02:04:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:10.912 02:04:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:10.912 02:04:44 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:10.912 02:04:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:10.913 02:04:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:10.913 02:04:44 -- common/autotest_common.sh@1197 -- # return 0 00:22:10.913 02:04:44 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:10.913 02:04:44 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:11.171 02:04:45 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:11.171 02:04:45 -- common/autotest_common.sh@1187 -- # local i=0 00:22:11.171 02:04:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:11.171 02:04:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:11.171 02:04:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:13.760 02:04:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:13.760 02:04:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:13.760 02:04:47 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:13.760 02:04:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:13.760 02:04:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:13.760 02:04:47 -- common/autotest_common.sh@1197 -- # return 0 00:22:13.760 02:04:47 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.760 02:04:47 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:14.020 02:04:48 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:14.020 02:04:48 -- common/autotest_common.sh@1187 -- # local i=0 00:22:14.020 02:04:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:14.020 02:04:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:14.020 02:04:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:15.995 02:04:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:15.995 02:04:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:15.995 02:04:50 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:15.995 02:04:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:15.995 02:04:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:15.995 02:04:50 -- common/autotest_common.sh@1197 -- # return 0 00:22:15.995 02:04:50 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:15.995 02:04:50 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:16.931 02:04:51 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:16.931 02:04:51 -- common/autotest_common.sh@1187 -- # local i=0 00:22:16.931 02:04:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:16.931 02:04:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:16.931 02:04:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:18.836 02:04:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:19.096 02:04:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:19.096 02:04:53 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:19.096 02:04:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:19.096 02:04:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:19.096 02:04:53 -- common/autotest_common.sh@1197 -- # return 0 00:22:19.096 02:04:53 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.096 02:04:53 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:20.033 02:04:54 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:20.033 02:04:54 -- common/autotest_common.sh@1187 -- # local i=0 00:22:20.033 02:04:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:20.033 02:04:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:20.033 02:04:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:21.937 02:04:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:21.937 02:04:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:21.937 02:04:56 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:22:21.937 02:04:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:21.937 02:04:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:21.937 02:04:56 -- common/autotest_common.sh@1197 -- # return 0 00:22:21.937 02:04:56 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:21.937 [global] 00:22:21.937 thread=1 00:22:21.937 invalidate=1 00:22:21.937 rw=read 00:22:21.937 time_based=1 00:22:21.937 runtime=10 00:22:21.937 ioengine=libaio 00:22:21.937 direct=1 00:22:21.937 bs=262144 00:22:21.937 iodepth=64 00:22:21.937 norandommap=1 00:22:21.937 numjobs=1 00:22:21.937 00:22:21.937 [job0] 00:22:21.937 filename=/dev/nvme0n1 00:22:21.937 [job1] 00:22:21.937 filename=/dev/nvme10n1 00:22:21.937 [job2] 00:22:21.937 filename=/dev/nvme1n1 00:22:21.937 [job3] 00:22:21.937 filename=/dev/nvme2n1 00:22:21.937 [job4] 00:22:21.937 filename=/dev/nvme3n1 00:22:21.937 [job5] 00:22:21.937 filename=/dev/nvme4n1 00:22:21.937 [job6] 00:22:21.937 filename=/dev/nvme5n1 00:22:21.937 [job7] 00:22:21.937 filename=/dev/nvme6n1 00:22:21.937 [job8] 00:22:21.937 filename=/dev/nvme7n1 00:22:21.937 [job9] 00:22:21.937 filename=/dev/nvme8n1 00:22:21.937 [job10] 00:22:21.937 filename=/dev/nvme9n1 00:22:21.937 Could not set queue depth (nvme0n1) 00:22:21.937 Could not set queue depth (nvme10n1) 00:22:21.937 Could not set queue depth (nvme1n1) 00:22:21.937 Could not set queue depth (nvme2n1) 00:22:21.937 Could not set queue depth (nvme3n1) 00:22:21.937 Could not set queue depth (nvme4n1) 00:22:21.937 Could not set queue depth (nvme5n1) 00:22:21.937 Could not set queue depth (nvme6n1) 00:22:21.937 Could not set queue depth (nvme7n1) 00:22:21.937 Could not set queue depth (nvme8n1) 00:22:21.937 Could not set queue depth (nvme9n1) 00:22:22.213 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:22.213 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:22.213 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:22.213 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:22.213 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:22.213 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:22.213 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:22.213 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:22.213 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:22.213 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:22.213 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:22.213 fio-3.35 00:22:22.213 Starting 11 threads 00:22:34.419 00:22:34.419 job0: (groupid=0, jobs=1): err= 0: pid=1254630: Mon Nov 18 02:05:06 2024 00:22:34.419 read: IOPS=707, BW=177MiB/s (185MB/s)(1792MiB/10129msec) 00:22:34.419 slat (usec): min=9, max=95319, avg=1119.80, stdev=3929.61 00:22:34.419 clat (msec): min=2, max=301, avg=89.26, stdev=35.27 00:22:34.419 lat (msec): min=2, max=301, avg=90.38, stdev=35.89 00:22:34.419 clat percentiles (msec): 00:22:34.419 | 1.00th=[ 15], 5.00th=[ 39], 10.00th=[ 51], 20.00th=[ 64], 00:22:34.419 | 30.00th=[ 74], 40.00th=[ 81], 50.00th=[ 86], 60.00th=[ 91], 00:22:34.419 | 70.00th=[ 101], 80.00th=[ 112], 90.00th=[ 131], 95.00th=[ 153], 00:22:34.419 | 99.00th=[ 211], 99.50th=[ 215], 99.90th=[ 262], 99.95th=[ 271], 00:22:34.419 | 99.99th=[ 300] 00:22:34.419 bw ( KiB/s): min=92160, max=264192, per=9.35%, avg=181811.20, stdev=44790.92, samples=20 00:22:34.419 iops : min= 360, max= 1032, avg=710.20, stdev=174.96, samples=20 00:22:34.419 lat (msec) : 4=0.06%, 10=0.52%, 20=1.00%, 50=8.01%, 100=59.91% 00:22:34.419 lat (msec) : 250=30.31%, 500=0.20% 00:22:34.419 cpu : usr=0.38%, sys=2.04%, ctx=1329, majf=0, minf=4097 00:22:34.419 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:22:34.419 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:34.419 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:34.419 issued rwts: total=7166,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:34.419 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:34.419 job1: (groupid=0, jobs=1): err= 0: pid=1254631: Mon Nov 18 02:05:06 2024 00:22:34.419 read: IOPS=619, BW=155MiB/s (162MB/s)(1569MiB/10134msec) 00:22:34.419 slat (usec): min=13, max=94795, avg=1480.00, stdev=4516.77 00:22:34.419 clat (msec): min=8, max=222, avg=101.76, stdev=33.28 00:22:34.419 lat (msec): min=8, max=226, avg=103.24, stdev=33.72 00:22:34.419 clat percentiles (msec): 00:22:34.419 | 1.00th=[ 31], 5.00th=[ 46], 10.00th=[ 54], 20.00th=[ 70], 00:22:34.419 | 30.00th=[ 85], 40.00th=[ 96], 50.00th=[ 105], 60.00th=[ 114], 00:22:34.419 | 70.00th=[ 123], 80.00th=[ 131], 90.00th=[ 142], 95.00th=[ 150], 00:22:34.419 | 99.00th=[ 176], 99.50th=[ 186], 99.90th=[ 199], 99.95th=[ 201], 00:22:34.419 | 99.99th=[ 224] 00:22:34.419 bw ( KiB/s): min=110080, max=278016, per=8.18%, avg=159027.20, stdev=41680.04, samples=20 00:22:34.419 iops : min= 430, max= 1086, avg=621.20, stdev=162.81, samples=20 00:22:34.419 lat (msec) : 10=0.14%, 20=0.30%, 50=7.19%, 100=36.88%, 250=55.49% 00:22:34.419 cpu : usr=0.52%, sys=1.97%, ctx=1156, majf=0, minf=4097 00:22:34.419 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:34.419 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:34.419 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:34.419 issued rwts: total=6275,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:34.419 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:34.419 job2: (groupid=0, jobs=1): err= 0: pid=1254632: Mon Nov 18 02:05:06 2024 00:22:34.419 read: IOPS=766, BW=192MiB/s (201MB/s)(1941MiB/10127msec) 00:22:34.419 slat (usec): min=13, max=57615, avg=1240.31, stdev=3620.71 00:22:34.419 clat (msec): min=5, max=282, avg=82.16, stdev=39.12 00:22:34.419 lat (msec): min=5, max=282, avg=83.40, stdev=39.66 00:22:34.419 clat percentiles (msec): 00:22:34.419 | 1.00th=[ 21], 5.00th=[ 29], 10.00th=[ 31], 20.00th=[ 41], 00:22:34.419 | 30.00th=[ 61], 40.00th=[ 70], 50.00th=[ 79], 60.00th=[ 89], 00:22:34.419 | 70.00th=[ 107], 80.00th=[ 121], 90.00th=[ 134], 95.00th=[ 144], 00:22:34.419 | 99.00th=[ 163], 99.50th=[ 176], 99.90th=[ 284], 99.95th=[ 284], 00:22:34.419 | 99.99th=[ 284] 00:22:34.419 bw ( KiB/s): min=110080, max=449024, per=10.14%, avg=197158.70, stdev=96652.45, samples=20 00:22:34.419 iops : min= 430, max= 1754, avg=770.15, stdev=377.55, samples=20 00:22:34.419 lat (msec) : 10=0.39%, 20=0.53%, 50=23.38%, 100=42.21%, 250=33.27% 00:22:34.419 lat (msec) : 500=0.23% 00:22:34.419 cpu : usr=0.42%, sys=2.56%, ctx=1353, majf=0, minf=4097 00:22:34.420 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:34.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:34.420 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:34.420 issued rwts: total=7764,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:34.420 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:34.420 job3: (groupid=0, jobs=1): err= 0: pid=1254633: Mon Nov 18 02:05:06 2024 00:22:34.420 read: IOPS=768, BW=192MiB/s (201MB/s)(1925MiB/10026msec) 00:22:34.420 slat (usec): min=9, max=82639, avg=1157.35, stdev=3825.78 00:22:34.420 clat (usec): min=1413, max=240634, avg=82082.92, stdev=38569.65 00:22:34.420 lat (usec): min=1471, max=279243, avg=83240.27, stdev=39100.81 00:22:34.420 clat percentiles (msec): 00:22:34.420 | 1.00th=[ 6], 5.00th=[ 19], 10.00th=[ 33], 20.00th=[ 50], 00:22:34.420 | 30.00th=[ 67], 40.00th=[ 75], 50.00th=[ 83], 60.00th=[ 89], 00:22:34.420 | 70.00th=[ 99], 80.00th=[ 111], 90.00th=[ 127], 95.00th=[ 148], 00:22:34.420 | 99.00th=[ 205], 99.50th=[ 215], 99.90th=[ 228], 99.95th=[ 232], 00:22:34.420 | 99.99th=[ 241] 00:22:34.420 bw ( KiB/s): min=77312, max=374272, per=10.05%, avg=195532.80, stdev=62815.51, samples=20 00:22:34.420 iops : min= 302, max= 1462, avg=763.80, stdev=245.37, samples=20 00:22:34.420 lat (msec) : 2=0.04%, 4=0.30%, 10=2.00%, 20=3.29%, 50=14.78% 00:22:34.420 lat (msec) : 100=51.25%, 250=28.35% 00:22:34.420 cpu : usr=0.45%, sys=2.59%, ctx=1431, majf=0, minf=4097 00:22:34.420 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:34.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:34.420 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:34.420 issued rwts: total=7701,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:34.420 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:34.420 job4: (groupid=0, jobs=1): err= 0: pid=1254634: Mon Nov 18 02:05:06 2024 00:22:34.420 read: IOPS=634, BW=159MiB/s (166MB/s)(1589MiB/10022msec) 00:22:34.420 slat (usec): min=13, max=65824, avg=1392.96, stdev=4342.21 00:22:34.420 clat (msec): min=3, max=185, avg=99.43, stdev=37.73 00:22:34.420 lat (msec): min=3, max=193, avg=100.82, stdev=38.35 00:22:34.420 clat percentiles (msec): 00:22:34.420 | 1.00th=[ 24], 5.00th=[ 33], 10.00th=[ 41], 20.00th=[ 61], 00:22:34.420 | 30.00th=[ 78], 40.00th=[ 96], 50.00th=[ 111], 60.00th=[ 120], 00:22:34.420 | 70.00th=[ 127], 80.00th=[ 133], 90.00th=[ 142], 95.00th=[ 148], 00:22:34.420 | 99.00th=[ 165], 99.50th=[ 167], 99.90th=[ 180], 99.95th=[ 184], 00:22:34.420 | 99.99th=[ 186] 00:22:34.420 bw ( KiB/s): min=103936, max=377856, per=8.28%, avg=161087.90, stdev=62696.70, samples=20 00:22:34.420 iops : min= 406, max= 1476, avg=629.20, stdev=244.94, samples=20 00:22:34.420 lat (msec) : 4=0.02%, 10=0.11%, 20=0.36%, 50=14.08%, 100=27.27% 00:22:34.420 lat (msec) : 250=58.16% 00:22:34.420 cpu : usr=0.36%, sys=2.12%, ctx=1230, majf=0, minf=4097 00:22:34.420 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:34.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:34.420 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:34.420 issued rwts: total=6355,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:34.420 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:34.420 job5: (groupid=0, jobs=1): err= 0: pid=1254635: Mon Nov 18 02:05:06 2024 00:22:34.420 read: IOPS=630, BW=158MiB/s (165MB/s)(1595MiB/10123msec) 00:22:34.420 slat (usec): min=9, max=91028, avg=1177.67, stdev=4216.57 00:22:34.420 clat (usec): min=1028, max=274810, avg=100302.27, stdev=46858.16 00:22:34.420 lat (usec): min=1045, max=295392, avg=101479.93, stdev=47611.71 00:22:34.420 clat percentiles (msec): 00:22:34.420 | 1.00th=[ 6], 5.00th=[ 17], 10.00th=[ 28], 20.00th=[ 52], 00:22:34.420 | 30.00th=[ 83], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 118], 00:22:34.420 | 70.00th=[ 127], 80.00th=[ 134], 90.00th=[ 148], 95.00th=[ 163], 00:22:34.420 | 99.00th=[ 222], 99.50th=[ 230], 99.90th=[ 253], 99.95th=[ 275], 00:22:34.420 | 99.99th=[ 275] 00:22:34.420 bw ( KiB/s): min=110592, max=318464, per=8.31%, avg=161664.00, stdev=56956.01, samples=20 00:22:34.420 iops : min= 432, max= 1244, avg=631.50, stdev=222.48, samples=20 00:22:34.420 lat (msec) : 2=0.22%, 4=0.56%, 10=1.21%, 20=4.00%, 50=13.59% 00:22:34.420 lat (msec) : 100=20.29%, 250=59.80%, 500=0.33% 00:22:34.420 cpu : usr=0.33%, sys=2.08%, ctx=1427, majf=0, minf=4097 00:22:34.420 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:34.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:34.420 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:34.420 issued rwts: total=6378,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:34.420 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:34.420 job6: (groupid=0, jobs=1): err= 0: pid=1254636: Mon Nov 18 02:05:06 2024 00:22:34.420 read: IOPS=540, BW=135MiB/s (142MB/s)(1370MiB/10130msec) 00:22:34.420 slat (usec): min=10, max=57976, avg=1535.58, stdev=4596.95 00:22:34.420 clat (usec): min=1152, max=297532, avg=116694.52, stdev=35773.96 00:22:34.420 lat (usec): min=1187, max=297550, avg=118230.09, stdev=36297.75 00:22:34.420 clat percentiles (msec): 00:22:34.420 | 1.00th=[ 7], 5.00th=[ 65], 10.00th=[ 78], 20.00th=[ 89], 00:22:34.420 | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 122], 60.00th=[ 129], 00:22:34.420 | 70.00th=[ 134], 80.00th=[ 140], 90.00th=[ 153], 95.00th=[ 167], 00:22:34.420 | 99.00th=[ 226], 99.50th=[ 239], 99.90th=[ 271], 99.95th=[ 296], 00:22:34.420 | 99.99th=[ 296] 00:22:34.420 bw ( KiB/s): min=88064, max=182784, per=7.13%, avg=138624.00, stdev=24830.61, samples=20 00:22:34.420 iops : min= 344, max= 714, avg=541.50, stdev=96.99, samples=20 00:22:34.420 lat (msec) : 2=0.05%, 4=0.18%, 10=1.13%, 20=0.77%, 50=1.57% 00:22:34.420 lat (msec) : 100=26.49%, 250=69.55%, 500=0.26% 00:22:34.420 cpu : usr=0.37%, sys=1.87%, ctx=1160, majf=0, minf=4098 00:22:34.420 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:34.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:34.420 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:34.420 issued rwts: total=5478,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:34.420 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:34.420 job7: (groupid=0, jobs=1): err= 0: pid=1254637: Mon Nov 18 02:05:06 2024 00:22:34.420 read: IOPS=655, BW=164MiB/s (172MB/s)(1644MiB/10028msec) 00:22:34.420 slat (usec): min=9, max=63964, avg=991.43, stdev=3822.89 00:22:34.420 clat (usec): min=1492, max=236697, avg=96533.89, stdev=35707.82 00:22:34.420 lat (usec): min=1511, max=265974, avg=97525.32, stdev=36156.87 00:22:34.420 clat percentiles (msec): 00:22:34.420 | 1.00th=[ 16], 5.00th=[ 34], 10.00th=[ 52], 20.00th=[ 74], 00:22:34.420 | 30.00th=[ 82], 40.00th=[ 88], 50.00th=[ 93], 60.00th=[ 102], 00:22:34.420 | 70.00th=[ 113], 80.00th=[ 127], 90.00th=[ 140], 95.00th=[ 153], 00:22:34.420 | 99.00th=[ 209], 99.50th=[ 218], 99.90th=[ 228], 99.95th=[ 236], 00:22:34.420 | 99.99th=[ 236] 00:22:34.420 bw ( KiB/s): min=94208, max=226816, per=8.57%, avg=166707.20, stdev=36088.36, samples=20 00:22:34.420 iops : min= 368, max= 886, avg=651.20, stdev=140.97, samples=20 00:22:34.420 lat (msec) : 2=0.09%, 4=0.21%, 10=0.24%, 20=1.16%, 50=7.95% 00:22:34.420 lat (msec) : 100=49.10%, 250=41.25% 00:22:34.420 cpu : usr=0.32%, sys=2.04%, ctx=1466, majf=0, minf=3722 00:22:34.420 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:22:34.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:34.420 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:34.420 issued rwts: total=6575,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:34.420 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:34.420 job8: (groupid=0, jobs=1): err= 0: pid=1254638: Mon Nov 18 02:05:06 2024 00:22:34.420 read: IOPS=766, BW=192MiB/s (201MB/s)(1919MiB/10022msec) 00:22:34.420 slat (usec): min=9, max=67518, avg=888.71, stdev=3287.51 00:22:34.420 clat (msec): min=3, max=235, avg=82.58, stdev=37.38 00:22:34.420 lat (msec): min=3, max=242, avg=83.46, stdev=37.76 00:22:34.420 clat percentiles (msec): 00:22:34.420 | 1.00th=[ 8], 5.00th=[ 24], 10.00th=[ 40], 20.00th=[ 55], 00:22:34.420 | 30.00th=[ 63], 40.00th=[ 71], 50.00th=[ 81], 60.00th=[ 88], 00:22:34.420 | 70.00th=[ 97], 80.00th=[ 109], 90.00th=[ 131], 95.00th=[ 153], 00:22:34.420 | 99.00th=[ 194], 99.50th=[ 218], 99.90th=[ 228], 99.95th=[ 228], 00:22:34.420 | 99.99th=[ 236] 00:22:34.420 bw ( KiB/s): min=109568, max=275456, per=10.02%, avg=194918.40, stdev=45759.74, samples=20 00:22:34.420 iops : min= 428, max= 1076, avg=761.40, stdev=178.75, samples=20 00:22:34.420 lat (msec) : 4=0.03%, 10=2.24%, 20=2.16%, 50=10.68%, 100=57.56% 00:22:34.420 lat (msec) : 250=27.33% 00:22:34.420 cpu : usr=0.34%, sys=2.25%, ctx=1583, majf=0, minf=4097 00:22:34.420 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:34.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:34.420 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:34.420 issued rwts: total=7677,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:34.420 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:34.420 job9: (groupid=0, jobs=1): err= 0: pid=1254639: Mon Nov 18 02:05:06 2024 00:22:34.420 read: IOPS=775, BW=194MiB/s (203MB/s)(1962MiB/10126msec) 00:22:34.420 slat (usec): min=13, max=52882, avg=1203.42, stdev=3584.26 00:22:34.420 clat (msec): min=3, max=284, avg=81.29, stdev=36.23 00:22:34.420 lat (msec): min=3, max=284, avg=82.49, stdev=36.76 00:22:34.420 clat percentiles (msec): 00:22:34.420 | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 31], 20.00th=[ 48], 00:22:34.420 | 30.00th=[ 60], 40.00th=[ 72], 50.00th=[ 81], 60.00th=[ 88], 00:22:34.420 | 70.00th=[ 100], 80.00th=[ 115], 90.00th=[ 131], 95.00th=[ 140], 00:22:34.420 | 99.00th=[ 159], 99.50th=[ 174], 99.90th=[ 259], 99.95th=[ 284], 00:22:34.420 | 99.99th=[ 284] 00:22:34.420 bw ( KiB/s): min=114688, max=452608, per=10.25%, avg=199323.35, stdev=81304.48, samples=20 00:22:34.420 iops : min= 448, max= 1768, avg=778.60, stdev=317.59, samples=20 00:22:34.420 lat (msec) : 4=0.08%, 10=0.31%, 20=0.42%, 50=21.04%, 100=48.60% 00:22:34.420 lat (msec) : 250=29.35%, 500=0.22% 00:22:34.420 cpu : usr=0.45%, sys=2.65%, ctx=1422, majf=0, minf=4097 00:22:34.420 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:34.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:34.420 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:34.420 issued rwts: total=7848,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:34.421 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:34.421 job10: (groupid=0, jobs=1): err= 0: pid=1254640: Mon Nov 18 02:05:06 2024 00:22:34.421 read: IOPS=766, BW=192MiB/s (201MB/s)(1941MiB/10126msec) 00:22:34.421 slat (usec): min=9, max=58453, avg=1009.86, stdev=3320.28 00:22:34.421 clat (usec): min=761, max=302011, avg=82367.93, stdev=37278.34 00:22:34.421 lat (usec): min=790, max=302028, avg=83377.79, stdev=37677.72 00:22:34.421 clat percentiles (msec): 00:22:34.421 | 1.00th=[ 12], 5.00th=[ 32], 10.00th=[ 35], 20.00th=[ 43], 00:22:34.421 | 30.00th=[ 62], 40.00th=[ 75], 50.00th=[ 84], 60.00th=[ 90], 00:22:34.421 | 70.00th=[ 100], 80.00th=[ 113], 90.00th=[ 132], 95.00th=[ 142], 00:22:34.421 | 99.00th=[ 169], 99.50th=[ 186], 99.90th=[ 284], 99.95th=[ 296], 00:22:34.421 | 99.99th=[ 305] 00:22:34.421 bw ( KiB/s): min=115712, max=442368, per=10.14%, avg=197185.75, stdev=74032.70, samples=20 00:22:34.421 iops : min= 452, max= 1728, avg=770.25, stdev=289.20, samples=20 00:22:34.421 lat (usec) : 1000=0.05% 00:22:34.421 lat (msec) : 2=0.18%, 4=0.40%, 10=0.32%, 20=1.04%, 50=22.45% 00:22:34.421 lat (msec) : 100=46.70%, 250=28.71%, 500=0.15% 00:22:34.421 cpu : usr=0.40%, sys=2.41%, ctx=1570, majf=0, minf=4097 00:22:34.421 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:34.421 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:34.421 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:34.421 issued rwts: total=7765,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:34.421 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:34.421 00:22:34.421 Run status group 0 (all jobs): 00:22:34.421 READ: bw=1899MiB/s (1991MB/s), 135MiB/s-194MiB/s (142MB/s-203MB/s), io=18.8GiB (20.2GB), run=10022-10134msec 00:22:34.421 00:22:34.421 Disk stats (read/write): 00:22:34.421 nvme0n1: ios=14180/0, merge=0/0, ticks=1237877/0, in_queue=1237877, util=97.37% 00:22:34.421 nvme10n1: ios=12319/0, merge=0/0, ticks=1237282/0, in_queue=1237282, util=97.59% 00:22:34.421 nvme1n1: ios=15354/0, merge=0/0, ticks=1231744/0, in_queue=1231744, util=97.81% 00:22:34.421 nvme2n1: ios=15162/0, merge=0/0, ticks=1238110/0, in_queue=1238110, util=97.97% 00:22:34.421 nvme3n1: ios=12452/0, merge=0/0, ticks=1239676/0, in_queue=1239676, util=98.03% 00:22:34.421 nvme4n1: ios=12570/0, merge=0/0, ticks=1235396/0, in_queue=1235396, util=98.33% 00:22:34.421 nvme5n1: ios=10792/0, merge=0/0, ticks=1229280/0, in_queue=1229280, util=98.49% 00:22:34.421 nvme6n1: ios=12948/0, merge=0/0, ticks=1243782/0, in_queue=1243782, util=98.59% 00:22:34.421 nvme7n1: ios=15099/0, merge=0/0, ticks=1245407/0, in_queue=1245407, util=98.98% 00:22:34.421 nvme8n1: ios=15527/0, merge=0/0, ticks=1232177/0, in_queue=1232177, util=99.11% 00:22:34.421 nvme9n1: ios=15368/0, merge=0/0, ticks=1236712/0, in_queue=1236712, util=99.20% 00:22:34.421 02:05:06 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:22:34.421 [global] 00:22:34.421 thread=1 00:22:34.421 invalidate=1 00:22:34.421 rw=randwrite 00:22:34.421 time_based=1 00:22:34.421 runtime=10 00:22:34.421 ioengine=libaio 00:22:34.421 direct=1 00:22:34.421 bs=262144 00:22:34.421 iodepth=64 00:22:34.421 norandommap=1 00:22:34.421 numjobs=1 00:22:34.421 00:22:34.421 [job0] 00:22:34.421 filename=/dev/nvme0n1 00:22:34.421 [job1] 00:22:34.421 filename=/dev/nvme10n1 00:22:34.421 [job2] 00:22:34.421 filename=/dev/nvme1n1 00:22:34.421 [job3] 00:22:34.421 filename=/dev/nvme2n1 00:22:34.421 [job4] 00:22:34.421 filename=/dev/nvme3n1 00:22:34.421 [job5] 00:22:34.421 filename=/dev/nvme4n1 00:22:34.421 [job6] 00:22:34.421 filename=/dev/nvme5n1 00:22:34.421 [job7] 00:22:34.421 filename=/dev/nvme6n1 00:22:34.421 [job8] 00:22:34.421 filename=/dev/nvme7n1 00:22:34.421 [job9] 00:22:34.421 filename=/dev/nvme8n1 00:22:34.421 [job10] 00:22:34.421 filename=/dev/nvme9n1 00:22:34.421 Could not set queue depth (nvme0n1) 00:22:34.421 Could not set queue depth (nvme10n1) 00:22:34.421 Could not set queue depth (nvme1n1) 00:22:34.421 Could not set queue depth (nvme2n1) 00:22:34.421 Could not set queue depth (nvme3n1) 00:22:34.421 Could not set queue depth (nvme4n1) 00:22:34.421 Could not set queue depth (nvme5n1) 00:22:34.421 Could not set queue depth (nvme6n1) 00:22:34.421 Could not set queue depth (nvme7n1) 00:22:34.421 Could not set queue depth (nvme8n1) 00:22:34.421 Could not set queue depth (nvme9n1) 00:22:34.421 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:34.421 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:34.421 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:34.421 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:34.421 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:34.421 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:34.421 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:34.421 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:34.421 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:34.421 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:34.421 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:34.421 fio-3.35 00:22:34.421 Starting 11 threads 00:22:44.417 00:22:44.417 job0: (groupid=0, jobs=1): err= 0: pid=1255750: Mon Nov 18 02:05:17 2024 00:22:44.417 write: IOPS=598, BW=150MiB/s (157MB/s)(1507MiB/10079msec); 0 zone resets 00:22:44.417 slat (usec): min=16, max=64835, avg=894.77, stdev=3189.18 00:22:44.417 clat (usec): min=1975, max=304220, avg=106007.72, stdev=67128.06 00:22:44.417 lat (msec): min=2, max=304, avg=106.90, stdev=67.83 00:22:44.417 clat percentiles (msec): 00:22:44.417 | 1.00th=[ 8], 5.00th=[ 22], 10.00th=[ 34], 20.00th=[ 52], 00:22:44.417 | 30.00th=[ 58], 40.00th=[ 72], 50.00th=[ 90], 60.00th=[ 113], 00:22:44.417 | 70.00th=[ 132], 80.00th=[ 159], 90.00th=[ 213], 95.00th=[ 247], 00:22:44.417 | 99.00th=[ 279], 99.50th=[ 288], 99.90th=[ 300], 99.95th=[ 305], 00:22:44.417 | 99.99th=[ 305] 00:22:44.417 bw ( KiB/s): min=78336, max=273920, per=10.52%, avg=152745.60, stdev=50539.53, samples=20 00:22:44.417 iops : min= 306, max= 1070, avg=596.65, stdev=197.42, samples=20 00:22:44.417 lat (msec) : 2=0.02%, 4=0.27%, 10=1.24%, 20=2.85%, 50=14.60% 00:22:44.417 lat (msec) : 100=34.80%, 250=41.48%, 500=4.74% 00:22:44.417 cpu : usr=1.92%, sys=1.88%, ctx=3898, majf=0, minf=1 00:22:44.417 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:44.417 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.417 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:44.417 issued rwts: total=0,6029,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:44.417 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:44.417 job1: (groupid=0, jobs=1): err= 0: pid=1255777: Mon Nov 18 02:05:17 2024 00:22:44.417 write: IOPS=474, BW=119MiB/s (124MB/s)(1207MiB/10175msec); 0 zone resets 00:22:44.417 slat (usec): min=23, max=35567, avg=1758.16, stdev=3830.18 00:22:44.417 clat (usec): min=1896, max=438925, avg=133099.91, stdev=58777.76 00:22:44.417 lat (usec): min=1978, max=439003, avg=134858.07, stdev=59528.95 00:22:44.417 clat percentiles (msec): 00:22:44.417 | 1.00th=[ 21], 5.00th=[ 49], 10.00th=[ 70], 20.00th=[ 81], 00:22:44.417 | 30.00th=[ 90], 40.00th=[ 114], 50.00th=[ 131], 60.00th=[ 148], 00:22:44.417 | 70.00th=[ 157], 80.00th=[ 180], 90.00th=[ 220], 95.00th=[ 230], 00:22:44.417 | 99.00th=[ 266], 99.50th=[ 351], 99.90th=[ 422], 99.95th=[ 422], 00:22:44.417 | 99.99th=[ 439] 00:22:44.417 bw ( KiB/s): min=71680, max=211968, per=8.40%, avg=121945.30, stdev=36158.96, samples=20 00:22:44.417 iops : min= 280, max= 828, avg=476.30, stdev=141.24, samples=20 00:22:44.417 lat (msec) : 2=0.02%, 4=0.31%, 10=0.37%, 20=0.23%, 50=4.29% 00:22:44.417 lat (msec) : 100=27.72%, 250=65.50%, 500=1.55% 00:22:44.417 cpu : usr=1.46%, sys=1.44%, ctx=1926, majf=0, minf=1 00:22:44.417 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:22:44.417 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.417 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:44.417 issued rwts: total=0,4826,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:44.417 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:44.417 job2: (groupid=0, jobs=1): err= 0: pid=1255808: Mon Nov 18 02:05:17 2024 00:22:44.417 write: IOPS=571, BW=143MiB/s (150MB/s)(1439MiB/10072msec); 0 zone resets 00:22:44.417 slat (usec): min=19, max=50802, avg=1241.76, stdev=3290.14 00:22:44.417 clat (usec): min=772, max=288106, avg=110697.55, stdev=60055.14 00:22:44.417 lat (usec): min=813, max=288143, avg=111939.30, stdev=60799.15 00:22:44.417 clat percentiles (msec): 00:22:44.417 | 1.00th=[ 6], 5.00th=[ 20], 10.00th=[ 35], 20.00th=[ 51], 00:22:44.417 | 30.00th=[ 79], 40.00th=[ 87], 50.00th=[ 110], 60.00th=[ 118], 00:22:44.417 | 70.00th=[ 136], 80.00th=[ 171], 90.00th=[ 201], 95.00th=[ 213], 00:22:44.417 | 99.00th=[ 247], 99.50th=[ 259], 99.90th=[ 271], 99.95th=[ 279], 00:22:44.417 | 99.99th=[ 288] 00:22:44.417 bw ( KiB/s): min=75776, max=256512, per=10.04%, avg=145753.50, stdev=50909.28, samples=20 00:22:44.417 iops : min= 296, max= 1002, avg=569.30, stdev=198.88, samples=20 00:22:44.417 lat (usec) : 1000=0.05% 00:22:44.417 lat (msec) : 2=0.12%, 4=0.31%, 10=1.98%, 20=2.83%, 50=14.35% 00:22:44.417 lat (msec) : 100=25.71%, 250=53.74%, 500=0.90% 00:22:44.417 cpu : usr=1.73%, sys=1.85%, ctx=3059, majf=0, minf=1 00:22:44.417 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:44.417 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.417 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:44.417 issued rwts: total=0,5756,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:44.417 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:44.417 job3: (groupid=0, jobs=1): err= 0: pid=1255840: Mon Nov 18 02:05:17 2024 00:22:44.417 write: IOPS=536, BW=134MiB/s (141MB/s)(1356MiB/10115msec); 0 zone resets 00:22:44.417 slat (usec): min=25, max=52947, avg=1452.34, stdev=3419.48 00:22:44.417 clat (msec): min=2, max=268, avg=117.83, stdev=54.21 00:22:44.417 lat (msec): min=2, max=269, avg=119.28, stdev=54.95 00:22:44.417 clat percentiles (msec): 00:22:44.417 | 1.00th=[ 13], 5.00th=[ 34], 10.00th=[ 59], 20.00th=[ 77], 00:22:44.417 | 30.00th=[ 83], 40.00th=[ 93], 50.00th=[ 112], 60.00th=[ 127], 00:22:44.417 | 70.00th=[ 144], 80.00th=[ 161], 90.00th=[ 197], 95.00th=[ 220], 00:22:44.417 | 99.00th=[ 257], 99.50th=[ 264], 99.90th=[ 268], 99.95th=[ 271], 00:22:44.417 | 99.99th=[ 271] 00:22:44.417 bw ( KiB/s): min=63488, max=238080, per=9.46%, avg=137267.20, stdev=48898.12, samples=20 00:22:44.418 iops : min= 248, max= 930, avg=536.20, stdev=191.01, samples=20 00:22:44.418 lat (msec) : 4=0.02%, 10=0.59%, 20=1.94%, 50=5.77%, 100=35.59% 00:22:44.418 lat (msec) : 250=54.54%, 500=1.55% 00:22:44.418 cpu : usr=1.55%, sys=1.72%, ctx=2372, majf=0, minf=1 00:22:44.418 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:44.418 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.418 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:44.418 issued rwts: total=0,5425,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:44.418 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:44.418 job4: (groupid=0, jobs=1): err= 0: pid=1255846: Mon Nov 18 02:05:17 2024 00:22:44.418 write: IOPS=449, BW=112MiB/s (118MB/s)(1138MiB/10118msec); 0 zone resets 00:22:44.418 slat (usec): min=21, max=52231, avg=1948.55, stdev=4331.62 00:22:44.418 clat (usec): min=1147, max=277477, avg=140310.90, stdev=63936.50 00:22:44.418 lat (usec): min=1676, max=277511, avg=142259.45, stdev=64866.87 00:22:44.418 clat percentiles (msec): 00:22:44.418 | 1.00th=[ 6], 5.00th=[ 27], 10.00th=[ 51], 20.00th=[ 81], 00:22:44.418 | 30.00th=[ 120], 40.00th=[ 132], 50.00th=[ 142], 60.00th=[ 153], 00:22:44.418 | 70.00th=[ 165], 80.00th=[ 197], 90.00th=[ 232], 95.00th=[ 249], 00:22:44.418 | 99.00th=[ 268], 99.50th=[ 271], 99.90th=[ 275], 99.95th=[ 279], 00:22:44.418 | 99.99th=[ 279] 00:22:44.418 bw ( KiB/s): min=61440, max=261120, per=7.91%, avg=114867.20, stdev=46086.97, samples=20 00:22:44.418 iops : min= 240, max= 1020, avg=448.70, stdev=180.03, samples=20 00:22:44.418 lat (msec) : 2=0.04%, 4=0.42%, 10=1.87%, 20=1.49%, 50=6.11% 00:22:44.418 lat (msec) : 100=14.95%, 250=70.55%, 500=4.57% 00:22:44.418 cpu : usr=1.43%, sys=1.55%, ctx=1807, majf=0, minf=1 00:22:44.418 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:22:44.418 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.418 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:44.418 issued rwts: total=0,4550,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:44.418 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:44.418 job5: (groupid=0, jobs=1): err= 0: pid=1255854: Mon Nov 18 02:05:17 2024 00:22:44.418 write: IOPS=635, BW=159MiB/s (167MB/s)(1618MiB/10179msec); 0 zone resets 00:22:44.418 slat (usec): min=15, max=61014, avg=1006.37, stdev=2940.82 00:22:44.418 clat (usec): min=713, max=407989, avg=99506.83, stdev=65050.40 00:22:44.418 lat (usec): min=784, max=408053, avg=100513.20, stdev=65674.91 00:22:44.418 clat percentiles (msec): 00:22:44.418 | 1.00th=[ 4], 5.00th=[ 9], 10.00th=[ 26], 20.00th=[ 41], 00:22:44.418 | 30.00th=[ 45], 40.00th=[ 73], 50.00th=[ 95], 60.00th=[ 110], 00:22:44.418 | 70.00th=[ 136], 80.00th=[ 159], 90.00th=[ 188], 95.00th=[ 211], 00:22:44.418 | 99.00th=[ 262], 99.50th=[ 292], 99.90th=[ 380], 99.95th=[ 397], 00:22:44.418 | 99.99th=[ 409] 00:22:44.418 bw ( KiB/s): min=77824, max=352768, per=11.30%, avg=164055.35, stdev=72829.39, samples=20 00:22:44.418 iops : min= 304, max= 1378, avg=640.80, stdev=284.52, samples=20 00:22:44.418 lat (usec) : 750=0.02%, 1000=0.14% 00:22:44.418 lat (msec) : 2=0.45%, 4=1.05%, 10=3.57%, 20=2.95%, 50=25.20% 00:22:44.418 lat (msec) : 100=22.19%, 250=42.82%, 500=1.62% 00:22:44.418 cpu : usr=1.79%, sys=2.01%, ctx=3531, majf=0, minf=1 00:22:44.418 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:22:44.418 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.418 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:44.418 issued rwts: total=0,6472,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:44.418 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:44.418 job6: (groupid=0, jobs=1): err= 0: pid=1255855: Mon Nov 18 02:05:17 2024 00:22:44.418 write: IOPS=431, BW=108MiB/s (113MB/s)(1092MiB/10117msec); 0 zone resets 00:22:44.418 slat (usec): min=24, max=39554, avg=1730.31, stdev=4035.74 00:22:44.418 clat (msec): min=5, max=271, avg=146.44, stdev=55.77 00:22:44.418 lat (msec): min=5, max=282, avg=148.17, stdev=56.57 00:22:44.418 clat percentiles (msec): 00:22:44.418 | 1.00th=[ 22], 5.00th=[ 50], 10.00th=[ 75], 20.00th=[ 96], 00:22:44.418 | 30.00th=[ 118], 40.00th=[ 133], 50.00th=[ 148], 60.00th=[ 159], 00:22:44.418 | 70.00th=[ 178], 80.00th=[ 199], 90.00th=[ 222], 95.00th=[ 236], 00:22:44.418 | 99.00th=[ 264], 99.50th=[ 268], 99.90th=[ 271], 99.95th=[ 271], 00:22:44.418 | 99.99th=[ 271] 00:22:44.418 bw ( KiB/s): min=62976, max=168448, per=7.59%, avg=110220.55, stdev=31181.19, samples=20 00:22:44.418 iops : min= 246, max= 658, avg=430.50, stdev=121.78, samples=20 00:22:44.418 lat (msec) : 10=0.11%, 20=0.60%, 50=4.51%, 100=16.14%, 250=75.73% 00:22:44.418 lat (msec) : 500=2.91% 00:22:44.418 cpu : usr=1.36%, sys=1.48%, ctx=2070, majf=0, minf=1 00:22:44.418 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:22:44.418 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.418 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:44.418 issued rwts: total=0,4368,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:44.418 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:44.418 job7: (groupid=0, jobs=1): err= 0: pid=1255856: Mon Nov 18 02:05:17 2024 00:22:44.418 write: IOPS=535, BW=134MiB/s (140MB/s)(1361MiB/10176msec); 0 zone resets 00:22:44.418 slat (usec): min=24, max=50660, avg=1669.71, stdev=3507.31 00:22:44.418 clat (msec): min=2, max=438, avg=117.82, stdev=49.68 00:22:44.418 lat (msec): min=2, max=438, avg=119.49, stdev=50.25 00:22:44.418 clat percentiles (msec): 00:22:44.418 | 1.00th=[ 26], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 79], 00:22:44.418 | 30.00th=[ 88], 40.00th=[ 95], 50.00th=[ 109], 60.00th=[ 122], 00:22:44.418 | 70.00th=[ 136], 80.00th=[ 153], 90.00th=[ 169], 95.00th=[ 224], 00:22:44.418 | 99.00th=[ 268], 99.50th=[ 313], 99.90th=[ 422], 99.95th=[ 422], 00:22:44.418 | 99.99th=[ 439] 00:22:44.418 bw ( KiB/s): min=69632, max=208896, per=9.49%, avg=137796.35, stdev=37940.13, samples=20 00:22:44.418 iops : min= 272, max= 816, avg=538.25, stdev=148.19, samples=20 00:22:44.418 lat (msec) : 4=0.04%, 10=0.24%, 20=0.40%, 50=2.70%, 100=42.26% 00:22:44.418 lat (msec) : 250=51.90%, 500=2.46% 00:22:44.418 cpu : usr=1.76%, sys=1.66%, ctx=1783, majf=0, minf=1 00:22:44.418 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:44.418 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.418 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:44.418 issued rwts: total=0,5445,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:44.418 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:44.418 job8: (groupid=0, jobs=1): err= 0: pid=1255857: Mon Nov 18 02:05:17 2024 00:22:44.418 write: IOPS=456, BW=114MiB/s (120MB/s)(1162MiB/10173msec); 0 zone resets 00:22:44.418 slat (usec): min=25, max=32899, avg=1806.84, stdev=3930.37 00:22:44.418 clat (msec): min=4, max=439, avg=138.15, stdev=55.82 00:22:44.418 lat (msec): min=4, max=439, avg=139.96, stdev=56.59 00:22:44.418 clat percentiles (msec): 00:22:44.418 | 1.00th=[ 17], 5.00th=[ 45], 10.00th=[ 66], 20.00th=[ 90], 00:22:44.418 | 30.00th=[ 110], 40.00th=[ 128], 50.00th=[ 142], 60.00th=[ 153], 00:22:44.418 | 70.00th=[ 161], 80.00th=[ 180], 90.00th=[ 205], 95.00th=[ 226], 00:22:44.418 | 99.00th=[ 275], 99.50th=[ 334], 99.90th=[ 422], 99.95th=[ 422], 00:22:44.418 | 99.99th=[ 439] 00:22:44.418 bw ( KiB/s): min=73216, max=203776, per=8.09%, avg=117401.60, stdev=37379.54, samples=20 00:22:44.418 iops : min= 286, max= 796, avg=458.60, stdev=146.01, samples=20 00:22:44.418 lat (msec) : 10=0.34%, 20=0.99%, 50=4.95%, 100=19.98%, 250=71.71% 00:22:44.418 lat (msec) : 500=2.02% 00:22:44.418 cpu : usr=1.42%, sys=1.32%, ctx=2016, majf=0, minf=1 00:22:44.418 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:22:44.418 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.418 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:44.418 issued rwts: total=0,4649,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:44.418 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:44.418 job9: (groupid=0, jobs=1): err= 0: pid=1255858: Mon Nov 18 02:05:17 2024 00:22:44.418 write: IOPS=469, BW=117MiB/s (123MB/s)(1183MiB/10072msec); 0 zone resets 00:22:44.418 slat (usec): min=21, max=30460, avg=1895.35, stdev=3922.58 00:22:44.418 clat (usec): min=1252, max=255447, avg=134302.09, stdev=53391.89 00:22:44.418 lat (usec): min=1297, max=268173, avg=136197.44, stdev=54055.86 00:22:44.418 clat percentiles (msec): 00:22:44.418 | 1.00th=[ 17], 5.00th=[ 39], 10.00th=[ 67], 20.00th=[ 81], 00:22:44.418 | 30.00th=[ 106], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 153], 00:22:44.418 | 70.00th=[ 163], 80.00th=[ 182], 90.00th=[ 205], 95.00th=[ 220], 00:22:44.418 | 99.00th=[ 241], 99.50th=[ 251], 99.90th=[ 255], 99.95th=[ 255], 00:22:44.418 | 99.99th=[ 255] 00:22:44.418 bw ( KiB/s): min=75776, max=222208, per=8.23%, avg=119509.70, stdev=36927.87, samples=20 00:22:44.418 iops : min= 296, max= 868, avg=466.80, stdev=144.28, samples=20 00:22:44.418 lat (msec) : 2=0.11%, 4=0.30%, 10=0.36%, 20=0.61%, 50=6.00% 00:22:44.418 lat (msec) : 100=21.18%, 250=70.94%, 500=0.51% 00:22:44.418 cpu : usr=1.63%, sys=1.31%, ctx=1702, majf=0, minf=1 00:22:44.418 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:22:44.418 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.418 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:44.418 issued rwts: total=0,4731,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:44.418 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:44.418 job10: (groupid=0, jobs=1): err= 0: pid=1255859: Mon Nov 18 02:05:17 2024 00:22:44.418 write: IOPS=542, BW=136MiB/s (142MB/s)(1366MiB/10078msec); 0 zone resets 00:22:44.418 slat (usec): min=20, max=29276, avg=1569.87, stdev=3398.43 00:22:44.418 clat (usec): min=1571, max=254219, avg=116444.90, stdev=50322.37 00:22:44.418 lat (usec): min=1652, max=254251, avg=118014.77, stdev=51111.13 00:22:44.418 clat percentiles (msec): 00:22:44.418 | 1.00th=[ 8], 5.00th=[ 32], 10.00th=[ 57], 20.00th=[ 78], 00:22:44.418 | 30.00th=[ 88], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 128], 00:22:44.418 | 70.00th=[ 146], 80.00th=[ 155], 90.00th=[ 171], 95.00th=[ 220], 00:22:44.418 | 99.00th=[ 243], 99.50th=[ 249], 99.90th=[ 253], 99.95th=[ 255], 00:22:44.418 | 99.99th=[ 255] 00:22:44.418 bw ( KiB/s): min=69632, max=289792, per=9.53%, avg=138260.15, stdev=52352.53, samples=20 00:22:44.418 iops : min= 272, max= 1132, avg=540.05, stdev=204.47, samples=20 00:22:44.418 lat (msec) : 2=0.04%, 4=0.26%, 10=1.06%, 20=1.90%, 50=5.53% 00:22:44.419 lat (msec) : 100=30.44%, 250=60.61%, 500=0.16% 00:22:44.419 cpu : usr=1.75%, sys=1.58%, ctx=2191, majf=0, minf=1 00:22:44.419 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:44.419 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.419 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:44.419 issued rwts: total=0,5463,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:44.419 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:44.419 00:22:44.419 Run status group 0 (all jobs): 00:22:44.419 WRITE: bw=1417MiB/s (1486MB/s), 108MiB/s-159MiB/s (113MB/s-167MB/s), io=14.1GiB (15.1GB), run=10072-10179msec 00:22:44.419 00:22:44.419 Disk stats (read/write): 00:22:44.419 nvme0n1: ios=49/11798, merge=0/0, ticks=1992/1226316, in_queue=1228308, util=99.32% 00:22:44.419 nvme10n1: ios=49/9637, merge=0/0, ticks=87/1239228, in_queue=1239315, util=97.87% 00:22:44.419 nvme1n1: ios=49/11246, merge=0/0, ticks=89/1220177, in_queue=1220266, util=98.06% 00:22:44.419 nvme2n1: ios=46/10630, merge=0/0, ticks=1214/1211496, in_queue=1212710, util=99.88% 00:22:44.419 nvme3n1: ios=48/8890, merge=0/0, ticks=116/1209395, in_queue=1209511, util=98.52% 00:22:44.419 nvme4n1: ios=53/12923, merge=0/0, ticks=1572/1247808, in_queue=1249380, util=99.94% 00:22:44.419 nvme5n1: ios=0/8526, merge=0/0, ticks=0/1216185, in_queue=1216185, util=98.23% 00:22:44.419 nvme6n1: ios=25/10873, merge=0/0, ticks=752/1234900, in_queue=1235652, util=99.95% 00:22:44.419 nvme7n1: ios=0/9276, merge=0/0, ticks=0/1238701, in_queue=1238701, util=98.74% 00:22:44.419 nvme8n1: ios=0/9196, merge=0/0, ticks=0/1212508, in_queue=1212508, util=98.96% 00:22:44.419 nvme9n1: ios=0/10670, merge=0/0, ticks=0/1213030, in_queue=1213030, util=99.10% 00:22:44.419 02:05:17 -- target/multiconnection.sh@36 -- # sync 00:22:44.419 02:05:17 -- target/multiconnection.sh@37 -- # seq 1 11 00:22:44.419 02:05:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:44.419 02:05:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:22:44.419 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:22:44.419 02:05:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:22:44.419 02:05:18 -- common/autotest_common.sh@1208 -- # local i=0 00:22:44.419 02:05:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:44.419 02:05:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:22:44.419 02:05:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:44.419 02:05:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:22:44.419 02:05:18 -- common/autotest_common.sh@1220 -- # return 0 00:22:44.419 02:05:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:44.419 02:05:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.419 02:05:18 -- common/autotest_common.sh@10 -- # set +x 00:22:44.419 02:05:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.419 02:05:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:44.419 02:05:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:22:44.419 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:22:44.419 02:05:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:22:44.419 02:05:18 -- common/autotest_common.sh@1208 -- # local i=0 00:22:44.419 02:05:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:44.419 02:05:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:22:44.419 02:05:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:44.419 02:05:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:22:44.419 02:05:18 -- common/autotest_common.sh@1220 -- # return 0 00:22:44.419 02:05:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:44.419 02:05:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.419 02:05:18 -- common/autotest_common.sh@10 -- # set +x 00:22:44.419 02:05:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.419 02:05:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:44.419 02:05:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:22:44.419 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:22:44.419 02:05:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:22:44.419 02:05:18 -- common/autotest_common.sh@1208 -- # local i=0 00:22:44.419 02:05:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:44.419 02:05:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:22:44.419 02:05:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:44.419 02:05:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:22:44.419 02:05:18 -- common/autotest_common.sh@1220 -- # return 0 00:22:44.419 02:05:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:22:44.419 02:05:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.419 02:05:18 -- common/autotest_common.sh@10 -- # set +x 00:22:44.419 02:05:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.419 02:05:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:44.419 02:05:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:22:44.677 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:22:44.677 02:05:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:22:44.677 02:05:19 -- common/autotest_common.sh@1208 -- # local i=0 00:22:44.677 02:05:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:44.677 02:05:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:22:44.677 02:05:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:44.677 02:05:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:22:44.677 02:05:19 -- common/autotest_common.sh@1220 -- # return 0 00:22:44.677 02:05:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:22:44.677 02:05:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.677 02:05:19 -- common/autotest_common.sh@10 -- # set +x 00:22:44.677 02:05:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.677 02:05:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:44.677 02:05:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:22:44.942 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:22:44.943 02:05:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:22:44.943 02:05:19 -- common/autotest_common.sh@1208 -- # local i=0 00:22:44.943 02:05:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:44.943 02:05:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:22:44.943 02:05:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:44.943 02:05:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:22:44.943 02:05:19 -- common/autotest_common.sh@1220 -- # return 0 00:22:44.943 02:05:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:22:44.943 02:05:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.943 02:05:19 -- common/autotest_common.sh@10 -- # set +x 00:22:44.943 02:05:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.943 02:05:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:44.943 02:05:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:22:45.203 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:22:45.203 02:05:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:22:45.203 02:05:19 -- common/autotest_common.sh@1208 -- # local i=0 00:22:45.203 02:05:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:45.203 02:05:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:22:45.203 02:05:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:45.203 02:05:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:22:45.203 02:05:19 -- common/autotest_common.sh@1220 -- # return 0 00:22:45.203 02:05:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:22:45.203 02:05:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.203 02:05:19 -- common/autotest_common.sh@10 -- # set +x 00:22:45.203 02:05:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.203 02:05:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:45.203 02:05:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:22:45.461 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:22:45.461 02:05:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:22:45.461 02:05:19 -- common/autotest_common.sh@1208 -- # local i=0 00:22:45.461 02:05:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:45.461 02:05:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:22:45.461 02:05:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:45.461 02:05:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:22:45.461 02:05:19 -- common/autotest_common.sh@1220 -- # return 0 00:22:45.461 02:05:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:22:45.461 02:05:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.461 02:05:19 -- common/autotest_common.sh@10 -- # set +x 00:22:45.461 02:05:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.461 02:05:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:45.461 02:05:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:22:45.719 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:22:45.719 02:05:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:22:45.719 02:05:19 -- common/autotest_common.sh@1208 -- # local i=0 00:22:45.719 02:05:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:45.719 02:05:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:22:45.719 02:05:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:45.719 02:05:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:22:45.719 02:05:19 -- common/autotest_common.sh@1220 -- # return 0 00:22:45.719 02:05:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:22:45.719 02:05:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.719 02:05:19 -- common/autotest_common.sh@10 -- # set +x 00:22:45.719 02:05:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.719 02:05:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:45.719 02:05:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:22:45.978 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:22:45.978 02:05:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:22:45.978 02:05:20 -- common/autotest_common.sh@1208 -- # local i=0 00:22:45.978 02:05:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:45.978 02:05:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:22:45.978 02:05:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:45.978 02:05:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:22:45.978 02:05:20 -- common/autotest_common.sh@1220 -- # return 0 00:22:45.978 02:05:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:22:45.978 02:05:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.978 02:05:20 -- common/autotest_common.sh@10 -- # set +x 00:22:45.978 02:05:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.978 02:05:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:45.978 02:05:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:22:45.978 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:22:45.978 02:05:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:22:45.978 02:05:20 -- common/autotest_common.sh@1208 -- # local i=0 00:22:45.978 02:05:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:45.978 02:05:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:22:46.236 02:05:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:46.236 02:05:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:22:46.236 02:05:20 -- common/autotest_common.sh@1220 -- # return 0 00:22:46.236 02:05:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:22:46.236 02:05:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.236 02:05:20 -- common/autotest_common.sh@10 -- # set +x 00:22:46.236 02:05:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.236 02:05:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:46.236 02:05:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:22:46.236 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:22:46.236 02:05:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:22:46.236 02:05:20 -- common/autotest_common.sh@1208 -- # local i=0 00:22:46.236 02:05:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:46.236 02:05:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:22:46.236 02:05:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:46.236 02:05:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:22:46.236 02:05:20 -- common/autotest_common.sh@1220 -- # return 0 00:22:46.236 02:05:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:22:46.236 02:05:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.236 02:05:20 -- common/autotest_common.sh@10 -- # set +x 00:22:46.236 02:05:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.236 02:05:20 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:22:46.236 02:05:20 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:22:46.236 02:05:20 -- target/multiconnection.sh@47 -- # nvmftestfini 00:22:46.236 02:05:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:46.236 02:05:20 -- nvmf/common.sh@116 -- # sync 00:22:46.236 02:05:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:46.236 02:05:20 -- nvmf/common.sh@119 -- # set +e 00:22:46.236 02:05:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:46.236 02:05:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:46.236 rmmod nvme_tcp 00:22:46.236 rmmod nvme_fabrics 00:22:46.236 rmmod nvme_keyring 00:22:46.236 02:05:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:46.236 02:05:20 -- nvmf/common.sh@123 -- # set -e 00:22:46.236 02:05:20 -- nvmf/common.sh@124 -- # return 0 00:22:46.236 02:05:20 -- nvmf/common.sh@477 -- # '[' -n 1250119 ']' 00:22:46.236 02:05:20 -- nvmf/common.sh@478 -- # killprocess 1250119 00:22:46.236 02:05:20 -- common/autotest_common.sh@936 -- # '[' -z 1250119 ']' 00:22:46.236 02:05:20 -- common/autotest_common.sh@940 -- # kill -0 1250119 00:22:46.236 02:05:20 -- common/autotest_common.sh@941 -- # uname 00:22:46.236 02:05:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:46.237 02:05:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1250119 00:22:46.237 02:05:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:46.237 02:05:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:46.237 02:05:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1250119' 00:22:46.237 killing process with pid 1250119 00:22:46.237 02:05:20 -- common/autotest_common.sh@955 -- # kill 1250119 00:22:46.237 02:05:20 -- common/autotest_common.sh@960 -- # wait 1250119 00:22:46.804 02:05:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:46.804 02:05:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:46.804 02:05:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:46.804 02:05:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:46.804 02:05:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:46.804 02:05:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:46.804 02:05:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:46.804 02:05:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:49.342 02:05:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:49.342 00:22:49.342 real 1m1.654s 00:22:49.342 user 3m26.389s 00:22:49.342 sys 0m25.871s 00:22:49.342 02:05:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:49.342 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:22:49.342 ************************************ 00:22:49.342 END TEST nvmf_multiconnection 00:22:49.342 ************************************ 00:22:49.342 02:05:23 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:49.342 02:05:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:49.342 02:05:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:49.342 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:22:49.342 ************************************ 00:22:49.342 START TEST nvmf_initiator_timeout 00:22:49.342 ************************************ 00:22:49.342 02:05:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:49.342 * Looking for test storage... 00:22:49.342 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:49.342 02:05:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:49.342 02:05:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:49.342 02:05:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:49.342 02:05:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:49.342 02:05:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:49.342 02:05:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:49.342 02:05:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:49.342 02:05:23 -- scripts/common.sh@335 -- # IFS=.-: 00:22:49.342 02:05:23 -- scripts/common.sh@335 -- # read -ra ver1 00:22:49.342 02:05:23 -- scripts/common.sh@336 -- # IFS=.-: 00:22:49.342 02:05:23 -- scripts/common.sh@336 -- # read -ra ver2 00:22:49.342 02:05:23 -- scripts/common.sh@337 -- # local 'op=<' 00:22:49.342 02:05:23 -- scripts/common.sh@339 -- # ver1_l=2 00:22:49.342 02:05:23 -- scripts/common.sh@340 -- # ver2_l=1 00:22:49.342 02:05:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:49.342 02:05:23 -- scripts/common.sh@343 -- # case "$op" in 00:22:49.342 02:05:23 -- scripts/common.sh@344 -- # : 1 00:22:49.342 02:05:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:49.342 02:05:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:49.342 02:05:23 -- scripts/common.sh@364 -- # decimal 1 00:22:49.342 02:05:23 -- scripts/common.sh@352 -- # local d=1 00:22:49.342 02:05:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:49.342 02:05:23 -- scripts/common.sh@354 -- # echo 1 00:22:49.342 02:05:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:49.342 02:05:23 -- scripts/common.sh@365 -- # decimal 2 00:22:49.342 02:05:23 -- scripts/common.sh@352 -- # local d=2 00:22:49.342 02:05:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:49.342 02:05:23 -- scripts/common.sh@354 -- # echo 2 00:22:49.342 02:05:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:49.342 02:05:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:49.342 02:05:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:49.342 02:05:23 -- scripts/common.sh@367 -- # return 0 00:22:49.342 02:05:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:49.342 02:05:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:49.342 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:49.342 --rc genhtml_branch_coverage=1 00:22:49.342 --rc genhtml_function_coverage=1 00:22:49.342 --rc genhtml_legend=1 00:22:49.342 --rc geninfo_all_blocks=1 00:22:49.342 --rc geninfo_unexecuted_blocks=1 00:22:49.342 00:22:49.342 ' 00:22:49.342 02:05:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:49.342 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:49.342 --rc genhtml_branch_coverage=1 00:22:49.342 --rc genhtml_function_coverage=1 00:22:49.342 --rc genhtml_legend=1 00:22:49.342 --rc geninfo_all_blocks=1 00:22:49.342 --rc geninfo_unexecuted_blocks=1 00:22:49.342 00:22:49.342 ' 00:22:49.342 02:05:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:49.342 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:49.342 --rc genhtml_branch_coverage=1 00:22:49.342 --rc genhtml_function_coverage=1 00:22:49.342 --rc genhtml_legend=1 00:22:49.342 --rc geninfo_all_blocks=1 00:22:49.342 --rc geninfo_unexecuted_blocks=1 00:22:49.342 00:22:49.342 ' 00:22:49.342 02:05:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:49.342 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:49.342 --rc genhtml_branch_coverage=1 00:22:49.342 --rc genhtml_function_coverage=1 00:22:49.342 --rc genhtml_legend=1 00:22:49.342 --rc geninfo_all_blocks=1 00:22:49.342 --rc geninfo_unexecuted_blocks=1 00:22:49.342 00:22:49.342 ' 00:22:49.342 02:05:23 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:49.342 02:05:23 -- nvmf/common.sh@7 -- # uname -s 00:22:49.342 02:05:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:49.342 02:05:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:49.342 02:05:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:49.342 02:05:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:49.342 02:05:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:49.342 02:05:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:49.342 02:05:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:49.342 02:05:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:49.342 02:05:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:49.342 02:05:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:49.342 02:05:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:49.342 02:05:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:49.342 02:05:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:49.342 02:05:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:49.342 02:05:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:49.342 02:05:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:49.342 02:05:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:49.342 02:05:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:49.342 02:05:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:49.343 02:05:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:49.343 02:05:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:49.343 02:05:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:49.343 02:05:23 -- paths/export.sh@5 -- # export PATH 00:22:49.343 02:05:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:49.343 02:05:23 -- nvmf/common.sh@46 -- # : 0 00:22:49.343 02:05:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:49.343 02:05:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:49.343 02:05:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:49.343 02:05:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:49.343 02:05:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:49.343 02:05:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:49.343 02:05:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:49.343 02:05:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:49.343 02:05:23 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:49.343 02:05:23 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:49.343 02:05:23 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:22:49.343 02:05:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:49.343 02:05:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:49.343 02:05:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:49.343 02:05:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:49.343 02:05:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:49.343 02:05:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:49.343 02:05:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:49.343 02:05:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:49.343 02:05:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:49.343 02:05:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:49.343 02:05:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:49.343 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:22:51.246 02:05:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:51.246 02:05:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:51.246 02:05:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:51.246 02:05:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:51.246 02:05:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:51.246 02:05:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:51.246 02:05:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:51.246 02:05:25 -- nvmf/common.sh@294 -- # net_devs=() 00:22:51.246 02:05:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:51.246 02:05:25 -- nvmf/common.sh@295 -- # e810=() 00:22:51.246 02:05:25 -- nvmf/common.sh@295 -- # local -ga e810 00:22:51.246 02:05:25 -- nvmf/common.sh@296 -- # x722=() 00:22:51.246 02:05:25 -- nvmf/common.sh@296 -- # local -ga x722 00:22:51.246 02:05:25 -- nvmf/common.sh@297 -- # mlx=() 00:22:51.246 02:05:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:51.246 02:05:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:51.246 02:05:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:51.246 02:05:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:51.246 02:05:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:51.246 02:05:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:51.246 02:05:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:51.246 02:05:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:51.246 02:05:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:51.246 02:05:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:51.246 02:05:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:51.246 02:05:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:51.246 02:05:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:51.246 02:05:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:51.246 02:05:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:51.246 02:05:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:51.246 02:05:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:51.247 02:05:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:51.247 02:05:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:51.247 02:05:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:51.247 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:51.247 02:05:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:51.247 02:05:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:51.247 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:51.247 02:05:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:51.247 02:05:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:51.247 02:05:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.247 02:05:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:51.247 02:05:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.247 02:05:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:51.247 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:51.247 02:05:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.247 02:05:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:51.247 02:05:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.247 02:05:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:51.247 02:05:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.247 02:05:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:51.247 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:51.247 02:05:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.247 02:05:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:51.247 02:05:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:51.247 02:05:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:51.247 02:05:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:51.247 02:05:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:51.247 02:05:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:51.247 02:05:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:51.247 02:05:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:51.247 02:05:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:51.247 02:05:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:51.247 02:05:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:51.247 02:05:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:51.247 02:05:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:51.247 02:05:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:51.247 02:05:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:51.247 02:05:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:51.247 02:05:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:51.247 02:05:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:51.247 02:05:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:51.247 02:05:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:51.247 02:05:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:51.247 02:05:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:51.247 02:05:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:51.247 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:51.247 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.177 ms 00:22:51.247 00:22:51.247 --- 10.0.0.2 ping statistics --- 00:22:51.247 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:51.247 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:22:51.247 02:05:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:51.247 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:51.247 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:22:51.247 00:22:51.247 --- 10.0.0.1 ping statistics --- 00:22:51.247 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:51.247 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:22:51.247 02:05:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:51.247 02:05:25 -- nvmf/common.sh@410 -- # return 0 00:22:51.247 02:05:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:51.247 02:05:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:51.247 02:05:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:51.247 02:05:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:51.247 02:05:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:51.247 02:05:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:51.247 02:05:25 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:22:51.247 02:05:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:51.247 02:05:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:51.247 02:05:25 -- common/autotest_common.sh@10 -- # set +x 00:22:51.247 02:05:25 -- nvmf/common.sh@469 -- # nvmfpid=1259239 00:22:51.247 02:05:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:51.247 02:05:25 -- nvmf/common.sh@470 -- # waitforlisten 1259239 00:22:51.247 02:05:25 -- common/autotest_common.sh@829 -- # '[' -z 1259239 ']' 00:22:51.247 02:05:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:51.247 02:05:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:51.247 02:05:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:51.247 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:51.247 02:05:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:51.247 02:05:25 -- common/autotest_common.sh@10 -- # set +x 00:22:51.247 [2024-11-18 02:05:25.536694] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:22:51.247 [2024-11-18 02:05:25.536795] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:51.247 EAL: No free 2048 kB hugepages reported on node 1 00:22:51.247 [2024-11-18 02:05:25.605357] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:51.506 [2024-11-18 02:05:25.697820] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:51.506 [2024-11-18 02:05:25.698006] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:51.506 [2024-11-18 02:05:25.698027] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:51.506 [2024-11-18 02:05:25.698050] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:51.506 [2024-11-18 02:05:25.698144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:51.506 [2024-11-18 02:05:25.698199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:51.506 [2024-11-18 02:05:25.698253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:51.506 [2024-11-18 02:05:25.698256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:52.440 02:05:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:52.440 02:05:26 -- common/autotest_common.sh@862 -- # return 0 00:22:52.440 02:05:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:52.440 02:05:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:52.440 02:05:26 -- common/autotest_common.sh@10 -- # set +x 00:22:52.440 02:05:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:52.440 02:05:26 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:22:52.440 02:05:26 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:52.440 02:05:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.440 02:05:26 -- common/autotest_common.sh@10 -- # set +x 00:22:52.440 Malloc0 00:22:52.440 02:05:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.440 02:05:26 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:22:52.440 02:05:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.441 02:05:26 -- common/autotest_common.sh@10 -- # set +x 00:22:52.441 Delay0 00:22:52.441 02:05:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.441 02:05:26 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:52.441 02:05:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.441 02:05:26 -- common/autotest_common.sh@10 -- # set +x 00:22:52.441 [2024-11-18 02:05:26.540620] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:52.441 02:05:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.441 02:05:26 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:22:52.441 02:05:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.441 02:05:26 -- common/autotest_common.sh@10 -- # set +x 00:22:52.441 02:05:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.441 02:05:26 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:22:52.441 02:05:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.441 02:05:26 -- common/autotest_common.sh@10 -- # set +x 00:22:52.441 02:05:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.441 02:05:26 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:52.441 02:05:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.441 02:05:26 -- common/autotest_common.sh@10 -- # set +x 00:22:52.441 [2024-11-18 02:05:26.568887] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:52.441 02:05:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.441 02:05:26 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:53.007 02:05:27 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:22:53.007 02:05:27 -- common/autotest_common.sh@1187 -- # local i=0 00:22:53.007 02:05:27 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:53.007 02:05:27 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:53.007 02:05:27 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:54.913 02:05:29 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:54.913 02:05:29 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:54.913 02:05:29 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:22:54.913 02:05:29 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:54.913 02:05:29 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:54.913 02:05:29 -- common/autotest_common.sh@1197 -- # return 0 00:22:54.913 02:05:29 -- target/initiator_timeout.sh@35 -- # fio_pid=1259686 00:22:54.913 02:05:29 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:22:54.913 02:05:29 -- target/initiator_timeout.sh@37 -- # sleep 3 00:22:54.913 [global] 00:22:54.913 thread=1 00:22:54.913 invalidate=1 00:22:54.913 rw=write 00:22:54.913 time_based=1 00:22:54.913 runtime=60 00:22:54.913 ioengine=libaio 00:22:54.913 direct=1 00:22:54.913 bs=4096 00:22:54.913 iodepth=1 00:22:54.913 norandommap=0 00:22:54.913 numjobs=1 00:22:54.913 00:22:54.913 verify_dump=1 00:22:54.913 verify_backlog=512 00:22:54.913 verify_state_save=0 00:22:54.913 do_verify=1 00:22:54.913 verify=crc32c-intel 00:22:54.913 [job0] 00:22:54.913 filename=/dev/nvme0n1 00:22:54.913 Could not set queue depth (nvme0n1) 00:22:55.175 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:22:55.175 fio-3.35 00:22:55.175 Starting 1 thread 00:22:58.453 02:05:32 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:22:58.453 02:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.453 02:05:32 -- common/autotest_common.sh@10 -- # set +x 00:22:58.453 true 00:22:58.453 02:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.453 02:05:32 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:22:58.453 02:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.453 02:05:32 -- common/autotest_common.sh@10 -- # set +x 00:22:58.453 true 00:22:58.453 02:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.453 02:05:32 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:22:58.453 02:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.453 02:05:32 -- common/autotest_common.sh@10 -- # set +x 00:22:58.453 true 00:22:58.453 02:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.453 02:05:32 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:22:58.453 02:05:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.454 02:05:32 -- common/autotest_common.sh@10 -- # set +x 00:22:58.454 true 00:22:58.454 02:05:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.454 02:05:32 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:00.981 02:05:35 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:00.981 02:05:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.981 02:05:35 -- common/autotest_common.sh@10 -- # set +x 00:23:00.981 true 00:23:00.981 02:05:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.981 02:05:35 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:00.981 02:05:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.981 02:05:35 -- common/autotest_common.sh@10 -- # set +x 00:23:00.981 true 00:23:00.981 02:05:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.981 02:05:35 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:00.981 02:05:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.981 02:05:35 -- common/autotest_common.sh@10 -- # set +x 00:23:00.981 true 00:23:00.981 02:05:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.981 02:05:35 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:00.981 02:05:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.981 02:05:35 -- common/autotest_common.sh@10 -- # set +x 00:23:00.981 true 00:23:00.981 02:05:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.981 02:05:35 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:00.981 02:05:35 -- target/initiator_timeout.sh@54 -- # wait 1259686 00:23:57.249 00:23:57.249 job0: (groupid=0, jobs=1): err= 0: pid=1259849: Mon Nov 18 02:06:29 2024 00:23:57.249 read: IOPS=32, BW=130KiB/s (133kB/s)(7804KiB/60002msec) 00:23:57.249 slat (usec): min=5, max=5923, avg=19.01, stdev=133.97 00:23:57.249 clat (usec): min=229, max=40911k, avg=30460.74, stdev=926166.74 00:23:57.249 lat (usec): min=235, max=40911k, avg=30479.75, stdev=926166.91 00:23:57.249 clat percentiles (usec): 00:23:57.249 | 1.00th=[ 241], 5.00th=[ 251], 10.00th=[ 260], 00:23:57.249 | 20.00th=[ 269], 30.00th=[ 277], 40.00th=[ 285], 00:23:57.249 | 50.00th=[ 289], 60.00th=[ 297], 70.00th=[ 314], 00:23:57.249 | 80.00th=[ 41157], 90.00th=[ 41157], 95.00th=[ 42206], 00:23:57.249 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 43779], 00:23:57.249 | 99.95th=[17112761], 99.99th=[17112761] 00:23:57.249 write: IOPS=34, BW=137KiB/s (140kB/s)(8192KiB/60002msec); 0 zone resets 00:23:57.249 slat (usec): min=7, max=30939, avg=33.65, stdev=683.31 00:23:57.249 clat (usec): min=163, max=915, avg=218.68, stdev=38.10 00:23:57.249 lat (usec): min=170, max=31273, avg=252.33, stdev=687.02 00:23:57.249 clat percentiles (usec): 00:23:57.249 | 1.00th=[ 172], 5.00th=[ 180], 10.00th=[ 184], 20.00th=[ 194], 00:23:57.249 | 30.00th=[ 206], 40.00th=[ 212], 50.00th=[ 217], 60.00th=[ 223], 00:23:57.249 | 70.00th=[ 227], 80.00th=[ 235], 90.00th=[ 245], 95.00th=[ 269], 00:23:57.249 | 99.00th=[ 318], 99.50th=[ 326], 99.90th=[ 734], 99.95th=[ 914], 00:23:57.249 | 99.99th=[ 914] 00:23:57.249 bw ( KiB/s): min= 96, max= 8096, per=100.00%, avg=4096.00, stdev=3265.99, samples=4 00:23:57.249 iops : min= 24, max= 2024, avg=1024.00, stdev=816.50, samples=4 00:23:57.249 lat (usec) : 250=49.21%, 500=38.96%, 750=0.75%, 1000=0.08% 00:23:57.249 lat (msec) : 2=0.03%, 50=10.95%, >=2000=0.03% 00:23:57.249 cpu : usr=0.07%, sys=0.16%, ctx=4002, majf=0, minf=1 00:23:57.249 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:57.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:57.249 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:57.249 issued rwts: total=1951,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:57.249 latency : target=0, window=0, percentile=100.00%, depth=1 00:23:57.249 00:23:57.249 Run status group 0 (all jobs): 00:23:57.249 READ: bw=130KiB/s (133kB/s), 130KiB/s-130KiB/s (133kB/s-133kB/s), io=7804KiB (7991kB), run=60002-60002msec 00:23:57.249 WRITE: bw=137KiB/s (140kB/s), 137KiB/s-137KiB/s (140kB/s-140kB/s), io=8192KiB (8389kB), run=60002-60002msec 00:23:57.249 00:23:57.249 Disk stats (read/write): 00:23:57.249 nvme0n1: ios=2002/2048, merge=0/0, ticks=19931/437, in_queue=20368, util=99.65% 00:23:57.249 02:06:29 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:57.249 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:57.249 02:06:29 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:23:57.249 02:06:29 -- common/autotest_common.sh@1208 -- # local i=0 00:23:57.249 02:06:29 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:57.249 02:06:29 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:57.249 02:06:29 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:57.249 02:06:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:57.249 02:06:29 -- common/autotest_common.sh@1220 -- # return 0 00:23:57.249 02:06:29 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:23:57.249 02:06:29 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:23:57.249 nvmf hotplug test: fio successful as expected 00:23:57.249 02:06:29 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:57.249 02:06:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:57.249 02:06:29 -- common/autotest_common.sh@10 -- # set +x 00:23:57.249 02:06:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:57.249 02:06:29 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:23:57.249 02:06:29 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:23:57.249 02:06:29 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:23:57.249 02:06:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:57.249 02:06:29 -- nvmf/common.sh@116 -- # sync 00:23:57.249 02:06:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:57.249 02:06:29 -- nvmf/common.sh@119 -- # set +e 00:23:57.249 02:06:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:57.249 02:06:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:57.249 rmmod nvme_tcp 00:23:57.249 rmmod nvme_fabrics 00:23:57.249 rmmod nvme_keyring 00:23:57.249 02:06:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:57.249 02:06:29 -- nvmf/common.sh@123 -- # set -e 00:23:57.249 02:06:29 -- nvmf/common.sh@124 -- # return 0 00:23:57.249 02:06:29 -- nvmf/common.sh@477 -- # '[' -n 1259239 ']' 00:23:57.249 02:06:29 -- nvmf/common.sh@478 -- # killprocess 1259239 00:23:57.249 02:06:29 -- common/autotest_common.sh@936 -- # '[' -z 1259239 ']' 00:23:57.249 02:06:29 -- common/autotest_common.sh@940 -- # kill -0 1259239 00:23:57.249 02:06:29 -- common/autotest_common.sh@941 -- # uname 00:23:57.249 02:06:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:57.249 02:06:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1259239 00:23:57.249 02:06:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:57.249 02:06:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:57.249 02:06:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1259239' 00:23:57.249 killing process with pid 1259239 00:23:57.249 02:06:29 -- common/autotest_common.sh@955 -- # kill 1259239 00:23:57.249 02:06:29 -- common/autotest_common.sh@960 -- # wait 1259239 00:23:57.249 02:06:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:57.249 02:06:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:57.249 02:06:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:57.249 02:06:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:57.249 02:06:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:57.249 02:06:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:57.249 02:06:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:57.249 02:06:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:57.817 02:06:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:57.817 00:23:57.817 real 1m8.802s 00:23:57.817 user 4m13.486s 00:23:57.817 sys 0m6.586s 00:23:57.817 02:06:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:57.817 02:06:32 -- common/autotest_common.sh@10 -- # set +x 00:23:57.817 ************************************ 00:23:57.817 END TEST nvmf_initiator_timeout 00:23:57.817 ************************************ 00:23:57.817 02:06:32 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:23:57.817 02:06:32 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:23:57.817 02:06:32 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:23:57.817 02:06:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:57.817 02:06:32 -- common/autotest_common.sh@10 -- # set +x 00:23:59.718 02:06:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:59.718 02:06:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:59.718 02:06:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:59.718 02:06:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:59.718 02:06:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:59.718 02:06:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:59.718 02:06:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:59.718 02:06:34 -- nvmf/common.sh@294 -- # net_devs=() 00:23:59.718 02:06:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:59.718 02:06:34 -- nvmf/common.sh@295 -- # e810=() 00:23:59.718 02:06:34 -- nvmf/common.sh@295 -- # local -ga e810 00:23:59.718 02:06:34 -- nvmf/common.sh@296 -- # x722=() 00:23:59.718 02:06:34 -- nvmf/common.sh@296 -- # local -ga x722 00:23:59.719 02:06:34 -- nvmf/common.sh@297 -- # mlx=() 00:23:59.719 02:06:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:59.719 02:06:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:59.719 02:06:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:59.719 02:06:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:59.719 02:06:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:59.719 02:06:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:59.719 02:06:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:59.719 02:06:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:59.719 02:06:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:59.719 02:06:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:59.719 02:06:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:59.719 02:06:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:59.719 02:06:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:59.719 02:06:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:59.719 02:06:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:59.719 02:06:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:59.719 02:06:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:59.719 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:59.719 02:06:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:59.719 02:06:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:59.719 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:59.719 02:06:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:59.719 02:06:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:59.719 02:06:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:59.719 02:06:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:59.719 02:06:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:59.719 02:06:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:59.719 02:06:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:59.719 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:59.719 02:06:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:59.719 02:06:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:59.719 02:06:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:59.719 02:06:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:59.719 02:06:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:59.719 02:06:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:59.719 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:59.719 02:06:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:59.719 02:06:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:59.719 02:06:34 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:59.719 02:06:34 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:23:59.719 02:06:34 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:23:59.719 02:06:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:59.719 02:06:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:59.719 02:06:34 -- common/autotest_common.sh@10 -- # set +x 00:23:59.719 ************************************ 00:23:59.719 START TEST nvmf_perf_adq 00:23:59.719 ************************************ 00:23:59.719 02:06:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:23:59.719 * Looking for test storage... 00:23:59.719 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:59.719 02:06:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:59.719 02:06:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:59.719 02:06:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:59.978 02:06:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:59.978 02:06:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:59.978 02:06:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:59.978 02:06:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:59.978 02:06:34 -- scripts/common.sh@335 -- # IFS=.-: 00:23:59.978 02:06:34 -- scripts/common.sh@335 -- # read -ra ver1 00:23:59.978 02:06:34 -- scripts/common.sh@336 -- # IFS=.-: 00:23:59.978 02:06:34 -- scripts/common.sh@336 -- # read -ra ver2 00:23:59.978 02:06:34 -- scripts/common.sh@337 -- # local 'op=<' 00:23:59.978 02:06:34 -- scripts/common.sh@339 -- # ver1_l=2 00:23:59.978 02:06:34 -- scripts/common.sh@340 -- # ver2_l=1 00:23:59.978 02:06:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:59.978 02:06:34 -- scripts/common.sh@343 -- # case "$op" in 00:23:59.978 02:06:34 -- scripts/common.sh@344 -- # : 1 00:23:59.978 02:06:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:59.978 02:06:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:59.978 02:06:34 -- scripts/common.sh@364 -- # decimal 1 00:23:59.978 02:06:34 -- scripts/common.sh@352 -- # local d=1 00:23:59.978 02:06:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:59.978 02:06:34 -- scripts/common.sh@354 -- # echo 1 00:23:59.978 02:06:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:59.978 02:06:34 -- scripts/common.sh@365 -- # decimal 2 00:23:59.978 02:06:34 -- scripts/common.sh@352 -- # local d=2 00:23:59.978 02:06:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:59.978 02:06:34 -- scripts/common.sh@354 -- # echo 2 00:23:59.978 02:06:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:59.978 02:06:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:59.978 02:06:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:59.978 02:06:34 -- scripts/common.sh@367 -- # return 0 00:23:59.978 02:06:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:59.978 02:06:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:59.978 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:59.978 --rc genhtml_branch_coverage=1 00:23:59.978 --rc genhtml_function_coverage=1 00:23:59.978 --rc genhtml_legend=1 00:23:59.978 --rc geninfo_all_blocks=1 00:23:59.978 --rc geninfo_unexecuted_blocks=1 00:23:59.978 00:23:59.978 ' 00:23:59.978 02:06:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:59.978 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:59.978 --rc genhtml_branch_coverage=1 00:23:59.978 --rc genhtml_function_coverage=1 00:23:59.978 --rc genhtml_legend=1 00:23:59.978 --rc geninfo_all_blocks=1 00:23:59.978 --rc geninfo_unexecuted_blocks=1 00:23:59.978 00:23:59.978 ' 00:23:59.978 02:06:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:59.978 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:59.978 --rc genhtml_branch_coverage=1 00:23:59.978 --rc genhtml_function_coverage=1 00:23:59.978 --rc genhtml_legend=1 00:23:59.978 --rc geninfo_all_blocks=1 00:23:59.978 --rc geninfo_unexecuted_blocks=1 00:23:59.978 00:23:59.978 ' 00:23:59.978 02:06:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:59.978 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:59.978 --rc genhtml_branch_coverage=1 00:23:59.978 --rc genhtml_function_coverage=1 00:23:59.978 --rc genhtml_legend=1 00:23:59.978 --rc geninfo_all_blocks=1 00:23:59.978 --rc geninfo_unexecuted_blocks=1 00:23:59.978 00:23:59.978 ' 00:23:59.978 02:06:34 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:59.978 02:06:34 -- nvmf/common.sh@7 -- # uname -s 00:23:59.979 02:06:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:59.979 02:06:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:59.979 02:06:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:59.979 02:06:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:59.979 02:06:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:59.979 02:06:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:59.979 02:06:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:59.979 02:06:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:59.979 02:06:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:59.979 02:06:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:59.979 02:06:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:59.979 02:06:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:59.979 02:06:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:59.979 02:06:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:59.979 02:06:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:59.979 02:06:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:59.979 02:06:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:59.979 02:06:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:59.979 02:06:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:59.979 02:06:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:59.979 02:06:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:59.979 02:06:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:59.979 02:06:34 -- paths/export.sh@5 -- # export PATH 00:23:59.979 02:06:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:59.979 02:06:34 -- nvmf/common.sh@46 -- # : 0 00:23:59.979 02:06:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:59.979 02:06:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:59.979 02:06:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:59.979 02:06:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:59.979 02:06:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:59.979 02:06:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:59.979 02:06:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:59.979 02:06:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:59.979 02:06:34 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:23:59.979 02:06:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:59.979 02:06:34 -- common/autotest_common.sh@10 -- # set +x 00:24:02.510 02:06:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:02.510 02:06:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:02.510 02:06:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:02.510 02:06:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:02.510 02:06:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:02.510 02:06:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:02.510 02:06:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:02.510 02:06:36 -- nvmf/common.sh@294 -- # net_devs=() 00:24:02.510 02:06:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:02.510 02:06:36 -- nvmf/common.sh@295 -- # e810=() 00:24:02.510 02:06:36 -- nvmf/common.sh@295 -- # local -ga e810 00:24:02.510 02:06:36 -- nvmf/common.sh@296 -- # x722=() 00:24:02.510 02:06:36 -- nvmf/common.sh@296 -- # local -ga x722 00:24:02.510 02:06:36 -- nvmf/common.sh@297 -- # mlx=() 00:24:02.510 02:06:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:02.510 02:06:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:02.510 02:06:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:02.510 02:06:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:02.510 02:06:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:02.510 02:06:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:02.510 02:06:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:02.510 02:06:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:02.510 02:06:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:02.510 02:06:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:02.510 02:06:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:02.510 02:06:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:02.510 02:06:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:02.510 02:06:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:02.510 02:06:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:02.510 02:06:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:02.510 02:06:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:02.510 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:02.510 02:06:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:02.510 02:06:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:02.510 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:02.510 02:06:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:02.510 02:06:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:02.510 02:06:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:02.510 02:06:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:02.510 02:06:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:02.510 02:06:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:02.510 02:06:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:02.510 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:02.510 02:06:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:02.510 02:06:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:02.510 02:06:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:02.510 02:06:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:02.510 02:06:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:02.510 02:06:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:02.510 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:02.510 02:06:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:02.510 02:06:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:02.510 02:06:36 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:02.510 02:06:36 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:02.510 02:06:36 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:02.510 02:06:36 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:02.510 02:06:36 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:02.769 02:06:37 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:05.300 02:06:39 -- target/perf_adq.sh@54 -- # sleep 5 00:24:10.575 02:06:44 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:10.575 02:06:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:10.575 02:06:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:10.575 02:06:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:10.575 02:06:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:10.575 02:06:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:10.575 02:06:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:10.575 02:06:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:10.575 02:06:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:10.575 02:06:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:10.575 02:06:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:10.575 02:06:44 -- common/autotest_common.sh@10 -- # set +x 00:24:10.575 02:06:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:10.575 02:06:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:10.575 02:06:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:10.575 02:06:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:10.575 02:06:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:10.575 02:06:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:10.575 02:06:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:10.575 02:06:44 -- nvmf/common.sh@294 -- # net_devs=() 00:24:10.575 02:06:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:10.575 02:06:44 -- nvmf/common.sh@295 -- # e810=() 00:24:10.575 02:06:44 -- nvmf/common.sh@295 -- # local -ga e810 00:24:10.575 02:06:44 -- nvmf/common.sh@296 -- # x722=() 00:24:10.575 02:06:44 -- nvmf/common.sh@296 -- # local -ga x722 00:24:10.575 02:06:44 -- nvmf/common.sh@297 -- # mlx=() 00:24:10.575 02:06:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:10.575 02:06:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:10.575 02:06:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:10.575 02:06:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:10.575 02:06:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:10.575 02:06:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:10.575 02:06:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:10.575 02:06:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:10.575 02:06:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:10.575 02:06:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:10.575 02:06:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:10.575 02:06:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:10.575 02:06:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:10.575 02:06:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:10.575 02:06:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:10.575 02:06:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:10.575 02:06:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:10.575 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:10.575 02:06:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:10.575 02:06:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:10.575 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:10.575 02:06:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:10.575 02:06:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:10.575 02:06:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:10.575 02:06:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:10.575 02:06:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:10.575 02:06:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:10.575 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:10.575 02:06:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:10.575 02:06:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:10.575 02:06:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:10.575 02:06:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:10.575 02:06:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:10.575 02:06:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:10.575 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:10.575 02:06:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:10.575 02:06:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:10.575 02:06:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:10.575 02:06:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:10.575 02:06:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:10.575 02:06:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:10.575 02:06:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:10.575 02:06:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:10.575 02:06:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:10.575 02:06:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:10.576 02:06:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:10.576 02:06:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:10.576 02:06:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:10.576 02:06:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:10.576 02:06:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:10.576 02:06:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:10.576 02:06:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:10.576 02:06:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:10.576 02:06:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:10.576 02:06:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:10.576 02:06:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:10.576 02:06:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:10.576 02:06:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:10.576 02:06:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:10.576 02:06:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:10.576 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:10.576 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:24:10.576 00:24:10.576 --- 10.0.0.2 ping statistics --- 00:24:10.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:10.576 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:24:10.576 02:06:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:10.576 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:10.576 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.087 ms 00:24:10.576 00:24:10.576 --- 10.0.0.1 ping statistics --- 00:24:10.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:10.576 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:24:10.576 02:06:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:10.576 02:06:44 -- nvmf/common.sh@410 -- # return 0 00:24:10.576 02:06:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:10.576 02:06:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:10.576 02:06:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:10.576 02:06:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:10.576 02:06:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:10.576 02:06:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:10.576 02:06:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:10.576 02:06:44 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:10.576 02:06:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:10.576 02:06:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:10.576 02:06:44 -- common/autotest_common.sh@10 -- # set +x 00:24:10.576 02:06:44 -- nvmf/common.sh@469 -- # nvmfpid=1272418 00:24:10.576 02:06:44 -- nvmf/common.sh@470 -- # waitforlisten 1272418 00:24:10.576 02:06:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:10.576 02:06:44 -- common/autotest_common.sh@829 -- # '[' -z 1272418 ']' 00:24:10.576 02:06:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:10.576 02:06:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:10.576 02:06:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:10.576 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:10.576 02:06:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:10.576 02:06:44 -- common/autotest_common.sh@10 -- # set +x 00:24:10.576 [2024-11-18 02:06:44.975860] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:10.576 [2024-11-18 02:06:44.975949] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:10.834 EAL: No free 2048 kB hugepages reported on node 1 00:24:10.834 [2024-11-18 02:06:45.054601] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:10.834 [2024-11-18 02:06:45.154785] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:10.834 [2024-11-18 02:06:45.154947] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:10.834 [2024-11-18 02:06:45.154967] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:10.834 [2024-11-18 02:06:45.154981] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:10.834 [2024-11-18 02:06:45.155049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:10.834 [2024-11-18 02:06:45.155084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:10.834 [2024-11-18 02:06:45.155140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:10.834 [2024-11-18 02:06:45.155143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:10.834 02:06:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:10.834 02:06:45 -- common/autotest_common.sh@862 -- # return 0 00:24:10.834 02:06:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:10.834 02:06:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:10.834 02:06:45 -- common/autotest_common.sh@10 -- # set +x 00:24:11.093 02:06:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:11.093 02:06:45 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:11.093 02:06:45 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:11.093 02:06:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:11.093 02:06:45 -- common/autotest_common.sh@10 -- # set +x 00:24:11.093 02:06:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:11.093 02:06:45 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:11.093 02:06:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:11.093 02:06:45 -- common/autotest_common.sh@10 -- # set +x 00:24:11.093 02:06:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:11.093 02:06:45 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:11.093 02:06:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:11.093 02:06:45 -- common/autotest_common.sh@10 -- # set +x 00:24:11.093 [2024-11-18 02:06:45.381195] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:11.093 02:06:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:11.093 02:06:45 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:11.093 02:06:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:11.093 02:06:45 -- common/autotest_common.sh@10 -- # set +x 00:24:11.093 Malloc1 00:24:11.093 02:06:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:11.093 02:06:45 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:11.093 02:06:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:11.093 02:06:45 -- common/autotest_common.sh@10 -- # set +x 00:24:11.093 02:06:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:11.093 02:06:45 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:11.093 02:06:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:11.093 02:06:45 -- common/autotest_common.sh@10 -- # set +x 00:24:11.093 02:06:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:11.093 02:06:45 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:11.093 02:06:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:11.093 02:06:45 -- common/autotest_common.sh@10 -- # set +x 00:24:11.093 [2024-11-18 02:06:45.432723] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:11.093 02:06:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:11.093 02:06:45 -- target/perf_adq.sh@73 -- # perfpid=1272452 00:24:11.093 02:06:45 -- target/perf_adq.sh@74 -- # sleep 2 00:24:11.093 02:06:45 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:11.093 EAL: No free 2048 kB hugepages reported on node 1 00:24:13.623 02:06:47 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:13.624 02:06:47 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:13.624 02:06:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:13.624 02:06:47 -- target/perf_adq.sh@76 -- # wc -l 00:24:13.624 02:06:47 -- common/autotest_common.sh@10 -- # set +x 00:24:13.624 02:06:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:13.624 02:06:47 -- target/perf_adq.sh@76 -- # count=4 00:24:13.624 02:06:47 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:13.624 02:06:47 -- target/perf_adq.sh@81 -- # wait 1272452 00:24:21.747 Initializing NVMe Controllers 00:24:21.747 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:21.747 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:21.747 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:21.747 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:21.747 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:21.747 Initialization complete. Launching workers. 00:24:21.747 ======================================================== 00:24:21.747 Latency(us) 00:24:21.747 Device Information : IOPS MiB/s Average min max 00:24:21.747 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11246.92 43.93 5692.81 1605.10 9769.27 00:24:21.747 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11298.62 44.14 5666.32 1399.60 9645.16 00:24:21.747 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11181.23 43.68 5725.00 1697.46 9650.22 00:24:21.747 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11128.53 43.47 5752.83 1507.29 9638.49 00:24:21.747 ======================================================== 00:24:21.747 Total : 44855.30 175.22 5709.05 1399.60 9769.27 00:24:21.747 00:24:21.747 02:06:55 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:21.747 02:06:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:21.747 02:06:55 -- nvmf/common.sh@116 -- # sync 00:24:21.747 02:06:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:21.747 02:06:55 -- nvmf/common.sh@119 -- # set +e 00:24:21.747 02:06:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:21.747 02:06:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:21.747 rmmod nvme_tcp 00:24:21.747 rmmod nvme_fabrics 00:24:21.747 rmmod nvme_keyring 00:24:21.747 02:06:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:21.747 02:06:55 -- nvmf/common.sh@123 -- # set -e 00:24:21.747 02:06:55 -- nvmf/common.sh@124 -- # return 0 00:24:21.747 02:06:55 -- nvmf/common.sh@477 -- # '[' -n 1272418 ']' 00:24:21.747 02:06:55 -- nvmf/common.sh@478 -- # killprocess 1272418 00:24:21.747 02:06:55 -- common/autotest_common.sh@936 -- # '[' -z 1272418 ']' 00:24:21.747 02:06:55 -- common/autotest_common.sh@940 -- # kill -0 1272418 00:24:21.747 02:06:55 -- common/autotest_common.sh@941 -- # uname 00:24:21.747 02:06:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:21.747 02:06:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1272418 00:24:21.747 02:06:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:21.747 02:06:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:21.747 02:06:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1272418' 00:24:21.747 killing process with pid 1272418 00:24:21.747 02:06:55 -- common/autotest_common.sh@955 -- # kill 1272418 00:24:21.747 02:06:55 -- common/autotest_common.sh@960 -- # wait 1272418 00:24:21.747 02:06:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:21.747 02:06:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:21.747 02:06:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:21.747 02:06:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:21.747 02:06:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:21.747 02:06:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:21.747 02:06:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:21.747 02:06:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:23.649 02:06:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:23.649 02:06:57 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:23.649 02:06:57 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:24.584 02:06:58 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:27.113 02:07:01 -- target/perf_adq.sh@54 -- # sleep 5 00:24:32.380 02:07:06 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:32.380 02:07:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:32.380 02:07:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:32.380 02:07:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:32.380 02:07:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:32.380 02:07:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:32.380 02:07:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:32.380 02:07:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:32.380 02:07:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:32.380 02:07:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:32.380 02:07:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:32.380 02:07:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:32.380 02:07:06 -- common/autotest_common.sh@10 -- # set +x 00:24:32.380 02:07:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:32.380 02:07:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:32.380 02:07:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:32.380 02:07:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:32.380 02:07:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:32.380 02:07:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:32.380 02:07:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:32.380 02:07:06 -- nvmf/common.sh@294 -- # net_devs=() 00:24:32.380 02:07:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:32.380 02:07:06 -- nvmf/common.sh@295 -- # e810=() 00:24:32.380 02:07:06 -- nvmf/common.sh@295 -- # local -ga e810 00:24:32.380 02:07:06 -- nvmf/common.sh@296 -- # x722=() 00:24:32.380 02:07:06 -- nvmf/common.sh@296 -- # local -ga x722 00:24:32.380 02:07:06 -- nvmf/common.sh@297 -- # mlx=() 00:24:32.380 02:07:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:32.380 02:07:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:32.380 02:07:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:32.380 02:07:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:32.380 02:07:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:32.380 02:07:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:32.380 02:07:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:32.380 02:07:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:32.380 02:07:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:32.381 02:07:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:32.381 02:07:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:32.381 02:07:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:32.381 02:07:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:32.381 02:07:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:32.381 02:07:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:32.381 02:07:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:32.381 02:07:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:32.381 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:32.381 02:07:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:32.381 02:07:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:32.381 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:32.381 02:07:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:32.381 02:07:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:32.381 02:07:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:32.381 02:07:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:32.381 02:07:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:32.381 02:07:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:32.381 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:32.381 02:07:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:32.381 02:07:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:32.381 02:07:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:32.381 02:07:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:32.381 02:07:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:32.381 02:07:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:32.381 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:32.381 02:07:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:32.381 02:07:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:32.381 02:07:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:32.381 02:07:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:32.381 02:07:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:32.381 02:07:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:32.381 02:07:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:32.381 02:07:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:32.381 02:07:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:32.381 02:07:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:32.381 02:07:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:32.381 02:07:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:32.381 02:07:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:32.381 02:07:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:32.381 02:07:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:32.381 02:07:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:32.381 02:07:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:32.381 02:07:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:32.381 02:07:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:32.381 02:07:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:32.381 02:07:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:32.381 02:07:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:32.381 02:07:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:32.381 02:07:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:32.381 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:32.381 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:24:32.381 00:24:32.381 --- 10.0.0.2 ping statistics --- 00:24:32.381 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:32.381 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:24:32.381 02:07:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:32.381 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:32.381 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.135 ms 00:24:32.381 00:24:32.381 --- 10.0.0.1 ping statistics --- 00:24:32.381 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:32.381 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:24:32.381 02:07:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:32.381 02:07:06 -- nvmf/common.sh@410 -- # return 0 00:24:32.381 02:07:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:32.381 02:07:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:32.381 02:07:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:32.381 02:07:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:32.381 02:07:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:32.381 02:07:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:32.381 02:07:06 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:32.381 02:07:06 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:32.381 02:07:06 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:32.381 02:07:06 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:32.381 net.core.busy_poll = 1 00:24:32.381 02:07:06 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:32.381 net.core.busy_read = 1 00:24:32.381 02:07:06 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:32.381 02:07:06 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:32.381 02:07:06 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:32.381 02:07:06 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:32.381 02:07:06 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:32.381 02:07:06 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:32.381 02:07:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:32.381 02:07:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:32.381 02:07:06 -- common/autotest_common.sh@10 -- # set +x 00:24:32.381 02:07:06 -- nvmf/common.sh@469 -- # nvmfpid=1275162 00:24:32.381 02:07:06 -- nvmf/common.sh@470 -- # waitforlisten 1275162 00:24:32.381 02:07:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:32.381 02:07:06 -- common/autotest_common.sh@829 -- # '[' -z 1275162 ']' 00:24:32.381 02:07:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:32.381 02:07:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:32.381 02:07:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:32.381 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:32.381 02:07:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:32.381 02:07:06 -- common/autotest_common.sh@10 -- # set +x 00:24:32.381 [2024-11-18 02:07:06.435844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:32.381 [2024-11-18 02:07:06.435934] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:32.381 EAL: No free 2048 kB hugepages reported on node 1 00:24:32.381 [2024-11-18 02:07:06.503927] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:32.381 [2024-11-18 02:07:06.587813] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:32.381 [2024-11-18 02:07:06.587963] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:32.381 [2024-11-18 02:07:06.587981] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:32.381 [2024-11-18 02:07:06.587993] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:32.381 [2024-11-18 02:07:06.588053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:32.381 [2024-11-18 02:07:06.588115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:32.381 [2024-11-18 02:07:06.588180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:32.381 [2024-11-18 02:07:06.588183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:32.381 02:07:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:32.381 02:07:06 -- common/autotest_common.sh@862 -- # return 0 00:24:32.381 02:07:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:32.381 02:07:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:32.381 02:07:06 -- common/autotest_common.sh@10 -- # set +x 00:24:32.381 02:07:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:32.381 02:07:06 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:32.381 02:07:06 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:32.381 02:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.381 02:07:06 -- common/autotest_common.sh@10 -- # set +x 00:24:32.381 02:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.381 02:07:06 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:32.381 02:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.381 02:07:06 -- common/autotest_common.sh@10 -- # set +x 00:24:32.641 02:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.641 02:07:06 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:32.641 02:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.641 02:07:06 -- common/autotest_common.sh@10 -- # set +x 00:24:32.641 [2024-11-18 02:07:06.798334] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:32.641 02:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.641 02:07:06 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:32.641 02:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.641 02:07:06 -- common/autotest_common.sh@10 -- # set +x 00:24:32.641 Malloc1 00:24:32.641 02:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.641 02:07:06 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:32.641 02:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.641 02:07:06 -- common/autotest_common.sh@10 -- # set +x 00:24:32.641 02:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.641 02:07:06 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:32.641 02:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.641 02:07:06 -- common/autotest_common.sh@10 -- # set +x 00:24:32.641 02:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.641 02:07:06 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:32.641 02:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.641 02:07:06 -- common/autotest_common.sh@10 -- # set +x 00:24:32.641 [2024-11-18 02:07:06.851593] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:32.641 02:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.641 02:07:06 -- target/perf_adq.sh@94 -- # perfpid=1275292 00:24:32.641 02:07:06 -- target/perf_adq.sh@95 -- # sleep 2 00:24:32.641 02:07:06 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:32.641 EAL: No free 2048 kB hugepages reported on node 1 00:24:34.542 02:07:08 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:24:34.542 02:07:08 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:24:34.543 02:07:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:34.543 02:07:08 -- target/perf_adq.sh@97 -- # wc -l 00:24:34.543 02:07:08 -- common/autotest_common.sh@10 -- # set +x 00:24:34.543 02:07:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:34.543 02:07:08 -- target/perf_adq.sh@97 -- # count=2 00:24:34.543 02:07:08 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:24:34.543 02:07:08 -- target/perf_adq.sh@103 -- # wait 1275292 00:24:44.517 Initializing NVMe Controllers 00:24:44.517 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:44.517 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:44.517 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:44.517 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:44.517 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:44.517 Initialization complete. Launching workers. 00:24:44.517 ======================================================== 00:24:44.517 Latency(us) 00:24:44.517 Device Information : IOPS MiB/s Average min max 00:24:44.517 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 4613.30 18.02 13918.15 2003.58 58280.39 00:24:44.517 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4834.80 18.89 13241.87 1988.94 58691.45 00:24:44.517 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5282.20 20.63 12119.80 2044.35 57730.46 00:24:44.517 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 14913.00 58.25 4291.34 1733.54 46546.23 00:24:44.517 ======================================================== 00:24:44.517 Total : 29643.30 115.79 8644.33 1733.54 58691.45 00:24:44.517 00:24:44.517 02:07:17 -- target/perf_adq.sh@104 -- # nvmftestfini 00:24:44.517 02:07:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:44.517 02:07:17 -- nvmf/common.sh@116 -- # sync 00:24:44.517 02:07:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:44.517 02:07:17 -- nvmf/common.sh@119 -- # set +e 00:24:44.517 02:07:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:44.517 02:07:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:44.517 rmmod nvme_tcp 00:24:44.517 rmmod nvme_fabrics 00:24:44.517 rmmod nvme_keyring 00:24:44.517 02:07:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:44.517 02:07:17 -- nvmf/common.sh@123 -- # set -e 00:24:44.517 02:07:17 -- nvmf/common.sh@124 -- # return 0 00:24:44.517 02:07:17 -- nvmf/common.sh@477 -- # '[' -n 1275162 ']' 00:24:44.517 02:07:17 -- nvmf/common.sh@478 -- # killprocess 1275162 00:24:44.517 02:07:17 -- common/autotest_common.sh@936 -- # '[' -z 1275162 ']' 00:24:44.517 02:07:17 -- common/autotest_common.sh@940 -- # kill -0 1275162 00:24:44.517 02:07:17 -- common/autotest_common.sh@941 -- # uname 00:24:44.517 02:07:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:44.517 02:07:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1275162 00:24:44.517 02:07:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:44.517 02:07:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:44.517 02:07:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1275162' 00:24:44.517 killing process with pid 1275162 00:24:44.517 02:07:17 -- common/autotest_common.sh@955 -- # kill 1275162 00:24:44.517 02:07:17 -- common/autotest_common.sh@960 -- # wait 1275162 00:24:44.517 02:07:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:44.517 02:07:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:44.517 02:07:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:44.517 02:07:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:44.517 02:07:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:44.517 02:07:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:44.517 02:07:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:44.517 02:07:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:46.425 02:07:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:46.425 02:07:20 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:24:46.425 00:24:46.425 real 0m46.445s 00:24:46.425 user 2m39.722s 00:24:46.425 sys 0m9.791s 00:24:46.425 02:07:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:46.425 02:07:20 -- common/autotest_common.sh@10 -- # set +x 00:24:46.425 ************************************ 00:24:46.425 END TEST nvmf_perf_adq 00:24:46.425 ************************************ 00:24:46.425 02:07:20 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:46.425 02:07:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:46.425 02:07:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:46.425 02:07:20 -- common/autotest_common.sh@10 -- # set +x 00:24:46.425 ************************************ 00:24:46.425 START TEST nvmf_shutdown 00:24:46.425 ************************************ 00:24:46.425 02:07:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:46.425 * Looking for test storage... 00:24:46.425 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:46.425 02:07:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:46.425 02:07:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:46.425 02:07:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:46.425 02:07:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:46.425 02:07:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:46.425 02:07:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:46.425 02:07:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:46.425 02:07:20 -- scripts/common.sh@335 -- # IFS=.-: 00:24:46.425 02:07:20 -- scripts/common.sh@335 -- # read -ra ver1 00:24:46.425 02:07:20 -- scripts/common.sh@336 -- # IFS=.-: 00:24:46.425 02:07:20 -- scripts/common.sh@336 -- # read -ra ver2 00:24:46.425 02:07:20 -- scripts/common.sh@337 -- # local 'op=<' 00:24:46.425 02:07:20 -- scripts/common.sh@339 -- # ver1_l=2 00:24:46.425 02:07:20 -- scripts/common.sh@340 -- # ver2_l=1 00:24:46.425 02:07:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:46.425 02:07:20 -- scripts/common.sh@343 -- # case "$op" in 00:24:46.425 02:07:20 -- scripts/common.sh@344 -- # : 1 00:24:46.425 02:07:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:46.425 02:07:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:46.425 02:07:20 -- scripts/common.sh@364 -- # decimal 1 00:24:46.425 02:07:20 -- scripts/common.sh@352 -- # local d=1 00:24:46.425 02:07:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:46.425 02:07:20 -- scripts/common.sh@354 -- # echo 1 00:24:46.425 02:07:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:46.425 02:07:20 -- scripts/common.sh@365 -- # decimal 2 00:24:46.425 02:07:20 -- scripts/common.sh@352 -- # local d=2 00:24:46.425 02:07:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:46.425 02:07:20 -- scripts/common.sh@354 -- # echo 2 00:24:46.425 02:07:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:46.425 02:07:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:46.425 02:07:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:46.425 02:07:20 -- scripts/common.sh@367 -- # return 0 00:24:46.425 02:07:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:46.425 02:07:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:46.425 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:46.425 --rc genhtml_branch_coverage=1 00:24:46.425 --rc genhtml_function_coverage=1 00:24:46.425 --rc genhtml_legend=1 00:24:46.425 --rc geninfo_all_blocks=1 00:24:46.425 --rc geninfo_unexecuted_blocks=1 00:24:46.425 00:24:46.425 ' 00:24:46.425 02:07:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:46.425 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:46.425 --rc genhtml_branch_coverage=1 00:24:46.425 --rc genhtml_function_coverage=1 00:24:46.425 --rc genhtml_legend=1 00:24:46.425 --rc geninfo_all_blocks=1 00:24:46.425 --rc geninfo_unexecuted_blocks=1 00:24:46.425 00:24:46.425 ' 00:24:46.425 02:07:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:46.425 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:46.425 --rc genhtml_branch_coverage=1 00:24:46.425 --rc genhtml_function_coverage=1 00:24:46.425 --rc genhtml_legend=1 00:24:46.425 --rc geninfo_all_blocks=1 00:24:46.425 --rc geninfo_unexecuted_blocks=1 00:24:46.425 00:24:46.425 ' 00:24:46.425 02:07:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:46.425 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:46.425 --rc genhtml_branch_coverage=1 00:24:46.425 --rc genhtml_function_coverage=1 00:24:46.425 --rc genhtml_legend=1 00:24:46.425 --rc geninfo_all_blocks=1 00:24:46.425 --rc geninfo_unexecuted_blocks=1 00:24:46.425 00:24:46.425 ' 00:24:46.425 02:07:20 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:46.425 02:07:20 -- nvmf/common.sh@7 -- # uname -s 00:24:46.425 02:07:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:46.425 02:07:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:46.425 02:07:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:46.425 02:07:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:46.425 02:07:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:46.425 02:07:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:46.425 02:07:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:46.425 02:07:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:46.425 02:07:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:46.425 02:07:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:46.425 02:07:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:46.426 02:07:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:46.426 02:07:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:46.426 02:07:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:46.426 02:07:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:46.426 02:07:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:46.426 02:07:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:46.426 02:07:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:46.426 02:07:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:46.426 02:07:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:46.426 02:07:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:46.426 02:07:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:46.426 02:07:20 -- paths/export.sh@5 -- # export PATH 00:24:46.426 02:07:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:46.426 02:07:20 -- nvmf/common.sh@46 -- # : 0 00:24:46.426 02:07:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:46.426 02:07:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:46.426 02:07:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:46.426 02:07:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:46.426 02:07:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:46.426 02:07:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:46.426 02:07:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:46.426 02:07:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:46.426 02:07:20 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:46.426 02:07:20 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:46.426 02:07:20 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:24:46.426 02:07:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:46.426 02:07:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:46.426 02:07:20 -- common/autotest_common.sh@10 -- # set +x 00:24:46.426 ************************************ 00:24:46.426 START TEST nvmf_shutdown_tc1 00:24:46.426 ************************************ 00:24:46.426 02:07:20 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:24:46.426 02:07:20 -- target/shutdown.sh@74 -- # starttarget 00:24:46.426 02:07:20 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:46.426 02:07:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:46.426 02:07:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:46.426 02:07:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:46.426 02:07:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:46.426 02:07:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:46.426 02:07:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:46.426 02:07:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:46.426 02:07:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:46.426 02:07:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:46.426 02:07:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:46.426 02:07:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:46.426 02:07:20 -- common/autotest_common.sh@10 -- # set +x 00:24:48.445 02:07:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:48.445 02:07:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:48.445 02:07:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:48.445 02:07:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:48.445 02:07:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:48.445 02:07:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:48.445 02:07:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:48.445 02:07:22 -- nvmf/common.sh@294 -- # net_devs=() 00:24:48.445 02:07:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:48.445 02:07:22 -- nvmf/common.sh@295 -- # e810=() 00:24:48.445 02:07:22 -- nvmf/common.sh@295 -- # local -ga e810 00:24:48.445 02:07:22 -- nvmf/common.sh@296 -- # x722=() 00:24:48.445 02:07:22 -- nvmf/common.sh@296 -- # local -ga x722 00:24:48.445 02:07:22 -- nvmf/common.sh@297 -- # mlx=() 00:24:48.445 02:07:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:48.445 02:07:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:48.445 02:07:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:48.445 02:07:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:48.445 02:07:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:48.445 02:07:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:48.445 02:07:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:48.445 02:07:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:48.445 02:07:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:48.445 02:07:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:48.445 02:07:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:48.445 02:07:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:48.445 02:07:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:48.445 02:07:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:48.445 02:07:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:48.445 02:07:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:48.445 02:07:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:48.445 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:48.445 02:07:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:48.445 02:07:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:48.445 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:48.445 02:07:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:48.445 02:07:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:48.445 02:07:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:48.445 02:07:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:48.445 02:07:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:48.445 02:07:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:48.445 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:48.445 02:07:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:48.445 02:07:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:48.445 02:07:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:48.445 02:07:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:48.445 02:07:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:48.445 02:07:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:48.445 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:48.445 02:07:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:48.445 02:07:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:48.445 02:07:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:48.445 02:07:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:48.445 02:07:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:48.445 02:07:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:48.445 02:07:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:48.445 02:07:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:48.445 02:07:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:48.445 02:07:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:48.445 02:07:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:48.445 02:07:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:48.445 02:07:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:48.445 02:07:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:48.445 02:07:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:48.445 02:07:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:48.445 02:07:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:48.445 02:07:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:48.445 02:07:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:48.445 02:07:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:48.445 02:07:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:48.445 02:07:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:48.445 02:07:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:48.446 02:07:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:48.446 02:07:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:48.446 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:48.446 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.165 ms 00:24:48.446 00:24:48.446 --- 10.0.0.2 ping statistics --- 00:24:48.446 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:48.446 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:24:48.446 02:07:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:48.446 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:48.446 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:24:48.446 00:24:48.446 --- 10.0.0.1 ping statistics --- 00:24:48.446 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:48.446 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:24:48.446 02:07:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:48.446 02:07:22 -- nvmf/common.sh@410 -- # return 0 00:24:48.446 02:07:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:48.446 02:07:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:48.446 02:07:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:48.446 02:07:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:48.446 02:07:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:48.446 02:07:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:48.446 02:07:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:48.446 02:07:22 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:48.446 02:07:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:48.446 02:07:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:48.446 02:07:22 -- common/autotest_common.sh@10 -- # set +x 00:24:48.446 02:07:22 -- nvmf/common.sh@469 -- # nvmfpid=1278645 00:24:48.446 02:07:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:48.446 02:07:22 -- nvmf/common.sh@470 -- # waitforlisten 1278645 00:24:48.446 02:07:22 -- common/autotest_common.sh@829 -- # '[' -z 1278645 ']' 00:24:48.446 02:07:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:48.446 02:07:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:48.446 02:07:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:48.446 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:48.446 02:07:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:48.446 02:07:22 -- common/autotest_common.sh@10 -- # set +x 00:24:48.446 [2024-11-18 02:07:22.718867] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:48.446 [2024-11-18 02:07:22.718938] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:48.446 EAL: No free 2048 kB hugepages reported on node 1 00:24:48.446 [2024-11-18 02:07:22.782933] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:48.706 [2024-11-18 02:07:22.873422] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:48.706 [2024-11-18 02:07:22.873569] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:48.706 [2024-11-18 02:07:22.873586] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:48.706 [2024-11-18 02:07:22.873598] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:48.706 [2024-11-18 02:07:22.877334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:48.706 [2024-11-18 02:07:22.877403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:48.706 [2024-11-18 02:07:22.877467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:48.706 [2024-11-18 02:07:22.877470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:49.645 02:07:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:49.645 02:07:23 -- common/autotest_common.sh@862 -- # return 0 00:24:49.645 02:07:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:49.645 02:07:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:49.645 02:07:23 -- common/autotest_common.sh@10 -- # set +x 00:24:49.645 02:07:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:49.645 02:07:23 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:49.645 02:07:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.645 02:07:23 -- common/autotest_common.sh@10 -- # set +x 00:24:49.645 [2024-11-18 02:07:23.775188] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:49.645 02:07:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.645 02:07:23 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:49.645 02:07:23 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:49.645 02:07:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:49.645 02:07:23 -- common/autotest_common.sh@10 -- # set +x 00:24:49.645 02:07:23 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:49.645 02:07:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.645 02:07:23 -- target/shutdown.sh@28 -- # cat 00:24:49.645 02:07:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.645 02:07:23 -- target/shutdown.sh@28 -- # cat 00:24:49.645 02:07:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.645 02:07:23 -- target/shutdown.sh@28 -- # cat 00:24:49.645 02:07:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.645 02:07:23 -- target/shutdown.sh@28 -- # cat 00:24:49.645 02:07:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.645 02:07:23 -- target/shutdown.sh@28 -- # cat 00:24:49.645 02:07:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.645 02:07:23 -- target/shutdown.sh@28 -- # cat 00:24:49.645 02:07:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.645 02:07:23 -- target/shutdown.sh@28 -- # cat 00:24:49.645 02:07:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.645 02:07:23 -- target/shutdown.sh@28 -- # cat 00:24:49.645 02:07:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.645 02:07:23 -- target/shutdown.sh@28 -- # cat 00:24:49.645 02:07:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.645 02:07:23 -- target/shutdown.sh@28 -- # cat 00:24:49.645 02:07:23 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:49.645 02:07:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.645 02:07:23 -- common/autotest_common.sh@10 -- # set +x 00:24:49.645 Malloc1 00:24:49.645 [2024-11-18 02:07:23.850526] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:49.645 Malloc2 00:24:49.645 Malloc3 00:24:49.645 Malloc4 00:24:49.645 Malloc5 00:24:49.904 Malloc6 00:24:49.904 Malloc7 00:24:49.904 Malloc8 00:24:49.904 Malloc9 00:24:49.904 Malloc10 00:24:49.904 02:07:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.904 02:07:24 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:49.904 02:07:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:49.904 02:07:24 -- common/autotest_common.sh@10 -- # set +x 00:24:49.904 02:07:24 -- target/shutdown.sh@78 -- # perfpid=1278835 00:24:49.904 02:07:24 -- target/shutdown.sh@79 -- # waitforlisten 1278835 /var/tmp/bdevperf.sock 00:24:49.904 02:07:24 -- common/autotest_common.sh@829 -- # '[' -z 1278835 ']' 00:24:49.904 02:07:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:49.904 02:07:24 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:49.904 02:07:24 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:24:49.904 02:07:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:49.904 02:07:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:49.904 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:49.904 02:07:24 -- nvmf/common.sh@520 -- # config=() 00:24:49.904 02:07:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:49.904 02:07:24 -- nvmf/common.sh@520 -- # local subsystem config 00:24:49.904 02:07:24 -- common/autotest_common.sh@10 -- # set +x 00:24:49.904 02:07:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:49.904 02:07:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:49.904 { 00:24:49.904 "params": { 00:24:49.904 "name": "Nvme$subsystem", 00:24:49.904 "trtype": "$TEST_TRANSPORT", 00:24:49.904 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:49.904 "adrfam": "ipv4", 00:24:49.904 "trsvcid": "$NVMF_PORT", 00:24:49.904 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:49.905 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:49.905 "hdgst": ${hdgst:-false}, 00:24:49.905 "ddgst": ${ddgst:-false} 00:24:49.905 }, 00:24:49.905 "method": "bdev_nvme_attach_controller" 00:24:49.905 } 00:24:49.905 EOF 00:24:49.905 )") 00:24:49.905 02:07:24 -- nvmf/common.sh@542 -- # cat 00:24:49.905 02:07:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:49.905 02:07:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:49.905 { 00:24:49.905 "params": { 00:24:49.905 "name": "Nvme$subsystem", 00:24:49.905 "trtype": "$TEST_TRANSPORT", 00:24:49.905 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:49.905 "adrfam": "ipv4", 00:24:49.905 "trsvcid": "$NVMF_PORT", 00:24:49.905 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:49.905 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:49.905 "hdgst": ${hdgst:-false}, 00:24:49.905 "ddgst": ${ddgst:-false} 00:24:49.905 }, 00:24:49.905 "method": "bdev_nvme_attach_controller" 00:24:49.905 } 00:24:49.905 EOF 00:24:49.905 )") 00:24:49.905 02:07:24 -- nvmf/common.sh@542 -- # cat 00:24:49.905 02:07:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.164 02:07:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.164 { 00:24:50.164 "params": { 00:24:50.164 "name": "Nvme$subsystem", 00:24:50.164 "trtype": "$TEST_TRANSPORT", 00:24:50.164 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.164 "adrfam": "ipv4", 00:24:50.164 "trsvcid": "$NVMF_PORT", 00:24:50.164 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.164 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.164 "hdgst": ${hdgst:-false}, 00:24:50.164 "ddgst": ${ddgst:-false} 00:24:50.164 }, 00:24:50.164 "method": "bdev_nvme_attach_controller" 00:24:50.164 } 00:24:50.164 EOF 00:24:50.164 )") 00:24:50.164 02:07:24 -- nvmf/common.sh@542 -- # cat 00:24:50.164 02:07:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.164 02:07:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.164 { 00:24:50.164 "params": { 00:24:50.164 "name": "Nvme$subsystem", 00:24:50.164 "trtype": "$TEST_TRANSPORT", 00:24:50.164 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.164 "adrfam": "ipv4", 00:24:50.164 "trsvcid": "$NVMF_PORT", 00:24:50.164 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.164 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.164 "hdgst": ${hdgst:-false}, 00:24:50.164 "ddgst": ${ddgst:-false} 00:24:50.164 }, 00:24:50.164 "method": "bdev_nvme_attach_controller" 00:24:50.164 } 00:24:50.164 EOF 00:24:50.164 )") 00:24:50.164 02:07:24 -- nvmf/common.sh@542 -- # cat 00:24:50.164 02:07:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.164 02:07:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.164 { 00:24:50.164 "params": { 00:24:50.164 "name": "Nvme$subsystem", 00:24:50.164 "trtype": "$TEST_TRANSPORT", 00:24:50.164 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.164 "adrfam": "ipv4", 00:24:50.164 "trsvcid": "$NVMF_PORT", 00:24:50.164 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.164 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.164 "hdgst": ${hdgst:-false}, 00:24:50.164 "ddgst": ${ddgst:-false} 00:24:50.164 }, 00:24:50.164 "method": "bdev_nvme_attach_controller" 00:24:50.164 } 00:24:50.164 EOF 00:24:50.164 )") 00:24:50.164 02:07:24 -- nvmf/common.sh@542 -- # cat 00:24:50.164 02:07:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.164 02:07:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.164 { 00:24:50.164 "params": { 00:24:50.164 "name": "Nvme$subsystem", 00:24:50.164 "trtype": "$TEST_TRANSPORT", 00:24:50.164 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.164 "adrfam": "ipv4", 00:24:50.164 "trsvcid": "$NVMF_PORT", 00:24:50.164 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.164 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.165 "hdgst": ${hdgst:-false}, 00:24:50.165 "ddgst": ${ddgst:-false} 00:24:50.165 }, 00:24:50.165 "method": "bdev_nvme_attach_controller" 00:24:50.165 } 00:24:50.165 EOF 00:24:50.165 )") 00:24:50.165 02:07:24 -- nvmf/common.sh@542 -- # cat 00:24:50.165 02:07:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.165 02:07:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.165 { 00:24:50.165 "params": { 00:24:50.165 "name": "Nvme$subsystem", 00:24:50.165 "trtype": "$TEST_TRANSPORT", 00:24:50.165 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.165 "adrfam": "ipv4", 00:24:50.165 "trsvcid": "$NVMF_PORT", 00:24:50.165 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.165 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.165 "hdgst": ${hdgst:-false}, 00:24:50.165 "ddgst": ${ddgst:-false} 00:24:50.165 }, 00:24:50.165 "method": "bdev_nvme_attach_controller" 00:24:50.165 } 00:24:50.165 EOF 00:24:50.165 )") 00:24:50.165 02:07:24 -- nvmf/common.sh@542 -- # cat 00:24:50.165 02:07:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.165 02:07:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.165 { 00:24:50.165 "params": { 00:24:50.165 "name": "Nvme$subsystem", 00:24:50.165 "trtype": "$TEST_TRANSPORT", 00:24:50.165 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.165 "adrfam": "ipv4", 00:24:50.165 "trsvcid": "$NVMF_PORT", 00:24:50.165 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.165 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.165 "hdgst": ${hdgst:-false}, 00:24:50.165 "ddgst": ${ddgst:-false} 00:24:50.165 }, 00:24:50.165 "method": "bdev_nvme_attach_controller" 00:24:50.165 } 00:24:50.165 EOF 00:24:50.165 )") 00:24:50.165 02:07:24 -- nvmf/common.sh@542 -- # cat 00:24:50.165 02:07:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.165 02:07:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.165 { 00:24:50.165 "params": { 00:24:50.165 "name": "Nvme$subsystem", 00:24:50.165 "trtype": "$TEST_TRANSPORT", 00:24:50.165 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.165 "adrfam": "ipv4", 00:24:50.165 "trsvcid": "$NVMF_PORT", 00:24:50.165 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.165 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.165 "hdgst": ${hdgst:-false}, 00:24:50.165 "ddgst": ${ddgst:-false} 00:24:50.165 }, 00:24:50.165 "method": "bdev_nvme_attach_controller" 00:24:50.165 } 00:24:50.165 EOF 00:24:50.165 )") 00:24:50.165 02:07:24 -- nvmf/common.sh@542 -- # cat 00:24:50.165 02:07:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.165 02:07:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.165 { 00:24:50.165 "params": { 00:24:50.165 "name": "Nvme$subsystem", 00:24:50.165 "trtype": "$TEST_TRANSPORT", 00:24:50.165 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.165 "adrfam": "ipv4", 00:24:50.165 "trsvcid": "$NVMF_PORT", 00:24:50.165 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.165 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.165 "hdgst": ${hdgst:-false}, 00:24:50.165 "ddgst": ${ddgst:-false} 00:24:50.165 }, 00:24:50.165 "method": "bdev_nvme_attach_controller" 00:24:50.165 } 00:24:50.165 EOF 00:24:50.165 )") 00:24:50.165 02:07:24 -- nvmf/common.sh@542 -- # cat 00:24:50.165 02:07:24 -- nvmf/common.sh@544 -- # jq . 00:24:50.165 02:07:24 -- nvmf/common.sh@545 -- # IFS=, 00:24:50.165 02:07:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:50.165 "params": { 00:24:50.165 "name": "Nvme1", 00:24:50.165 "trtype": "tcp", 00:24:50.165 "traddr": "10.0.0.2", 00:24:50.165 "adrfam": "ipv4", 00:24:50.165 "trsvcid": "4420", 00:24:50.165 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:50.165 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:50.165 "hdgst": false, 00:24:50.165 "ddgst": false 00:24:50.165 }, 00:24:50.165 "method": "bdev_nvme_attach_controller" 00:24:50.165 },{ 00:24:50.165 "params": { 00:24:50.165 "name": "Nvme2", 00:24:50.165 "trtype": "tcp", 00:24:50.165 "traddr": "10.0.0.2", 00:24:50.165 "adrfam": "ipv4", 00:24:50.165 "trsvcid": "4420", 00:24:50.165 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:50.165 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:50.165 "hdgst": false, 00:24:50.165 "ddgst": false 00:24:50.165 }, 00:24:50.165 "method": "bdev_nvme_attach_controller" 00:24:50.165 },{ 00:24:50.165 "params": { 00:24:50.165 "name": "Nvme3", 00:24:50.165 "trtype": "tcp", 00:24:50.165 "traddr": "10.0.0.2", 00:24:50.165 "adrfam": "ipv4", 00:24:50.165 "trsvcid": "4420", 00:24:50.165 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:50.165 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:50.165 "hdgst": false, 00:24:50.165 "ddgst": false 00:24:50.165 }, 00:24:50.165 "method": "bdev_nvme_attach_controller" 00:24:50.165 },{ 00:24:50.165 "params": { 00:24:50.165 "name": "Nvme4", 00:24:50.165 "trtype": "tcp", 00:24:50.165 "traddr": "10.0.0.2", 00:24:50.165 "adrfam": "ipv4", 00:24:50.165 "trsvcid": "4420", 00:24:50.165 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:50.165 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:50.165 "hdgst": false, 00:24:50.165 "ddgst": false 00:24:50.165 }, 00:24:50.165 "method": "bdev_nvme_attach_controller" 00:24:50.165 },{ 00:24:50.165 "params": { 00:24:50.165 "name": "Nvme5", 00:24:50.165 "trtype": "tcp", 00:24:50.165 "traddr": "10.0.0.2", 00:24:50.165 "adrfam": "ipv4", 00:24:50.165 "trsvcid": "4420", 00:24:50.165 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:50.165 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:50.165 "hdgst": false, 00:24:50.165 "ddgst": false 00:24:50.165 }, 00:24:50.165 "method": "bdev_nvme_attach_controller" 00:24:50.165 },{ 00:24:50.165 "params": { 00:24:50.165 "name": "Nvme6", 00:24:50.165 "trtype": "tcp", 00:24:50.165 "traddr": "10.0.0.2", 00:24:50.165 "adrfam": "ipv4", 00:24:50.165 "trsvcid": "4420", 00:24:50.165 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:50.165 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:50.165 "hdgst": false, 00:24:50.165 "ddgst": false 00:24:50.165 }, 00:24:50.165 "method": "bdev_nvme_attach_controller" 00:24:50.165 },{ 00:24:50.165 "params": { 00:24:50.165 "name": "Nvme7", 00:24:50.165 "trtype": "tcp", 00:24:50.165 "traddr": "10.0.0.2", 00:24:50.165 "adrfam": "ipv4", 00:24:50.165 "trsvcid": "4420", 00:24:50.165 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:50.165 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:50.165 "hdgst": false, 00:24:50.165 "ddgst": false 00:24:50.165 }, 00:24:50.165 "method": "bdev_nvme_attach_controller" 00:24:50.165 },{ 00:24:50.165 "params": { 00:24:50.165 "name": "Nvme8", 00:24:50.165 "trtype": "tcp", 00:24:50.165 "traddr": "10.0.0.2", 00:24:50.166 "adrfam": "ipv4", 00:24:50.166 "trsvcid": "4420", 00:24:50.166 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:50.166 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:50.166 "hdgst": false, 00:24:50.166 "ddgst": false 00:24:50.166 }, 00:24:50.166 "method": "bdev_nvme_attach_controller" 00:24:50.166 },{ 00:24:50.166 "params": { 00:24:50.166 "name": "Nvme9", 00:24:50.166 "trtype": "tcp", 00:24:50.166 "traddr": "10.0.0.2", 00:24:50.166 "adrfam": "ipv4", 00:24:50.166 "trsvcid": "4420", 00:24:50.166 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:50.166 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:50.166 "hdgst": false, 00:24:50.166 "ddgst": false 00:24:50.166 }, 00:24:50.166 "method": "bdev_nvme_attach_controller" 00:24:50.166 },{ 00:24:50.166 "params": { 00:24:50.166 "name": "Nvme10", 00:24:50.166 "trtype": "tcp", 00:24:50.166 "traddr": "10.0.0.2", 00:24:50.166 "adrfam": "ipv4", 00:24:50.166 "trsvcid": "4420", 00:24:50.166 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:50.166 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:50.166 "hdgst": false, 00:24:50.166 "ddgst": false 00:24:50.166 }, 00:24:50.166 "method": "bdev_nvme_attach_controller" 00:24:50.166 }' 00:24:50.166 [2024-11-18 02:07:24.337546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:50.166 [2024-11-18 02:07:24.337632] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:24:50.166 EAL: No free 2048 kB hugepages reported on node 1 00:24:50.166 [2024-11-18 02:07:24.401404] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:50.166 [2024-11-18 02:07:24.486677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:52.071 02:07:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:52.071 02:07:26 -- common/autotest_common.sh@862 -- # return 0 00:24:52.071 02:07:26 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:52.072 02:07:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:52.072 02:07:26 -- common/autotest_common.sh@10 -- # set +x 00:24:52.072 02:07:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:52.072 02:07:26 -- target/shutdown.sh@83 -- # kill -9 1278835 00:24:52.072 02:07:26 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:24:52.072 02:07:26 -- target/shutdown.sh@87 -- # sleep 1 00:24:53.012 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1278835 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:24:53.012 02:07:27 -- target/shutdown.sh@88 -- # kill -0 1278645 00:24:53.012 02:07:27 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:24:53.012 02:07:27 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:53.012 02:07:27 -- nvmf/common.sh@520 -- # config=() 00:24:53.012 02:07:27 -- nvmf/common.sh@520 -- # local subsystem config 00:24:53.012 02:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:53.012 02:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:53.012 { 00:24:53.012 "params": { 00:24:53.012 "name": "Nvme$subsystem", 00:24:53.012 "trtype": "$TEST_TRANSPORT", 00:24:53.012 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:53.012 "adrfam": "ipv4", 00:24:53.012 "trsvcid": "$NVMF_PORT", 00:24:53.012 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:53.012 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:53.012 "hdgst": ${hdgst:-false}, 00:24:53.012 "ddgst": ${ddgst:-false} 00:24:53.012 }, 00:24:53.012 "method": "bdev_nvme_attach_controller" 00:24:53.012 } 00:24:53.012 EOF 00:24:53.012 )") 00:24:53.012 02:07:27 -- nvmf/common.sh@542 -- # cat 00:24:53.012 02:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:53.012 02:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:53.012 { 00:24:53.012 "params": { 00:24:53.012 "name": "Nvme$subsystem", 00:24:53.012 "trtype": "$TEST_TRANSPORT", 00:24:53.012 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:53.012 "adrfam": "ipv4", 00:24:53.012 "trsvcid": "$NVMF_PORT", 00:24:53.012 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:53.012 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:53.012 "hdgst": ${hdgst:-false}, 00:24:53.012 "ddgst": ${ddgst:-false} 00:24:53.012 }, 00:24:53.012 "method": "bdev_nvme_attach_controller" 00:24:53.012 } 00:24:53.012 EOF 00:24:53.012 )") 00:24:53.012 02:07:27 -- nvmf/common.sh@542 -- # cat 00:24:53.012 02:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:53.012 02:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:53.012 { 00:24:53.012 "params": { 00:24:53.012 "name": "Nvme$subsystem", 00:24:53.012 "trtype": "$TEST_TRANSPORT", 00:24:53.012 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:53.012 "adrfam": "ipv4", 00:24:53.012 "trsvcid": "$NVMF_PORT", 00:24:53.012 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:53.012 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:53.012 "hdgst": ${hdgst:-false}, 00:24:53.012 "ddgst": ${ddgst:-false} 00:24:53.012 }, 00:24:53.012 "method": "bdev_nvme_attach_controller" 00:24:53.012 } 00:24:53.012 EOF 00:24:53.012 )") 00:24:53.012 02:07:27 -- nvmf/common.sh@542 -- # cat 00:24:53.012 02:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:53.012 02:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:53.012 { 00:24:53.012 "params": { 00:24:53.012 "name": "Nvme$subsystem", 00:24:53.012 "trtype": "$TEST_TRANSPORT", 00:24:53.012 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:53.012 "adrfam": "ipv4", 00:24:53.012 "trsvcid": "$NVMF_PORT", 00:24:53.012 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:53.012 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:53.012 "hdgst": ${hdgst:-false}, 00:24:53.012 "ddgst": ${ddgst:-false} 00:24:53.012 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 } 00:24:53.013 EOF 00:24:53.013 )") 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # cat 00:24:53.013 02:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:53.013 { 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme$subsystem", 00:24:53.013 "trtype": "$TEST_TRANSPORT", 00:24:53.013 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "$NVMF_PORT", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:53.013 "hdgst": ${hdgst:-false}, 00:24:53.013 "ddgst": ${ddgst:-false} 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 } 00:24:53.013 EOF 00:24:53.013 )") 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # cat 00:24:53.013 02:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:53.013 { 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme$subsystem", 00:24:53.013 "trtype": "$TEST_TRANSPORT", 00:24:53.013 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "$NVMF_PORT", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:53.013 "hdgst": ${hdgst:-false}, 00:24:53.013 "ddgst": ${ddgst:-false} 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 } 00:24:53.013 EOF 00:24:53.013 )") 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # cat 00:24:53.013 02:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:53.013 { 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme$subsystem", 00:24:53.013 "trtype": "$TEST_TRANSPORT", 00:24:53.013 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "$NVMF_PORT", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:53.013 "hdgst": ${hdgst:-false}, 00:24:53.013 "ddgst": ${ddgst:-false} 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 } 00:24:53.013 EOF 00:24:53.013 )") 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # cat 00:24:53.013 02:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:53.013 { 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme$subsystem", 00:24:53.013 "trtype": "$TEST_TRANSPORT", 00:24:53.013 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "$NVMF_PORT", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:53.013 "hdgst": ${hdgst:-false}, 00:24:53.013 "ddgst": ${ddgst:-false} 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 } 00:24:53.013 EOF 00:24:53.013 )") 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # cat 00:24:53.013 02:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:53.013 { 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme$subsystem", 00:24:53.013 "trtype": "$TEST_TRANSPORT", 00:24:53.013 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "$NVMF_PORT", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:53.013 "hdgst": ${hdgst:-false}, 00:24:53.013 "ddgst": ${ddgst:-false} 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 } 00:24:53.013 EOF 00:24:53.013 )") 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # cat 00:24:53.013 02:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:53.013 { 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme$subsystem", 00:24:53.013 "trtype": "$TEST_TRANSPORT", 00:24:53.013 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "$NVMF_PORT", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:53.013 "hdgst": ${hdgst:-false}, 00:24:53.013 "ddgst": ${ddgst:-false} 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 } 00:24:53.013 EOF 00:24:53.013 )") 00:24:53.013 02:07:27 -- nvmf/common.sh@542 -- # cat 00:24:53.013 02:07:27 -- nvmf/common.sh@544 -- # jq . 00:24:53.013 02:07:27 -- nvmf/common.sh@545 -- # IFS=, 00:24:53.013 02:07:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme1", 00:24:53.013 "trtype": "tcp", 00:24:53.013 "traddr": "10.0.0.2", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "4420", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:53.013 "hdgst": false, 00:24:53.013 "ddgst": false 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 },{ 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme2", 00:24:53.013 "trtype": "tcp", 00:24:53.013 "traddr": "10.0.0.2", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "4420", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:53.013 "hdgst": false, 00:24:53.013 "ddgst": false 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 },{ 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme3", 00:24:53.013 "trtype": "tcp", 00:24:53.013 "traddr": "10.0.0.2", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "4420", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:53.013 "hdgst": false, 00:24:53.013 "ddgst": false 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 },{ 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme4", 00:24:53.013 "trtype": "tcp", 00:24:53.013 "traddr": "10.0.0.2", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "4420", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:53.013 "hdgst": false, 00:24:53.013 "ddgst": false 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 },{ 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme5", 00:24:53.013 "trtype": "tcp", 00:24:53.013 "traddr": "10.0.0.2", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "4420", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:53.013 "hdgst": false, 00:24:53.013 "ddgst": false 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 },{ 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme6", 00:24:53.013 "trtype": "tcp", 00:24:53.013 "traddr": "10.0.0.2", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "4420", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:53.013 "hdgst": false, 00:24:53.013 "ddgst": false 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 },{ 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme7", 00:24:53.013 "trtype": "tcp", 00:24:53.013 "traddr": "10.0.0.2", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "4420", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:53.013 "hdgst": false, 00:24:53.013 "ddgst": false 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 },{ 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme8", 00:24:53.013 "trtype": "tcp", 00:24:53.013 "traddr": "10.0.0.2", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "4420", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:53.013 "hdgst": false, 00:24:53.013 "ddgst": false 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 },{ 00:24:53.013 "params": { 00:24:53.013 "name": "Nvme9", 00:24:53.013 "trtype": "tcp", 00:24:53.013 "traddr": "10.0.0.2", 00:24:53.013 "adrfam": "ipv4", 00:24:53.013 "trsvcid": "4420", 00:24:53.013 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:53.013 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:53.013 "hdgst": false, 00:24:53.013 "ddgst": false 00:24:53.013 }, 00:24:53.013 "method": "bdev_nvme_attach_controller" 00:24:53.013 },{ 00:24:53.013 "params": { 00:24:53.014 "name": "Nvme10", 00:24:53.014 "trtype": "tcp", 00:24:53.014 "traddr": "10.0.0.2", 00:24:53.014 "adrfam": "ipv4", 00:24:53.014 "trsvcid": "4420", 00:24:53.014 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:53.014 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:53.014 "hdgst": false, 00:24:53.014 "ddgst": false 00:24:53.014 }, 00:24:53.014 "method": "bdev_nvme_attach_controller" 00:24:53.014 }' 00:24:53.014 [2024-11-18 02:07:27.161695] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:53.014 [2024-11-18 02:07:27.161768] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1279267 ] 00:24:53.014 EAL: No free 2048 kB hugepages reported on node 1 00:24:53.014 [2024-11-18 02:07:27.225867] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:53.014 [2024-11-18 02:07:27.310430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:54.391 Running I/O for 1 seconds... 00:24:55.766 00:24:55.766 Latency(us) 00:24:55.766 [2024-11-18T01:07:30.168Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:55.766 [2024-11-18T01:07:30.168Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:55.766 Verification LBA range: start 0x0 length 0x400 00:24:55.766 Nvme1n1 : 1.09 397.32 24.83 0.00 0.00 157932.14 20486.07 118838.61 00:24:55.766 [2024-11-18T01:07:30.168Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:55.766 Verification LBA range: start 0x0 length 0x400 00:24:55.766 Nvme2n1 : 1.10 394.98 24.69 0.00 0.00 157657.65 22233.69 126605.84 00:24:55.766 [2024-11-18T01:07:30.168Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:55.766 Verification LBA range: start 0x0 length 0x400 00:24:55.766 Nvme3n1 : 1.10 396.02 24.75 0.00 0.00 156246.26 21262.79 115731.72 00:24:55.766 [2024-11-18T01:07:30.168Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:55.766 Verification LBA range: start 0x0 length 0x400 00:24:55.766 Nvme4n1 : 1.10 401.92 25.12 0.00 0.00 152407.55 21651.15 128159.29 00:24:55.766 [2024-11-18T01:07:30.168Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:55.766 Verification LBA range: start 0x0 length 0x400 00:24:55.766 Nvme5n1 : 1.10 393.52 24.59 0.00 0.00 155037.77 21262.79 120392.06 00:24:55.766 [2024-11-18T01:07:30.168Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:55.766 Verification LBA range: start 0x0 length 0x400 00:24:55.766 Nvme6n1 : 1.11 392.02 24.50 0.00 0.00 154811.83 19223.89 126605.84 00:24:55.766 [2024-11-18T01:07:30.168Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:55.766 Verification LBA range: start 0x0 length 0x400 00:24:55.766 Nvme7n1 : 1.10 393.07 24.57 0.00 0.00 153089.03 20971.52 123498.95 00:24:55.766 [2024-11-18T01:07:30.168Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:55.766 Verification LBA range: start 0x0 length 0x400 00:24:55.766 Nvme8n1 : 1.11 396.07 24.75 0.00 0.00 150865.94 22136.60 159228.21 00:24:55.766 [2024-11-18T01:07:30.168Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:55.766 Verification LBA range: start 0x0 length 0x400 00:24:55.766 Nvme9n1 : 1.11 395.02 24.69 0.00 0.00 150510.97 19709.35 158451.48 00:24:55.766 [2024-11-18T01:07:30.168Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:55.766 Verification LBA range: start 0x0 length 0x400 00:24:55.766 Nvme10n1 : 1.12 388.54 24.28 0.00 0.00 153715.95 3179.71 152237.70 00:24:55.766 [2024-11-18T01:07:30.168Z] =================================================================================================================== 00:24:55.766 [2024-11-18T01:07:30.168Z] Total : 3948.46 246.78 0.00 0.00 154216.46 3179.71 159228.21 00:24:55.766 02:07:30 -- target/shutdown.sh@93 -- # stoptarget 00:24:55.766 02:07:30 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:55.766 02:07:30 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:55.766 02:07:30 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:55.766 02:07:30 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:55.766 02:07:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:55.766 02:07:30 -- nvmf/common.sh@116 -- # sync 00:24:55.766 02:07:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:55.766 02:07:30 -- nvmf/common.sh@119 -- # set +e 00:24:55.766 02:07:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:55.766 02:07:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:55.766 rmmod nvme_tcp 00:24:55.766 rmmod nvme_fabrics 00:24:55.766 rmmod nvme_keyring 00:24:55.766 02:07:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:55.766 02:07:30 -- nvmf/common.sh@123 -- # set -e 00:24:55.766 02:07:30 -- nvmf/common.sh@124 -- # return 0 00:24:55.766 02:07:30 -- nvmf/common.sh@477 -- # '[' -n 1278645 ']' 00:24:55.766 02:07:30 -- nvmf/common.sh@478 -- # killprocess 1278645 00:24:55.766 02:07:30 -- common/autotest_common.sh@936 -- # '[' -z 1278645 ']' 00:24:55.766 02:07:30 -- common/autotest_common.sh@940 -- # kill -0 1278645 00:24:55.766 02:07:30 -- common/autotest_common.sh@941 -- # uname 00:24:55.766 02:07:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:55.766 02:07:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1278645 00:24:56.027 02:07:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:56.027 02:07:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:56.027 02:07:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1278645' 00:24:56.027 killing process with pid 1278645 00:24:56.027 02:07:30 -- common/autotest_common.sh@955 -- # kill 1278645 00:24:56.027 02:07:30 -- common/autotest_common.sh@960 -- # wait 1278645 00:24:56.287 02:07:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:56.287 02:07:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:56.287 02:07:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:56.287 02:07:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:56.287 02:07:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:56.287 02:07:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:56.287 02:07:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:56.287 02:07:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:58.825 02:07:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:58.825 00:24:58.825 real 0m12.045s 00:24:58.825 user 0m35.908s 00:24:58.825 sys 0m3.146s 00:24:58.825 02:07:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:58.825 02:07:32 -- common/autotest_common.sh@10 -- # set +x 00:24:58.825 ************************************ 00:24:58.825 END TEST nvmf_shutdown_tc1 00:24:58.825 ************************************ 00:24:58.825 02:07:32 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:24:58.825 02:07:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:58.825 02:07:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:58.825 02:07:32 -- common/autotest_common.sh@10 -- # set +x 00:24:58.825 ************************************ 00:24:58.825 START TEST nvmf_shutdown_tc2 00:24:58.825 ************************************ 00:24:58.825 02:07:32 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:24:58.825 02:07:32 -- target/shutdown.sh@98 -- # starttarget 00:24:58.825 02:07:32 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:58.825 02:07:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:58.825 02:07:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:58.825 02:07:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:58.825 02:07:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:58.825 02:07:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:58.825 02:07:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:58.825 02:07:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:58.825 02:07:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:58.825 02:07:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:58.825 02:07:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:58.826 02:07:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:58.826 02:07:32 -- common/autotest_common.sh@10 -- # set +x 00:24:58.826 02:07:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:58.826 02:07:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:58.826 02:07:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:58.826 02:07:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:58.826 02:07:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:58.826 02:07:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:58.826 02:07:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:58.826 02:07:32 -- nvmf/common.sh@294 -- # net_devs=() 00:24:58.826 02:07:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:58.826 02:07:32 -- nvmf/common.sh@295 -- # e810=() 00:24:58.826 02:07:32 -- nvmf/common.sh@295 -- # local -ga e810 00:24:58.826 02:07:32 -- nvmf/common.sh@296 -- # x722=() 00:24:58.826 02:07:32 -- nvmf/common.sh@296 -- # local -ga x722 00:24:58.826 02:07:32 -- nvmf/common.sh@297 -- # mlx=() 00:24:58.826 02:07:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:58.826 02:07:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:58.826 02:07:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:58.826 02:07:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:58.826 02:07:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:58.826 02:07:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:58.826 02:07:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:58.826 02:07:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:58.826 02:07:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:58.826 02:07:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:58.826 02:07:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:58.826 02:07:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:58.826 02:07:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:58.826 02:07:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:58.826 02:07:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:58.826 02:07:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:58.826 02:07:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:58.826 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:58.826 02:07:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:58.826 02:07:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:58.826 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:58.826 02:07:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:58.826 02:07:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:58.826 02:07:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:58.826 02:07:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:58.826 02:07:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:58.826 02:07:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:58.826 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:58.826 02:07:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:58.826 02:07:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:58.826 02:07:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:58.826 02:07:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:58.826 02:07:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:58.826 02:07:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:58.826 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:58.826 02:07:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:58.826 02:07:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:58.826 02:07:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:58.826 02:07:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:58.826 02:07:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:58.826 02:07:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:58.826 02:07:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:58.826 02:07:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:58.826 02:07:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:58.826 02:07:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:58.826 02:07:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:58.826 02:07:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:58.826 02:07:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:58.826 02:07:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:58.826 02:07:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:58.826 02:07:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:58.826 02:07:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:58.826 02:07:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:58.826 02:07:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:58.826 02:07:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:58.826 02:07:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:58.826 02:07:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:58.826 02:07:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:58.826 02:07:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:58.826 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:58.826 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:24:58.826 00:24:58.826 --- 10.0.0.2 ping statistics --- 00:24:58.826 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:58.826 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:24:58.826 02:07:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:58.826 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:58.826 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.192 ms 00:24:58.826 00:24:58.826 --- 10.0.0.1 ping statistics --- 00:24:58.826 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:58.826 rtt min/avg/max/mdev = 0.192/0.192/0.192/0.000 ms 00:24:58.826 02:07:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:58.826 02:07:32 -- nvmf/common.sh@410 -- # return 0 00:24:58.826 02:07:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:58.826 02:07:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:58.826 02:07:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:58.826 02:07:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:58.826 02:07:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:58.826 02:07:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:58.826 02:07:32 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:58.826 02:07:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:58.826 02:07:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:58.826 02:07:32 -- common/autotest_common.sh@10 -- # set +x 00:24:58.826 02:07:32 -- nvmf/common.sh@469 -- # nvmfpid=1280052 00:24:58.826 02:07:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:58.826 02:07:32 -- nvmf/common.sh@470 -- # waitforlisten 1280052 00:24:58.826 02:07:32 -- common/autotest_common.sh@829 -- # '[' -z 1280052 ']' 00:24:58.826 02:07:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:58.826 02:07:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:58.826 02:07:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:58.826 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:58.826 02:07:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:58.826 02:07:32 -- common/autotest_common.sh@10 -- # set +x 00:24:58.826 [2024-11-18 02:07:32.974875] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:58.826 [2024-11-18 02:07:32.974949] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:58.826 EAL: No free 2048 kB hugepages reported on node 1 00:24:58.826 [2024-11-18 02:07:33.041193] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:58.826 [2024-11-18 02:07:33.138970] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:58.826 [2024-11-18 02:07:33.139118] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:58.826 [2024-11-18 02:07:33.139134] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:58.826 [2024-11-18 02:07:33.139147] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:58.826 [2024-11-18 02:07:33.139381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:58.826 [2024-11-18 02:07:33.139408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:58.826 [2024-11-18 02:07:33.139467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:58.826 [2024-11-18 02:07:33.139470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:59.762 02:07:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:59.762 02:07:34 -- common/autotest_common.sh@862 -- # return 0 00:24:59.762 02:07:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:59.762 02:07:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:59.762 02:07:34 -- common/autotest_common.sh@10 -- # set +x 00:24:59.762 02:07:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:59.762 02:07:34 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:59.762 02:07:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.762 02:07:34 -- common/autotest_common.sh@10 -- # set +x 00:24:59.762 [2024-11-18 02:07:34.046153] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:59.762 02:07:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.762 02:07:34 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:59.762 02:07:34 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:59.762 02:07:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:59.762 02:07:34 -- common/autotest_common.sh@10 -- # set +x 00:24:59.762 02:07:34 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:59.762 02:07:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:59.762 02:07:34 -- target/shutdown.sh@28 -- # cat 00:24:59.762 02:07:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:59.762 02:07:34 -- target/shutdown.sh@28 -- # cat 00:24:59.762 02:07:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:59.762 02:07:34 -- target/shutdown.sh@28 -- # cat 00:24:59.762 02:07:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:59.762 02:07:34 -- target/shutdown.sh@28 -- # cat 00:24:59.762 02:07:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:59.762 02:07:34 -- target/shutdown.sh@28 -- # cat 00:24:59.762 02:07:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:59.762 02:07:34 -- target/shutdown.sh@28 -- # cat 00:24:59.762 02:07:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:59.762 02:07:34 -- target/shutdown.sh@28 -- # cat 00:24:59.762 02:07:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:59.762 02:07:34 -- target/shutdown.sh@28 -- # cat 00:24:59.762 02:07:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:59.762 02:07:34 -- target/shutdown.sh@28 -- # cat 00:24:59.762 02:07:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:59.762 02:07:34 -- target/shutdown.sh@28 -- # cat 00:24:59.762 02:07:34 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:59.762 02:07:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.762 02:07:34 -- common/autotest_common.sh@10 -- # set +x 00:24:59.762 Malloc1 00:24:59.762 [2024-11-18 02:07:34.121584] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:59.762 Malloc2 00:25:00.020 Malloc3 00:25:00.020 Malloc4 00:25:00.020 Malloc5 00:25:00.020 Malloc6 00:25:00.020 Malloc7 00:25:00.279 Malloc8 00:25:00.279 Malloc9 00:25:00.279 Malloc10 00:25:00.279 02:07:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.279 02:07:34 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:00.279 02:07:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:00.279 02:07:34 -- common/autotest_common.sh@10 -- # set +x 00:25:00.279 02:07:34 -- target/shutdown.sh@102 -- # perfpid=1280242 00:25:00.279 02:07:34 -- target/shutdown.sh@103 -- # waitforlisten 1280242 /var/tmp/bdevperf.sock 00:25:00.279 02:07:34 -- common/autotest_common.sh@829 -- # '[' -z 1280242 ']' 00:25:00.279 02:07:34 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:00.279 02:07:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:00.279 02:07:34 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:00.279 02:07:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:00.279 02:07:34 -- nvmf/common.sh@520 -- # config=() 00:25:00.279 02:07:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:00.279 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:00.279 02:07:34 -- nvmf/common.sh@520 -- # local subsystem config 00:25:00.279 02:07:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:00.279 02:07:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.279 02:07:34 -- common/autotest_common.sh@10 -- # set +x 00:25:00.279 02:07:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.279 { 00:25:00.279 "params": { 00:25:00.279 "name": "Nvme$subsystem", 00:25:00.279 "trtype": "$TEST_TRANSPORT", 00:25:00.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.279 "adrfam": "ipv4", 00:25:00.279 "trsvcid": "$NVMF_PORT", 00:25:00.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.279 "hdgst": ${hdgst:-false}, 00:25:00.279 "ddgst": ${ddgst:-false} 00:25:00.279 }, 00:25:00.279 "method": "bdev_nvme_attach_controller" 00:25:00.279 } 00:25:00.279 EOF 00:25:00.279 )") 00:25:00.279 02:07:34 -- nvmf/common.sh@542 -- # cat 00:25:00.279 02:07:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.279 02:07:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.279 { 00:25:00.279 "params": { 00:25:00.279 "name": "Nvme$subsystem", 00:25:00.279 "trtype": "$TEST_TRANSPORT", 00:25:00.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.279 "adrfam": "ipv4", 00:25:00.279 "trsvcid": "$NVMF_PORT", 00:25:00.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.279 "hdgst": ${hdgst:-false}, 00:25:00.279 "ddgst": ${ddgst:-false} 00:25:00.279 }, 00:25:00.279 "method": "bdev_nvme_attach_controller" 00:25:00.279 } 00:25:00.279 EOF 00:25:00.279 )") 00:25:00.279 02:07:34 -- nvmf/common.sh@542 -- # cat 00:25:00.279 02:07:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.279 02:07:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.279 { 00:25:00.279 "params": { 00:25:00.279 "name": "Nvme$subsystem", 00:25:00.279 "trtype": "$TEST_TRANSPORT", 00:25:00.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.279 "adrfam": "ipv4", 00:25:00.279 "trsvcid": "$NVMF_PORT", 00:25:00.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.279 "hdgst": ${hdgst:-false}, 00:25:00.279 "ddgst": ${ddgst:-false} 00:25:00.279 }, 00:25:00.279 "method": "bdev_nvme_attach_controller" 00:25:00.279 } 00:25:00.279 EOF 00:25:00.279 )") 00:25:00.279 02:07:34 -- nvmf/common.sh@542 -- # cat 00:25:00.279 02:07:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.279 02:07:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.279 { 00:25:00.279 "params": { 00:25:00.279 "name": "Nvme$subsystem", 00:25:00.279 "trtype": "$TEST_TRANSPORT", 00:25:00.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.279 "adrfam": "ipv4", 00:25:00.279 "trsvcid": "$NVMF_PORT", 00:25:00.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.279 "hdgst": ${hdgst:-false}, 00:25:00.279 "ddgst": ${ddgst:-false} 00:25:00.279 }, 00:25:00.279 "method": "bdev_nvme_attach_controller" 00:25:00.279 } 00:25:00.279 EOF 00:25:00.279 )") 00:25:00.279 02:07:34 -- nvmf/common.sh@542 -- # cat 00:25:00.279 02:07:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.279 02:07:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.279 { 00:25:00.279 "params": { 00:25:00.279 "name": "Nvme$subsystem", 00:25:00.279 "trtype": "$TEST_TRANSPORT", 00:25:00.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.279 "adrfam": "ipv4", 00:25:00.279 "trsvcid": "$NVMF_PORT", 00:25:00.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.280 "hdgst": ${hdgst:-false}, 00:25:00.280 "ddgst": ${ddgst:-false} 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 } 00:25:00.280 EOF 00:25:00.280 )") 00:25:00.280 02:07:34 -- nvmf/common.sh@542 -- # cat 00:25:00.280 02:07:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.280 02:07:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.280 { 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme$subsystem", 00:25:00.280 "trtype": "$TEST_TRANSPORT", 00:25:00.280 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "$NVMF_PORT", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.280 "hdgst": ${hdgst:-false}, 00:25:00.280 "ddgst": ${ddgst:-false} 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 } 00:25:00.280 EOF 00:25:00.280 )") 00:25:00.280 02:07:34 -- nvmf/common.sh@542 -- # cat 00:25:00.280 02:07:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.280 02:07:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.280 { 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme$subsystem", 00:25:00.280 "trtype": "$TEST_TRANSPORT", 00:25:00.280 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "$NVMF_PORT", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.280 "hdgst": ${hdgst:-false}, 00:25:00.280 "ddgst": ${ddgst:-false} 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 } 00:25:00.280 EOF 00:25:00.280 )") 00:25:00.280 02:07:34 -- nvmf/common.sh@542 -- # cat 00:25:00.280 02:07:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.280 02:07:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.280 { 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme$subsystem", 00:25:00.280 "trtype": "$TEST_TRANSPORT", 00:25:00.280 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "$NVMF_PORT", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.280 "hdgst": ${hdgst:-false}, 00:25:00.280 "ddgst": ${ddgst:-false} 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 } 00:25:00.280 EOF 00:25:00.280 )") 00:25:00.280 02:07:34 -- nvmf/common.sh@542 -- # cat 00:25:00.280 02:07:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.280 02:07:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.280 { 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme$subsystem", 00:25:00.280 "trtype": "$TEST_TRANSPORT", 00:25:00.280 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "$NVMF_PORT", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.280 "hdgst": ${hdgst:-false}, 00:25:00.280 "ddgst": ${ddgst:-false} 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 } 00:25:00.280 EOF 00:25:00.280 )") 00:25:00.280 02:07:34 -- nvmf/common.sh@542 -- # cat 00:25:00.280 02:07:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:00.280 02:07:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:00.280 { 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme$subsystem", 00:25:00.280 "trtype": "$TEST_TRANSPORT", 00:25:00.280 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "$NVMF_PORT", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:00.280 "hdgst": ${hdgst:-false}, 00:25:00.280 "ddgst": ${ddgst:-false} 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 } 00:25:00.280 EOF 00:25:00.280 )") 00:25:00.280 02:07:34 -- nvmf/common.sh@542 -- # cat 00:25:00.280 02:07:34 -- nvmf/common.sh@544 -- # jq . 00:25:00.280 02:07:34 -- nvmf/common.sh@545 -- # IFS=, 00:25:00.280 02:07:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme1", 00:25:00.280 "trtype": "tcp", 00:25:00.280 "traddr": "10.0.0.2", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "4420", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:00.280 "hdgst": false, 00:25:00.280 "ddgst": false 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 },{ 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme2", 00:25:00.280 "trtype": "tcp", 00:25:00.280 "traddr": "10.0.0.2", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "4420", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:00.280 "hdgst": false, 00:25:00.280 "ddgst": false 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 },{ 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme3", 00:25:00.280 "trtype": "tcp", 00:25:00.280 "traddr": "10.0.0.2", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "4420", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:00.280 "hdgst": false, 00:25:00.280 "ddgst": false 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 },{ 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme4", 00:25:00.280 "trtype": "tcp", 00:25:00.280 "traddr": "10.0.0.2", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "4420", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:00.280 "hdgst": false, 00:25:00.280 "ddgst": false 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 },{ 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme5", 00:25:00.280 "trtype": "tcp", 00:25:00.280 "traddr": "10.0.0.2", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "4420", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:00.280 "hdgst": false, 00:25:00.280 "ddgst": false 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 },{ 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme6", 00:25:00.280 "trtype": "tcp", 00:25:00.280 "traddr": "10.0.0.2", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "4420", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:00.280 "hdgst": false, 00:25:00.280 "ddgst": false 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 },{ 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme7", 00:25:00.280 "trtype": "tcp", 00:25:00.280 "traddr": "10.0.0.2", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "4420", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:00.280 "hdgst": false, 00:25:00.280 "ddgst": false 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 },{ 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme8", 00:25:00.280 "trtype": "tcp", 00:25:00.280 "traddr": "10.0.0.2", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "4420", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:00.280 "hdgst": false, 00:25:00.280 "ddgst": false 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 },{ 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme9", 00:25:00.280 "trtype": "tcp", 00:25:00.280 "traddr": "10.0.0.2", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "4420", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:00.280 "hdgst": false, 00:25:00.280 "ddgst": false 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 },{ 00:25:00.280 "params": { 00:25:00.280 "name": "Nvme10", 00:25:00.280 "trtype": "tcp", 00:25:00.280 "traddr": "10.0.0.2", 00:25:00.280 "adrfam": "ipv4", 00:25:00.280 "trsvcid": "4420", 00:25:00.280 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:00.280 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:00.280 "hdgst": false, 00:25:00.280 "ddgst": false 00:25:00.280 }, 00:25:00.280 "method": "bdev_nvme_attach_controller" 00:25:00.280 }' 00:25:00.280 [2024-11-18 02:07:34.609756] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:00.281 [2024-11-18 02:07:34.609831] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1280242 ] 00:25:00.281 EAL: No free 2048 kB hugepages reported on node 1 00:25:00.281 [2024-11-18 02:07:34.673489] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:00.541 [2024-11-18 02:07:34.760220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:02.444 Running I/O for 10 seconds... 00:25:03.011 02:07:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:03.011 02:07:37 -- common/autotest_common.sh@862 -- # return 0 00:25:03.011 02:07:37 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:03.011 02:07:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:03.011 02:07:37 -- common/autotest_common.sh@10 -- # set +x 00:25:03.011 02:07:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:03.011 02:07:37 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:03.011 02:07:37 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:03.011 02:07:37 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:03.011 02:07:37 -- target/shutdown.sh@57 -- # local ret=1 00:25:03.011 02:07:37 -- target/shutdown.sh@58 -- # local i 00:25:03.011 02:07:37 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:03.011 02:07:37 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:03.011 02:07:37 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:03.011 02:07:37 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:03.011 02:07:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:03.011 02:07:37 -- common/autotest_common.sh@10 -- # set +x 00:25:03.011 02:07:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:03.011 02:07:37 -- target/shutdown.sh@60 -- # read_io_count=211 00:25:03.011 02:07:37 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:25:03.011 02:07:37 -- target/shutdown.sh@64 -- # ret=0 00:25:03.011 02:07:37 -- target/shutdown.sh@65 -- # break 00:25:03.011 02:07:37 -- target/shutdown.sh@69 -- # return 0 00:25:03.011 02:07:37 -- target/shutdown.sh@109 -- # killprocess 1280242 00:25:03.011 02:07:37 -- common/autotest_common.sh@936 -- # '[' -z 1280242 ']' 00:25:03.011 02:07:37 -- common/autotest_common.sh@940 -- # kill -0 1280242 00:25:03.011 02:07:37 -- common/autotest_common.sh@941 -- # uname 00:25:03.011 02:07:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:03.011 02:07:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1280242 00:25:03.011 02:07:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:03.011 02:07:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:03.011 02:07:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1280242' 00:25:03.011 killing process with pid 1280242 00:25:03.011 02:07:37 -- common/autotest_common.sh@955 -- # kill 1280242 00:25:03.011 02:07:37 -- common/autotest_common.sh@960 -- # wait 1280242 00:25:03.011 Received shutdown signal, test time was about 0.802569 seconds 00:25:03.011 00:25:03.011 Latency(us) 00:25:03.011 [2024-11-18T01:07:37.413Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:03.011 [2024-11-18T01:07:37.413Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.011 Verification LBA range: start 0x0 length 0x400 00:25:03.011 Nvme1n1 : 0.79 399.39 24.96 0.00 0.00 155883.37 26602.76 121945.51 00:25:03.011 [2024-11-18T01:07:37.413Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.011 Verification LBA range: start 0x0 length 0x400 00:25:03.011 Nvme2n1 : 0.79 401.53 25.10 0.00 0.00 153980.60 22427.88 148354.09 00:25:03.011 [2024-11-18T01:07:37.413Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.011 Verification LBA range: start 0x0 length 0x400 00:25:03.011 Nvme3n1 : 0.79 398.61 24.91 0.00 0.00 153137.10 25826.04 121168.78 00:25:03.011 [2024-11-18T01:07:37.413Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.011 Verification LBA range: start 0x0 length 0x400 00:25:03.011 Nvme4n1 : 0.79 396.62 24.79 0.00 0.00 152167.43 27962.03 121945.51 00:25:03.011 [2024-11-18T01:07:37.413Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.011 Verification LBA range: start 0x0 length 0x400 00:25:03.011 Nvme5n1 : 0.80 395.50 24.72 0.00 0.00 151511.06 24758.04 121945.51 00:25:03.011 [2024-11-18T01:07:37.413Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.011 Verification LBA range: start 0x0 length 0x400 00:25:03.011 Nvme6n1 : 0.80 394.04 24.63 0.00 0.00 150838.98 21942.42 122722.23 00:25:03.011 [2024-11-18T01:07:37.413Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.011 Verification LBA range: start 0x0 length 0x400 00:25:03.011 Nvme7n1 : 0.80 392.88 24.56 0.00 0.00 150029.59 20777.34 123498.95 00:25:03.011 [2024-11-18T01:07:37.414Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.012 Verification LBA range: start 0x0 length 0x400 00:25:03.012 Nvme8n1 : 0.76 358.76 22.42 0.00 0.00 161597.82 20680.25 128936.01 00:25:03.012 [2024-11-18T01:07:37.414Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.012 Verification LBA range: start 0x0 length 0x400 00:25:03.012 Nvme9n1 : 0.77 354.26 22.14 0.00 0.00 161428.09 25243.50 128936.01 00:25:03.012 [2024-11-18T01:07:37.414Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:03.012 Verification LBA range: start 0x0 length 0x400 00:25:03.012 Nvme10n1 : 0.77 354.02 22.13 0.00 0.00 159677.65 4538.97 128936.01 00:25:03.012 [2024-11-18T01:07:37.414Z] =================================================================================================================== 00:25:03.012 [2024-11-18T01:07:37.414Z] Total : 3845.62 240.35 0.00 0.00 154776.71 4538.97 148354.09 00:25:03.270 02:07:37 -- target/shutdown.sh@112 -- # sleep 1 00:25:04.205 02:07:38 -- target/shutdown.sh@113 -- # kill -0 1280052 00:25:04.205 02:07:38 -- target/shutdown.sh@115 -- # stoptarget 00:25:04.205 02:07:38 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:04.205 02:07:38 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:04.205 02:07:38 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:04.205 02:07:38 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:04.205 02:07:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:04.205 02:07:38 -- nvmf/common.sh@116 -- # sync 00:25:04.205 02:07:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:04.205 02:07:38 -- nvmf/common.sh@119 -- # set +e 00:25:04.205 02:07:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:04.205 02:07:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:04.205 rmmod nvme_tcp 00:25:04.205 rmmod nvme_fabrics 00:25:04.205 rmmod nvme_keyring 00:25:04.205 02:07:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:04.465 02:07:38 -- nvmf/common.sh@123 -- # set -e 00:25:04.465 02:07:38 -- nvmf/common.sh@124 -- # return 0 00:25:04.465 02:07:38 -- nvmf/common.sh@477 -- # '[' -n 1280052 ']' 00:25:04.465 02:07:38 -- nvmf/common.sh@478 -- # killprocess 1280052 00:25:04.465 02:07:38 -- common/autotest_common.sh@936 -- # '[' -z 1280052 ']' 00:25:04.465 02:07:38 -- common/autotest_common.sh@940 -- # kill -0 1280052 00:25:04.465 02:07:38 -- common/autotest_common.sh@941 -- # uname 00:25:04.465 02:07:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:04.465 02:07:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1280052 00:25:04.465 02:07:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:04.465 02:07:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:04.465 02:07:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1280052' 00:25:04.465 killing process with pid 1280052 00:25:04.465 02:07:38 -- common/autotest_common.sh@955 -- # kill 1280052 00:25:04.465 02:07:38 -- common/autotest_common.sh@960 -- # wait 1280052 00:25:05.035 02:07:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:05.035 02:07:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:05.035 02:07:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:05.035 02:07:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:05.035 02:07:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:05.035 02:07:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:05.035 02:07:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:05.035 02:07:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:06.946 02:07:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:06.946 00:25:06.946 real 0m8.493s 00:25:06.946 user 0m27.109s 00:25:06.946 sys 0m1.576s 00:25:06.946 02:07:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:06.946 02:07:41 -- common/autotest_common.sh@10 -- # set +x 00:25:06.946 ************************************ 00:25:06.946 END TEST nvmf_shutdown_tc2 00:25:06.946 ************************************ 00:25:06.946 02:07:41 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:06.946 02:07:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:06.946 02:07:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:06.946 02:07:41 -- common/autotest_common.sh@10 -- # set +x 00:25:06.946 ************************************ 00:25:06.946 START TEST nvmf_shutdown_tc3 00:25:06.946 ************************************ 00:25:06.946 02:07:41 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:06.946 02:07:41 -- target/shutdown.sh@120 -- # starttarget 00:25:06.946 02:07:41 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:06.946 02:07:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:06.946 02:07:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:06.946 02:07:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:06.946 02:07:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:06.946 02:07:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:06.946 02:07:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:06.946 02:07:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:06.946 02:07:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:06.946 02:07:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:06.946 02:07:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:06.946 02:07:41 -- common/autotest_common.sh@10 -- # set +x 00:25:06.946 02:07:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:06.946 02:07:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:06.946 02:07:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:06.946 02:07:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:06.946 02:07:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:06.946 02:07:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:06.946 02:07:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:06.946 02:07:41 -- nvmf/common.sh@294 -- # net_devs=() 00:25:06.946 02:07:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:06.946 02:07:41 -- nvmf/common.sh@295 -- # e810=() 00:25:06.946 02:07:41 -- nvmf/common.sh@295 -- # local -ga e810 00:25:06.946 02:07:41 -- nvmf/common.sh@296 -- # x722=() 00:25:06.946 02:07:41 -- nvmf/common.sh@296 -- # local -ga x722 00:25:06.946 02:07:41 -- nvmf/common.sh@297 -- # mlx=() 00:25:06.946 02:07:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:06.946 02:07:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:06.946 02:07:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:06.946 02:07:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:06.946 02:07:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:06.946 02:07:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:06.946 02:07:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:06.946 02:07:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:06.946 02:07:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:06.946 02:07:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:06.946 02:07:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:06.946 02:07:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:06.946 02:07:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:06.946 02:07:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:06.946 02:07:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:06.946 02:07:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:06.946 02:07:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:06.946 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:06.946 02:07:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:06.946 02:07:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:06.946 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:06.946 02:07:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:06.946 02:07:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:06.946 02:07:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:06.946 02:07:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:06.946 02:07:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:06.946 02:07:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:06.946 02:07:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:06.946 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:06.946 02:07:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:06.946 02:07:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:06.946 02:07:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:06.946 02:07:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:06.946 02:07:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:06.946 02:07:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:06.946 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:06.946 02:07:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:06.946 02:07:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:06.947 02:07:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:06.947 02:07:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:06.947 02:07:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:06.947 02:07:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:06.947 02:07:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:06.947 02:07:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:06.947 02:07:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:06.947 02:07:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:06.947 02:07:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:06.947 02:07:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:06.947 02:07:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:06.947 02:07:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:06.947 02:07:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:06.947 02:07:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:06.947 02:07:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:06.947 02:07:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:06.947 02:07:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:07.206 02:07:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:07.206 02:07:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:07.206 02:07:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:07.206 02:07:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:07.206 02:07:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:07.206 02:07:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:07.206 02:07:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:07.206 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:07.206 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.351 ms 00:25:07.206 00:25:07.206 --- 10.0.0.2 ping statistics --- 00:25:07.206 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:07.206 rtt min/avg/max/mdev = 0.351/0.351/0.351/0.000 ms 00:25:07.206 02:07:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:07.206 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:07.206 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.208 ms 00:25:07.206 00:25:07.206 --- 10.0.0.1 ping statistics --- 00:25:07.206 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:07.206 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:25:07.206 02:07:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:07.206 02:07:41 -- nvmf/common.sh@410 -- # return 0 00:25:07.206 02:07:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:07.206 02:07:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:07.206 02:07:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:07.206 02:07:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:07.206 02:07:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:07.206 02:07:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:07.206 02:07:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:07.206 02:07:41 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:07.206 02:07:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:07.206 02:07:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:07.206 02:07:41 -- common/autotest_common.sh@10 -- # set +x 00:25:07.206 02:07:41 -- nvmf/common.sh@469 -- # nvmfpid=1281192 00:25:07.206 02:07:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:07.206 02:07:41 -- nvmf/common.sh@470 -- # waitforlisten 1281192 00:25:07.206 02:07:41 -- common/autotest_common.sh@829 -- # '[' -z 1281192 ']' 00:25:07.206 02:07:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:07.206 02:07:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:07.206 02:07:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:07.206 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:07.206 02:07:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:07.206 02:07:41 -- common/autotest_common.sh@10 -- # set +x 00:25:07.206 [2024-11-18 02:07:41.500253] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:07.206 [2024-11-18 02:07:41.500356] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:07.206 EAL: No free 2048 kB hugepages reported on node 1 00:25:07.206 [2024-11-18 02:07:41.565231] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:07.466 [2024-11-18 02:07:41.651807] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:07.466 [2024-11-18 02:07:41.651938] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:07.467 [2024-11-18 02:07:41.651955] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:07.467 [2024-11-18 02:07:41.651967] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:07.467 [2024-11-18 02:07:41.652053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:07.467 [2024-11-18 02:07:41.652117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:07.467 [2024-11-18 02:07:41.652165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:07.467 [2024-11-18 02:07:41.652167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:08.405 02:07:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:08.405 02:07:42 -- common/autotest_common.sh@862 -- # return 0 00:25:08.405 02:07:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:08.405 02:07:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:08.405 02:07:42 -- common/autotest_common.sh@10 -- # set +x 00:25:08.405 02:07:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:08.405 02:07:42 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:08.405 02:07:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:08.405 02:07:42 -- common/autotest_common.sh@10 -- # set +x 00:25:08.405 [2024-11-18 02:07:42.547090] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:08.405 02:07:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:08.405 02:07:42 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:08.405 02:07:42 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:08.405 02:07:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:08.405 02:07:42 -- common/autotest_common.sh@10 -- # set +x 00:25:08.405 02:07:42 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:08.405 02:07:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:08.405 02:07:42 -- target/shutdown.sh@28 -- # cat 00:25:08.405 02:07:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:08.405 02:07:42 -- target/shutdown.sh@28 -- # cat 00:25:08.405 02:07:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:08.405 02:07:42 -- target/shutdown.sh@28 -- # cat 00:25:08.405 02:07:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:08.405 02:07:42 -- target/shutdown.sh@28 -- # cat 00:25:08.405 02:07:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:08.405 02:07:42 -- target/shutdown.sh@28 -- # cat 00:25:08.405 02:07:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:08.405 02:07:42 -- target/shutdown.sh@28 -- # cat 00:25:08.405 02:07:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:08.405 02:07:42 -- target/shutdown.sh@28 -- # cat 00:25:08.405 02:07:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:08.405 02:07:42 -- target/shutdown.sh@28 -- # cat 00:25:08.405 02:07:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:08.405 02:07:42 -- target/shutdown.sh@28 -- # cat 00:25:08.405 02:07:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:08.405 02:07:42 -- target/shutdown.sh@28 -- # cat 00:25:08.405 02:07:42 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:08.405 02:07:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:08.405 02:07:42 -- common/autotest_common.sh@10 -- # set +x 00:25:08.405 Malloc1 00:25:08.405 [2024-11-18 02:07:42.631018] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:08.405 Malloc2 00:25:08.405 Malloc3 00:25:08.405 Malloc4 00:25:08.405 Malloc5 00:25:08.664 Malloc6 00:25:08.664 Malloc7 00:25:08.664 Malloc8 00:25:08.664 Malloc9 00:25:08.664 Malloc10 00:25:08.664 02:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:08.664 02:07:43 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:08.664 02:07:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:08.664 02:07:43 -- common/autotest_common.sh@10 -- # set +x 00:25:08.923 02:07:43 -- target/shutdown.sh@124 -- # perfpid=1281506 00:25:08.923 02:07:43 -- target/shutdown.sh@125 -- # waitforlisten 1281506 /var/tmp/bdevperf.sock 00:25:08.923 02:07:43 -- common/autotest_common.sh@829 -- # '[' -z 1281506 ']' 00:25:08.923 02:07:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:08.923 02:07:43 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:08.923 02:07:43 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:08.923 02:07:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:08.923 02:07:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:08.923 02:07:43 -- nvmf/common.sh@520 -- # config=() 00:25:08.923 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:08.923 02:07:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:08.923 02:07:43 -- nvmf/common.sh@520 -- # local subsystem config 00:25:08.923 02:07:43 -- common/autotest_common.sh@10 -- # set +x 00:25:08.923 02:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:08.923 02:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:08.923 { 00:25:08.923 "params": { 00:25:08.923 "name": "Nvme$subsystem", 00:25:08.923 "trtype": "$TEST_TRANSPORT", 00:25:08.923 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:08.923 "adrfam": "ipv4", 00:25:08.923 "trsvcid": "$NVMF_PORT", 00:25:08.923 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:08.923 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:08.923 "hdgst": ${hdgst:-false}, 00:25:08.923 "ddgst": ${ddgst:-false} 00:25:08.923 }, 00:25:08.923 "method": "bdev_nvme_attach_controller" 00:25:08.923 } 00:25:08.923 EOF 00:25:08.923 )") 00:25:08.923 02:07:43 -- nvmf/common.sh@542 -- # cat 00:25:08.923 02:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:08.923 02:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:08.923 { 00:25:08.923 "params": { 00:25:08.923 "name": "Nvme$subsystem", 00:25:08.923 "trtype": "$TEST_TRANSPORT", 00:25:08.923 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:08.923 "adrfam": "ipv4", 00:25:08.923 "trsvcid": "$NVMF_PORT", 00:25:08.923 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:08.923 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:08.923 "hdgst": ${hdgst:-false}, 00:25:08.923 "ddgst": ${ddgst:-false} 00:25:08.923 }, 00:25:08.923 "method": "bdev_nvme_attach_controller" 00:25:08.923 } 00:25:08.923 EOF 00:25:08.924 )") 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # cat 00:25:08.924 02:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:08.924 { 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme$subsystem", 00:25:08.924 "trtype": "$TEST_TRANSPORT", 00:25:08.924 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "$NVMF_PORT", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:08.924 "hdgst": ${hdgst:-false}, 00:25:08.924 "ddgst": ${ddgst:-false} 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 } 00:25:08.924 EOF 00:25:08.924 )") 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # cat 00:25:08.924 02:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:08.924 { 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme$subsystem", 00:25:08.924 "trtype": "$TEST_TRANSPORT", 00:25:08.924 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "$NVMF_PORT", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:08.924 "hdgst": ${hdgst:-false}, 00:25:08.924 "ddgst": ${ddgst:-false} 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 } 00:25:08.924 EOF 00:25:08.924 )") 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # cat 00:25:08.924 02:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:08.924 { 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme$subsystem", 00:25:08.924 "trtype": "$TEST_TRANSPORT", 00:25:08.924 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "$NVMF_PORT", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:08.924 "hdgst": ${hdgst:-false}, 00:25:08.924 "ddgst": ${ddgst:-false} 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 } 00:25:08.924 EOF 00:25:08.924 )") 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # cat 00:25:08.924 02:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:08.924 { 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme$subsystem", 00:25:08.924 "trtype": "$TEST_TRANSPORT", 00:25:08.924 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "$NVMF_PORT", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:08.924 "hdgst": ${hdgst:-false}, 00:25:08.924 "ddgst": ${ddgst:-false} 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 } 00:25:08.924 EOF 00:25:08.924 )") 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # cat 00:25:08.924 02:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:08.924 { 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme$subsystem", 00:25:08.924 "trtype": "$TEST_TRANSPORT", 00:25:08.924 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "$NVMF_PORT", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:08.924 "hdgst": ${hdgst:-false}, 00:25:08.924 "ddgst": ${ddgst:-false} 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 } 00:25:08.924 EOF 00:25:08.924 )") 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # cat 00:25:08.924 02:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:08.924 { 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme$subsystem", 00:25:08.924 "trtype": "$TEST_TRANSPORT", 00:25:08.924 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "$NVMF_PORT", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:08.924 "hdgst": ${hdgst:-false}, 00:25:08.924 "ddgst": ${ddgst:-false} 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 } 00:25:08.924 EOF 00:25:08.924 )") 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # cat 00:25:08.924 02:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:08.924 { 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme$subsystem", 00:25:08.924 "trtype": "$TEST_TRANSPORT", 00:25:08.924 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "$NVMF_PORT", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:08.924 "hdgst": ${hdgst:-false}, 00:25:08.924 "ddgst": ${ddgst:-false} 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 } 00:25:08.924 EOF 00:25:08.924 )") 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # cat 00:25:08.924 02:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:08.924 { 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme$subsystem", 00:25:08.924 "trtype": "$TEST_TRANSPORT", 00:25:08.924 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "$NVMF_PORT", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:08.924 "hdgst": ${hdgst:-false}, 00:25:08.924 "ddgst": ${ddgst:-false} 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 } 00:25:08.924 EOF 00:25:08.924 )") 00:25:08.924 02:07:43 -- nvmf/common.sh@542 -- # cat 00:25:08.924 02:07:43 -- nvmf/common.sh@544 -- # jq . 00:25:08.924 02:07:43 -- nvmf/common.sh@545 -- # IFS=, 00:25:08.924 02:07:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme1", 00:25:08.924 "trtype": "tcp", 00:25:08.924 "traddr": "10.0.0.2", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "4420", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:08.924 "hdgst": false, 00:25:08.924 "ddgst": false 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 },{ 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme2", 00:25:08.924 "trtype": "tcp", 00:25:08.924 "traddr": "10.0.0.2", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "4420", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:08.924 "hdgst": false, 00:25:08.924 "ddgst": false 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 },{ 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme3", 00:25:08.924 "trtype": "tcp", 00:25:08.924 "traddr": "10.0.0.2", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "4420", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:08.924 "hdgst": false, 00:25:08.924 "ddgst": false 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 },{ 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme4", 00:25:08.924 "trtype": "tcp", 00:25:08.924 "traddr": "10.0.0.2", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "4420", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:08.924 "hdgst": false, 00:25:08.924 "ddgst": false 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 },{ 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme5", 00:25:08.924 "trtype": "tcp", 00:25:08.924 "traddr": "10.0.0.2", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "4420", 00:25:08.924 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:08.924 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:08.924 "hdgst": false, 00:25:08.924 "ddgst": false 00:25:08.924 }, 00:25:08.924 "method": "bdev_nvme_attach_controller" 00:25:08.924 },{ 00:25:08.924 "params": { 00:25:08.924 "name": "Nvme6", 00:25:08.924 "trtype": "tcp", 00:25:08.924 "traddr": "10.0.0.2", 00:25:08.924 "adrfam": "ipv4", 00:25:08.924 "trsvcid": "4420", 00:25:08.925 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:08.925 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:08.925 "hdgst": false, 00:25:08.925 "ddgst": false 00:25:08.925 }, 00:25:08.925 "method": "bdev_nvme_attach_controller" 00:25:08.925 },{ 00:25:08.925 "params": { 00:25:08.925 "name": "Nvme7", 00:25:08.925 "trtype": "tcp", 00:25:08.925 "traddr": "10.0.0.2", 00:25:08.925 "adrfam": "ipv4", 00:25:08.925 "trsvcid": "4420", 00:25:08.925 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:08.925 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:08.925 "hdgst": false, 00:25:08.925 "ddgst": false 00:25:08.925 }, 00:25:08.925 "method": "bdev_nvme_attach_controller" 00:25:08.925 },{ 00:25:08.925 "params": { 00:25:08.925 "name": "Nvme8", 00:25:08.925 "trtype": "tcp", 00:25:08.925 "traddr": "10.0.0.2", 00:25:08.925 "adrfam": "ipv4", 00:25:08.925 "trsvcid": "4420", 00:25:08.925 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:08.925 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:08.925 "hdgst": false, 00:25:08.925 "ddgst": false 00:25:08.925 }, 00:25:08.925 "method": "bdev_nvme_attach_controller" 00:25:08.925 },{ 00:25:08.925 "params": { 00:25:08.925 "name": "Nvme9", 00:25:08.925 "trtype": "tcp", 00:25:08.925 "traddr": "10.0.0.2", 00:25:08.925 "adrfam": "ipv4", 00:25:08.925 "trsvcid": "4420", 00:25:08.925 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:08.925 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:08.925 "hdgst": false, 00:25:08.925 "ddgst": false 00:25:08.925 }, 00:25:08.925 "method": "bdev_nvme_attach_controller" 00:25:08.925 },{ 00:25:08.925 "params": { 00:25:08.925 "name": "Nvme10", 00:25:08.925 "trtype": "tcp", 00:25:08.925 "traddr": "10.0.0.2", 00:25:08.925 "adrfam": "ipv4", 00:25:08.925 "trsvcid": "4420", 00:25:08.925 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:08.925 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:08.925 "hdgst": false, 00:25:08.925 "ddgst": false 00:25:08.925 }, 00:25:08.925 "method": "bdev_nvme_attach_controller" 00:25:08.925 }' 00:25:08.925 [2024-11-18 02:07:43.122545] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:08.925 [2024-11-18 02:07:43.122646] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1281506 ] 00:25:08.925 EAL: No free 2048 kB hugepages reported on node 1 00:25:08.925 [2024-11-18 02:07:43.186164] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:08.925 [2024-11-18 02:07:43.271125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:10.305 Running I/O for 10 seconds... 00:25:10.564 02:07:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:10.564 02:07:44 -- common/autotest_common.sh@862 -- # return 0 00:25:10.564 02:07:44 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:10.564 02:07:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:10.564 02:07:44 -- common/autotest_common.sh@10 -- # set +x 00:25:10.564 02:07:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:10.564 02:07:44 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:10.564 02:07:44 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:10.564 02:07:44 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:10.564 02:07:44 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:10.564 02:07:44 -- target/shutdown.sh@57 -- # local ret=1 00:25:10.564 02:07:44 -- target/shutdown.sh@58 -- # local i 00:25:10.564 02:07:44 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:10.564 02:07:44 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:10.564 02:07:44 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:10.564 02:07:44 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:10.564 02:07:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:10.564 02:07:44 -- common/autotest_common.sh@10 -- # set +x 00:25:10.825 02:07:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:10.825 02:07:44 -- target/shutdown.sh@60 -- # read_io_count=87 00:25:10.825 02:07:44 -- target/shutdown.sh@63 -- # '[' 87 -ge 100 ']' 00:25:10.825 02:07:44 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:11.103 02:07:45 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:11.103 02:07:45 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:11.103 02:07:45 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:11.103 02:07:45 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:11.103 02:07:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:11.103 02:07:45 -- common/autotest_common.sh@10 -- # set +x 00:25:11.103 02:07:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:11.103 02:07:45 -- target/shutdown.sh@60 -- # read_io_count=211 00:25:11.103 02:07:45 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:25:11.103 02:07:45 -- target/shutdown.sh@64 -- # ret=0 00:25:11.103 02:07:45 -- target/shutdown.sh@65 -- # break 00:25:11.103 02:07:45 -- target/shutdown.sh@69 -- # return 0 00:25:11.103 02:07:45 -- target/shutdown.sh@134 -- # killprocess 1281192 00:25:11.103 02:07:45 -- common/autotest_common.sh@936 -- # '[' -z 1281192 ']' 00:25:11.103 02:07:45 -- common/autotest_common.sh@940 -- # kill -0 1281192 00:25:11.103 02:07:45 -- common/autotest_common.sh@941 -- # uname 00:25:11.103 02:07:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:11.103 02:07:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1281192 00:25:11.103 02:07:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:11.103 02:07:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:11.103 02:07:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1281192' 00:25:11.103 killing process with pid 1281192 00:25:11.103 02:07:45 -- common/autotest_common.sh@955 -- # kill 1281192 00:25:11.103 02:07:45 -- common/autotest_common.sh@960 -- # wait 1281192 00:25:11.103 [2024-11-18 02:07:45.325731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.325812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.325844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.325856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.325868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.325880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.325892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.325929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.325942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.325954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.325965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.325978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.325990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326095] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.103 [2024-11-18 02:07:45.326442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.326606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf2e70 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.327382] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.104 [2024-11-18 02:07:45.327423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.104 [2024-11-18 02:07:45.327441] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.104 [2024-11-18 02:07:45.327455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.104 [2024-11-18 02:07:45.327468] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.104 [2024-11-18 02:07:45.327481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.104 [2024-11-18 02:07:45.327495] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.104 [2024-11-18 02:07:45.327508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.104 [2024-11-18 02:07:45.327521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1635fe0 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.330427] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:11.104 [2024-11-18 02:07:45.334264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.334999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.335019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5840 is same with the state(5) to be set 00:25:11.104 [2024-11-18 02:07:45.335418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.104 [2024-11-18 02:07:45.335449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.104 [2024-11-18 02:07:45.335480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.104 [2024-11-18 02:07:45.335495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.104 [2024-11-18 02:07:45.335511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.104 [2024-11-18 02:07:45.335524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.104 [2024-11-18 02:07:45.335539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.104 [2024-11-18 02:07:45.335552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.104 [2024-11-18 02:07:45.335567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.104 [2024-11-18 02:07:45.335580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.104 [2024-11-18 02:07:45.335595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.104 [2024-11-18 02:07:45.335619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.104 [2024-11-18 02:07:45.335634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.104 [2024-11-18 02:07:45.335647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.104 [2024-11-18 02:07:45.335662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.104 [2024-11-18 02:07:45.335675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.335689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.335703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.335718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.335731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.335746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.335759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.335773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.335787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.335802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.335822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.335838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.335852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.335866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.335880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.335895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.335907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.335922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.335935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.335949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.335963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.335977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.335990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.105 [2024-11-18 02:07:45.336788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with [2024-11-18 02:07:45.336797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:11.105 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.105 [2024-11-18 02:07:45.336814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with [2024-11-18 02:07:45.336815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:32512 len:1the state(5) to be set 00:25:11.106 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.336828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.336832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.336840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.336848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.336852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.336862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 02:07:45.336864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.336881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.336884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.336893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.336899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.336904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.336915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:32896 len:1[2024-11-18 02:07:45.336917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.336930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with [2024-11-18 02:07:45.336931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:11.106 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.336943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.336948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.336956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.336963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.336968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.336979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with [2024-11-18 02:07:45.336979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33152 len:12the state(5) to be set 00:25:11.106 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.336993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.336996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.337017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with [2024-11-18 02:07:45.337042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33408 len:1the state(5) to be set 00:25:11.106 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.337057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337069] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.337081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.337117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.337141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.337178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.337202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with [2024-11-18 02:07:45.337228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34176 len:12the state(5) to be set 00:25:11.106 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.337253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with [2024-11-18 02:07:45.337254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:11.106 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.337280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.337327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.337353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.106 [2024-11-18 02:07:45.337386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.106 [2024-11-18 02:07:45.337399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.106 [2024-11-18 02:07:45.337423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3300 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.337966] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x162d060 was disconnected and freed. reset controller. 00:25:11.107 [2024-11-18 02:07:45.338109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1635fe0 (9): Bad file descriptor 00:25:11.107 [2024-11-18 02:07:45.338169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.107 [2024-11-18 02:07:45.338190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.107 [2024-11-18 02:07:45.338204] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.107 [2024-11-18 02:07:45.338217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.107 [2024-11-18 02:07:45.338231] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.107 [2024-11-18 02:07:45.338244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.107 [2024-11-18 02:07:45.338257] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.107 [2024-11-18 02:07:45.338270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.107 [2024-11-18 02:07:45.338282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17fd240 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.339997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.340009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.340021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.107 [2024-11-18 02:07:45.340032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.340028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:11.108 [2024-11-18 02:07:45.340044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.340056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.340067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with [2024-11-18 02:07:45.340065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17fd240 (9): the state(5) to be set 00:25:11.108 Bad file descriptor 00:25:11.108 [2024-11-18 02:07:45.340082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.340094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.340105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.340116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.340128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf37b0 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.341996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf3c40 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.342397] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:11.108 [2024-11-18 02:07:45.343156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.108 [2024-11-18 02:07:45.343182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.108 [2024-11-18 02:07:45.343205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.108 [2024-11-18 02:07:45.343220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.108 [2024-11-18 02:07:45.343236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.108 [2024-11-18 02:07:45.343249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.108 [2024-11-18 02:07:45.343264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.108 [2024-11-18 02:07:45.343277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.108 [2024-11-18 02:07:45.343292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.108 [2024-11-18 02:07:45.343320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.108 [2024-11-18 02:07:45.343339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.108 [2024-11-18 02:07:45.343340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with [2024-11-18 02:07:45.343353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:11.108 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.108 [2024-11-18 02:07:45.343376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.108 [2024-11-18 02:07:45.343380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.343389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.108 [2024-11-18 02:07:45.343395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.343405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.108 [2024-11-18 02:07:45.343408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.343419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 02:07:45.343421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.108 the state(5) to be set 00:25:11.108 [2024-11-18 02:07:45.343434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:12[2024-11-18 02:07:45.343495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with [2024-11-18 02:07:45.343509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:11.109 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with [2024-11-18 02:07:45.343625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:12the state(5) to be set 00:25:11.109 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with [2024-11-18 02:07:45.343686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:12the state(5) to be set 00:25:11.109 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27776 len:128[2024-11-18 02:07:45.343724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with [2024-11-18 02:07:45.343738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:11.109 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:12[2024-11-18 02:07:45.343786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 02:07:45.343800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:12[2024-11-18 02:07:45.343875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with [2024-11-18 02:07:45.343966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:12the state(5) to be set 00:25:11.109 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.343979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.109 [2024-11-18 02:07:45.343990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.109 [2024-11-18 02:07:45.343996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.109 [2024-11-18 02:07:45.344002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:12[2024-11-18 02:07:45.344026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 02:07:45.344041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:12[2024-11-18 02:07:45.344118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with [2024-11-18 02:07:45.344131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:11.110 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf40f0 is same with the state(5) to be set 00:25:11.110 [2024-11-18 02:07:45.344178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.110 [2024-11-18 02:07:45.344973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.110 [2024-11-18 02:07:45.344986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345196] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x17ba1e0 was disconnected and freed. reset controller. 00:25:11.111 [2024-11-18 02:07:45.345239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128[2024-11-18 02:07:45.345341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 02:07:45.345406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 02:07:45.345467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:12[2024-11-18 02:07:45.345519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with [2024-11-18 02:07:45.345533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:11.111 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128[2024-11-18 02:07:45.345580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with [2024-11-18 02:07:45.345594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:11.111 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 02:07:45.345663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.111 [2024-11-18 02:07:45.345776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.111 [2024-11-18 02:07:45.345785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.111 [2024-11-18 02:07:45.345789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:12[2024-11-18 02:07:45.345801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 02:07:45.345816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.345843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.345855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:12[2024-11-18 02:07:45.345867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with [2024-11-18 02:07:45.345881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:11.112 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.345895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.345907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.345919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.345931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 02:07:45.345944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.345968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.345980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.345988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.345992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.346001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.346017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.346024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.346030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.346049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with [2024-11-18 02:07:45.346049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28288 len:12the state(5) to be set 00:25:11.112 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.346063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.346065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.346081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.346087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.346094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.346109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:12[2024-11-18 02:07:45.346111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.346125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with [2024-11-18 02:07:45.346124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:11.112 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.346142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.346150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.346156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf45a0 is same with the state(5) to be set 00:25:11.112 [2024-11-18 02:07:45.346171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.346185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.346212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.346240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.346271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.346299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.346334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.346362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.112 [2024-11-18 02:07:45.346400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.112 [2024-11-18 02:07:45.346415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.346974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.346989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.347006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.347021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.347034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.347049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.347062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.347077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.347091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.347105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.347119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.347134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.347152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.347167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.113 [2024-11-18 02:07:45.347180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.113 [2024-11-18 02:07:45.347273] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1624d20 was disconnected and freed. reset controller. 00:25:11.113 [2024-11-18 02:07:45.347678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.113 [2024-11-18 02:07:45.347989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.348443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4a30 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.349986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:11.114 [2024-11-18 02:07:45.350118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.114 [2024-11-18 02:07:45.350172] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:11.115 [2024-11-18 02:07:45.350175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17df980 (9): [2024-11-18 02:07:45.350229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with Bad file descriptor 00:25:11.115 the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1660710 (9): [2024-11-18 02:07:45.350267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with Bad file descriptor 00:25:11.115 the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350374] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-18 02:07:45.350381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with id:0 cdw10:00000000 cdw11:00000000 00:25:11.115 the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf4ee0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350412] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350439] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350465] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x168d4f0 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350536] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350570] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350596] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350631] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1803e80 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350708] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350743] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350769] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350801] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1662200 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.350868] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350902] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350929] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350955] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.350967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.350979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1681190 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351030] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.351051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.351065] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.351078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.351091] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.351103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.351125] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.115 [2024-11-18 02:07:45.351139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.115 [2024-11-18 02:07:45.351142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with [2024-11-18 02:07:45.351151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17fd960 is same the state(5) to be set 00:25:11.115 with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.115 [2024-11-18 02:07:45.351436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.351656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 [2024-11-18 02:07:45.351679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with [2024-11-18 02:07:45.351690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:12the state(5) to be set 00:25:11.116 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.351707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 [2024-11-18 02:07:45.351713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.351726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 [2024-11-18 02:07:45.351739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.351763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 [2024-11-18 02:07:45.351776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.351789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 [2024-11-18 02:07:45.351801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.351827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 02:07:45.351839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.351865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 [2024-11-18 02:07:45.351877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.351890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 [2024-11-18 02:07:45.351902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with [2024-11-18 02:07:45.351914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128the state(5) to be set 00:25:11.116 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.351927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 [2024-11-18 02:07:45.351939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.351951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 [2024-11-18 02:07:45.351963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.351975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with [2024-11-18 02:07:45.351975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:12the state(5) to be set 00:25:11.116 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.351989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with [2024-11-18 02:07:45.351991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:11.116 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 [2024-11-18 02:07:45.352006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.352010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.352019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.352024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 [2024-11-18 02:07:45.352030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.352039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.116 [2024-11-18 02:07:45.352043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.352053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 02:07:45.352054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.116 the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.352068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.116 [2024-11-18 02:07:45.352070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf5390 is same with the state(5) to be set 00:25:11.117 [2024-11-18 02:07:45.352083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.352978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.352994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.353007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.353022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.353034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.353050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.353063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.353077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.353090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.353105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.353118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.353132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.353145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.117 [2024-11-18 02:07:45.353160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.117 [2024-11-18 02:07:45.353173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.118 [2024-11-18 02:07:45.353202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.118 [2024-11-18 02:07:45.353230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.118 [2024-11-18 02:07:45.353259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.118 [2024-11-18 02:07:45.353287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.118 [2024-11-18 02:07:45.353328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.118 [2024-11-18 02:07:45.353363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.118 [2024-11-18 02:07:45.353391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.118 [2024-11-18 02:07:45.353419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.118 [2024-11-18 02:07:45.353446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.118 [2024-11-18 02:07:45.353474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.118 [2024-11-18 02:07:45.353502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.118 [2024-11-18 02:07:45.353530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.353543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x160dac0 is same with the state(5) to be set 00:25:11.118 [2024-11-18 02:07:45.355530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:11.118 [2024-11-18 02:07:45.355708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.118 [2024-11-18 02:07:45.355812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.118 [2024-11-18 02:07:45.355837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1660710 with addr=10.0.0.2, port=4420 00:25:11.118 [2024-11-18 02:07:45.355853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1660710 is same with the state(5) to be set 00:25:11.118 [2024-11-18 02:07:45.355964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.118 [2024-11-18 02:07:45.356052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.118 [2024-11-18 02:07:45.356076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17df980 with addr=10.0.0.2, port=4420 00:25:11.118 [2024-11-18 02:07:45.356092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17df980 is same with the state(5) to be set 00:25:11.118 [2024-11-18 02:07:45.356128] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:11.118 [2024-11-18 02:07:45.356147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.356161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17fd240 is same with the state(5) to be set 00:25:11.118 [2024-11-18 02:07:45.356271] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:11.118 [2024-11-18 02:07:45.356373] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:11.118 [2024-11-18 02:07:45.356644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.118 [2024-11-18 02:07:45.356751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.118 [2024-11-18 02:07:45.356776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1635fe0 with addr=10.0.0.2, port=4420 00:25:11.118 [2024-11-18 02:07:45.356792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1635fe0 is same with the state(5) to be set 00:25:11.118 [2024-11-18 02:07:45.356810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1660710 (9): Bad file descriptor 00:25:11.118 [2024-11-18 02:07:45.356828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17df980 (9): Bad file descriptor 00:25:11.118 [2024-11-18 02:07:45.356845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17fd240 (9): Bad file descriptor 00:25:11.118 [2024-11-18 02:07:45.357217] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:11.118 [2024-11-18 02:07:45.357387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1635fe0 (9): Bad file descriptor 00:25:11.118 [2024-11-18 02:07:45.357413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:11.118 [2024-11-18 02:07:45.357426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:11.118 [2024-11-18 02:07:45.357441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:11.118 [2024-11-18 02:07:45.357461] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:11.118 [2024-11-18 02:07:45.357475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:11.118 [2024-11-18 02:07:45.357487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:11.118 [2024-11-18 02:07:45.357504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:11.118 [2024-11-18 02:07:45.357517] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:11.118 [2024-11-18 02:07:45.357528] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:11.118 [2024-11-18 02:07:45.357639] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:11.118 [2024-11-18 02:07:45.357727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.118 [2024-11-18 02:07:45.357748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.118 [2024-11-18 02:07:45.357760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.118 [2024-11-18 02:07:45.357771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:11.118 [2024-11-18 02:07:45.357783] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:11.118 [2024-11-18 02:07:45.357796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:11.118 [2024-11-18 02:07:45.357902] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:11.118 [2024-11-18 02:07:45.357932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.118 [2024-11-18 02:07:45.360142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x168d4f0 (9): Bad file descriptor 00:25:11.118 [2024-11-18 02:07:45.360181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1803e80 (9): Bad file descriptor 00:25:11.118 [2024-11-18 02:07:45.360215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1662200 (9): Bad file descriptor 00:25:11.118 [2024-11-18 02:07:45.360251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1681190 (9): Bad file descriptor 00:25:11.118 [2024-11-18 02:07:45.360283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17fd960 (9): Bad file descriptor 00:25:11.118 [2024-11-18 02:07:45.360344] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.118 [2024-11-18 02:07:45.360377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.360393] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.118 [2024-11-18 02:07:45.360406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.360419] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.118 [2024-11-18 02:07:45.360432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.360445] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:11.118 [2024-11-18 02:07:45.360457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.118 [2024-11-18 02:07:45.360469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1687c00 is same with the state(5) to be set 00:25:11.118 [2024-11-18 02:07:45.361678] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:11.118 [2024-11-18 02:07:45.361705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:11.118 [2024-11-18 02:07:45.361777] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:11.118 [2024-11-18 02:07:45.361888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.118 [2024-11-18 02:07:45.361971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.118 [2024-11-18 02:07:45.361996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17fd240 with addr=10.0.0.2, port=4420 00:25:11.118 [2024-11-18 02:07:45.362011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17fd240 is same with the state(5) to be set 00:25:11.119 [2024-11-18 02:07:45.362103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.119 [2024-11-18 02:07:45.362182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.119 [2024-11-18 02:07:45.362206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17df980 with addr=10.0.0.2, port=4420 00:25:11.119 [2024-11-18 02:07:45.362222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17df980 is same with the state(5) to be set 00:25:11.119 [2024-11-18 02:07:45.362354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.119 [2024-11-18 02:07:45.362482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.119 [2024-11-18 02:07:45.362506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1660710 with addr=10.0.0.2, port=4420 00:25:11.119 [2024-11-18 02:07:45.362521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1660710 is same with the state(5) to be set 00:25:11.119 [2024-11-18 02:07:45.362539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17fd240 (9): Bad file descriptor 00:25:11.119 [2024-11-18 02:07:45.362557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17df980 (9): Bad file descriptor 00:25:11.119 [2024-11-18 02:07:45.362612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1660710 (9): Bad file descriptor 00:25:11.119 [2024-11-18 02:07:45.362637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:11.119 [2024-11-18 02:07:45.362651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:11.119 [2024-11-18 02:07:45.362664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:11.119 [2024-11-18 02:07:45.362683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:11.119 [2024-11-18 02:07:45.362698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:11.119 [2024-11-18 02:07:45.362711] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:11.119 [2024-11-18 02:07:45.362763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.119 [2024-11-18 02:07:45.362782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.119 [2024-11-18 02:07:45.362794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:11.119 [2024-11-18 02:07:45.362806] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:11.119 [2024-11-18 02:07:45.362819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:11.119 [2024-11-18 02:07:45.362871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.119 [2024-11-18 02:07:45.365690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:11.119 [2024-11-18 02:07:45.365836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.119 [2024-11-18 02:07:45.365934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.119 [2024-11-18 02:07:45.365959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1635fe0 with addr=10.0.0.2, port=4420 00:25:11.119 [2024-11-18 02:07:45.365974] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1635fe0 is same with the state(5) to be set 00:25:11.119 [2024-11-18 02:07:45.366029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1635fe0 (9): Bad file descriptor 00:25:11.119 [2024-11-18 02:07:45.366083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:11.119 [2024-11-18 02:07:45.366099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:11.119 [2024-11-18 02:07:45.366112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:11.119 [2024-11-18 02:07:45.366165] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.119 [2024-11-18 02:07:45.370221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1687c00 (9): Bad file descriptor 00:25:11.119 [2024-11-18 02:07:45.370398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.370983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.370996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.371011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.371024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.371039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.371053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.371067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.371082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.371097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.371110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.119 [2024-11-18 02:07:45.371125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.119 [2024-11-18 02:07:45.371137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.371968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.371983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.372000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.372016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.372030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.372045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.372058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.372073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.372086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.372101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.372114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.372129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.372142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.372158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.372171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.372186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.372200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.372215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.372229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.372244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.372257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.372273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.120 [2024-11-18 02:07:45.372287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.120 [2024-11-18 02:07:45.372301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17ade90 is same with the state(5) to be set 00:25:11.121 [2024-11-18 02:07:45.373585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.373979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.373992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.121 [2024-11-18 02:07:45.374588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.121 [2024-11-18 02:07:45.374603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.374976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.374989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.375458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.375477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1626300 is same with the state(5) to be set 00:25:11.122 [2024-11-18 02:07:45.376681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.376703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.376724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.376739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.376754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.376768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.376783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.376796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.376811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.376825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.376840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.376853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.376868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.376882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.376896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.376910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.376925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.122 [2024-11-18 02:07:45.376938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.122 [2024-11-18 02:07:45.376953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.376967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.376981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.376995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.377986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.377999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.378013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.378027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.378041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.378055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.123 [2024-11-18 02:07:45.378070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.123 [2024-11-18 02:07:45.378083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.378525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.378539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16278e0 is same with the state(5) to be set 00:25:11.124 [2024-11-18 02:07:45.379758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.379781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.379801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.379816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.379831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.379844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.379860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.379873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.379888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.379901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.379916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.379930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.379944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.379958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.379973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.379986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.124 [2024-11-18 02:07:45.380431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.124 [2024-11-18 02:07:45.380447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.380978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.380990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.125 [2024-11-18 02:07:45.381434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.125 [2024-11-18 02:07:45.381448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.381462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.381475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.381494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.381507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.381522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.381535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.381551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.381565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.381579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.381592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.381607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1628ec0 is same with the state(5) to be set 00:25:11.126 [2024-11-18 02:07:45.382812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.382835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.382856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.382871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.382886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.382900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.382915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.382928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.382943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.382956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.382971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.382984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.382999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.126 [2024-11-18 02:07:45.383776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.126 [2024-11-18 02:07:45.383790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.383804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.383817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.383831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.383844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.383859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.383872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.383887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.383899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.383914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.383927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.383942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.383954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.383968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.383981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.383996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.127 [2024-11-18 02:07:45.384634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.127 [2024-11-18 02:07:45.384648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162a4a0 is same with the state(5) to be set 00:25:11.127 [2024-11-18 02:07:45.385853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:11.127 [2024-11-18 02:07:45.385883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:11.127 [2024-11-18 02:07:45.385902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:11.127 [2024-11-18 02:07:45.385919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:11.127 [2024-11-18 02:07:45.386043] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:11.127 [2024-11-18 02:07:45.386156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:11.127 [2024-11-18 02:07:45.386385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.127 [2024-11-18 02:07:45.386497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.127 [2024-11-18 02:07:45.386522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1662200 with addr=10.0.0.2, port=4420 00:25:11.127 [2024-11-18 02:07:45.386539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1662200 is same with the state(5) to be set 00:25:11.127 [2024-11-18 02:07:45.386628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.127 [2024-11-18 02:07:45.386708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.127 [2024-11-18 02:07:45.386733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1681190 with addr=10.0.0.2, port=4420 00:25:11.127 [2024-11-18 02:07:45.386749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1681190 is same with the state(5) to be set 00:25:11.127 [2024-11-18 02:07:45.386823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.127 [2024-11-18 02:07:45.386910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.127 [2024-11-18 02:07:45.386939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x168d4f0 with addr=10.0.0.2, port=4420 00:25:11.127 [2024-11-18 02:07:45.386955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x168d4f0 is same with the state(5) to be set 00:25:11.127 [2024-11-18 02:07:45.387038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.127 [2024-11-18 02:07:45.387129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.127 [2024-11-18 02:07:45.387154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1803e80 with addr=10.0.0.2, port=4420 00:25:11.128 [2024-11-18 02:07:45.387169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1803e80 is same with the state(5) to be set 00:25:11.128 [2024-11-18 02:07:45.388524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.388981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.388994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.128 [2024-11-18 02:07:45.389625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.128 [2024-11-18 02:07:45.389639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.389654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.389667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.389682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.389695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.389711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.389724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.389739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.389753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.389768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.389781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.389797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.389810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.389825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.389838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.389853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.389867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.389881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.389894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.389910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.389926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.389942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.389956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.389971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.389984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:11.129 [2024-11-18 02:07:45.390405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:11.129 [2024-11-18 02:07:45.390419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162ba80 is same with the state(5) to be set 00:25:11.129 [2024-11-18 02:07:45.391618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:11.129 [2024-11-18 02:07:45.391646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:11.129 [2024-11-18 02:07:45.391663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:11.129 [2024-11-18 02:07:45.391680] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:11.129 task offset: 29184 on job bdev=Nvme10n1 fails 00:25:11.129 00:25:11.129 Latency(us) 00:25:11.129 [2024-11-18T01:07:45.531Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme1n1 ended in about 0.67 seconds with error 00:25:11.129 Verification LBA range: start 0x0 length 0x400 00:25:11.129 Nvme1n1 : 0.67 312.58 19.54 96.18 0.00 155413.13 101750.71 121168.78 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme2n1 ended in about 0.68 seconds with error 00:25:11.129 Verification LBA range: start 0x0 length 0x400 00:25:11.129 Nvme2n1 : 0.68 304.01 19.00 93.54 0.00 158041.71 88158.06 141363.58 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme3n1 ended in about 0.66 seconds with error 00:25:11.129 Verification LBA range: start 0x0 length 0x400 00:25:11.129 Nvme3n1 : 0.66 315.38 19.71 97.04 0.00 150481.51 93206.76 119615.34 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme4n1 ended in about 0.66 seconds with error 00:25:11.129 Verification LBA range: start 0x0 length 0x400 00:25:11.129 Nvme4n1 : 0.66 314.86 19.68 96.88 0.00 148860.24 88934.78 118838.61 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme5n1 ended in about 0.69 seconds with error 00:25:11.129 Verification LBA range: start 0x0 length 0x400 00:25:11.129 Nvme5n1 : 0.69 302.63 18.91 93.12 0.00 153377.08 94760.20 118061.89 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme6n1 ended in about 0.69 seconds with error 00:25:11.129 Verification LBA range: start 0x0 length 0x400 00:25:11.129 Nvme6n1 : 0.69 301.29 18.83 92.71 0.00 152306.24 86216.25 120392.06 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme7n1 ended in about 0.69 seconds with error 00:25:11.129 Verification LBA range: start 0x0 length 0x400 00:25:11.129 Nvme7n1 : 0.69 299.96 18.75 92.30 0.00 151336.05 90488.23 121168.78 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:11.129 [2024-11-18T01:07:45.531Z] Job: Nvme8n1 ended in about 0.70 seconds with error 00:25:11.129 Verification LBA range: start 0x0 length 0x400 00:25:11.129 Nvme8n1 : 0.70 298.66 18.67 91.89 0.00 150317.31 83109.36 121945.51 00:25:11.130 [2024-11-18T01:07:45.532Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:11.130 [2024-11-18T01:07:45.532Z] Job: Nvme9n1 ended in about 0.70 seconds with error 00:25:11.130 Verification LBA range: start 0x0 length 0x400 00:25:11.130 Nvme9n1 : 0.70 296.20 18.51 91.14 0.00 149926.09 74177.04 123498.95 00:25:11.130 [2024-11-18T01:07:45.532Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:11.130 [2024-11-18T01:07:45.532Z] Job: Nvme10n1 ended in about 0.65 seconds with error 00:25:11.130 Verification LBA range: start 0x0 length 0x400 00:25:11.130 Nvme10n1 : 0.65 319.60 19.98 98.34 0.00 136095.18 11990.66 124275.67 00:25:11.130 [2024-11-18T01:07:45.532Z] =================================================================================================================== 00:25:11.130 [2024-11-18T01:07:45.532Z] Total : 3065.17 191.57 943.13 0.00 150615.45 11990.66 141363.58 00:25:11.130 [2024-11-18 02:07:45.418145] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:11.130 [2024-11-18 02:07:45.418232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:11.130 [2024-11-18 02:07:45.418559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.130 [2024-11-18 02:07:45.418660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.130 [2024-11-18 02:07:45.418688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17fd960 with addr=10.0.0.2, port=4420 00:25:11.130 [2024-11-18 02:07:45.418708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17fd960 is same with the state(5) to be set 00:25:11.130 [2024-11-18 02:07:45.418735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1662200 (9): Bad file descriptor 00:25:11.130 [2024-11-18 02:07:45.418758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1681190 (9): Bad file descriptor 00:25:11.130 [2024-11-18 02:07:45.418776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x168d4f0 (9): Bad file descriptor 00:25:11.130 [2024-11-18 02:07:45.418794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1803e80 (9): Bad file descriptor 00:25:11.130 [2024-11-18 02:07:45.419105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.130 [2024-11-18 02:07:45.419202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.130 [2024-11-18 02:07:45.419229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17df980 with addr=10.0.0.2, port=4420 00:25:11.130 [2024-11-18 02:07:45.419246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17df980 is same with the state(5) to be set 00:25:11.130 [2024-11-18 02:07:45.419365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.130 [2024-11-18 02:07:45.419455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.130 [2024-11-18 02:07:45.419481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17fd240 with addr=10.0.0.2, port=4420 00:25:11.130 [2024-11-18 02:07:45.419497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17fd240 is same with the state(5) to be set 00:25:11.130 [2024-11-18 02:07:45.419573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.130 [2024-11-18 02:07:45.419670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.130 [2024-11-18 02:07:45.419696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1660710 with addr=10.0.0.2, port=4420 00:25:11.130 [2024-11-18 02:07:45.419711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1660710 is same with the state(5) to be set 00:25:11.130 [2024-11-18 02:07:45.419797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.130 [2024-11-18 02:07:45.419883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.130 [2024-11-18 02:07:45.419908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1635fe0 with addr=10.0.0.2, port=4420 00:25:11.130 [2024-11-18 02:07:45.419924] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1635fe0 is same with the state(5) to be set 00:25:11.130 [2024-11-18 02:07:45.420007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.130 [2024-11-18 02:07:45.420088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:11.130 [2024-11-18 02:07:45.420113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1687c00 with addr=10.0.0.2, port=4420 00:25:11.130 [2024-11-18 02:07:45.420129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1687c00 is same with the state(5) to be set 00:25:11.130 [2024-11-18 02:07:45.420147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17fd960 (9): Bad file descriptor 00:25:11.130 [2024-11-18 02:07:45.420164] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:11.130 [2024-11-18 02:07:45.420177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:11.130 [2024-11-18 02:07:45.420192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:11.130 [2024-11-18 02:07:45.420212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:11.130 [2024-11-18 02:07:45.420225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:11.130 [2024-11-18 02:07:45.420237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:11.130 [2024-11-18 02:07:45.420255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:11.130 [2024-11-18 02:07:45.420268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:11.130 [2024-11-18 02:07:45.420280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:11.130 [2024-11-18 02:07:45.420297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:11.130 [2024-11-18 02:07:45.420316] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:11.130 [2024-11-18 02:07:45.420331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:11.130 [2024-11-18 02:07:45.420375] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:11.130 [2024-11-18 02:07:45.420399] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:11.130 [2024-11-18 02:07:45.420418] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:11.130 [2024-11-18 02:07:45.420439] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:11.130 [2024-11-18 02:07:45.420457] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:11.130 [2024-11-18 02:07:45.420829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.130 [2024-11-18 02:07:45.420853] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.130 [2024-11-18 02:07:45.420866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.130 [2024-11-18 02:07:45.420877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.130 [2024-11-18 02:07:45.420893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17df980 (9): Bad file descriptor 00:25:11.130 [2024-11-18 02:07:45.420917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17fd240 (9): Bad file descriptor 00:25:11.130 [2024-11-18 02:07:45.420936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1660710 (9): Bad file descriptor 00:25:11.130 [2024-11-18 02:07:45.420953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1635fe0 (9): Bad file descriptor 00:25:11.130 [2024-11-18 02:07:45.420969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1687c00 (9): Bad file descriptor 00:25:11.130 [2024-11-18 02:07:45.420984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:11.130 [2024-11-18 02:07:45.420996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:11.130 [2024-11-18 02:07:45.421008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:11.130 [2024-11-18 02:07:45.421065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.130 [2024-11-18 02:07:45.421085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:11.130 [2024-11-18 02:07:45.421098] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:11.130 [2024-11-18 02:07:45.421110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:11.130 [2024-11-18 02:07:45.421126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:11.130 [2024-11-18 02:07:45.421140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:11.130 [2024-11-18 02:07:45.421152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:11.130 [2024-11-18 02:07:45.421167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:11.130 [2024-11-18 02:07:45.421179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:11.130 [2024-11-18 02:07:45.421191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:11.130 [2024-11-18 02:07:45.421207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:11.131 [2024-11-18 02:07:45.421220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:11.131 [2024-11-18 02:07:45.421232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:11.131 [2024-11-18 02:07:45.421248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:11.131 [2024-11-18 02:07:45.421260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:11.131 [2024-11-18 02:07:45.421273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:11.131 [2024-11-18 02:07:45.421327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.131 [2024-11-18 02:07:45.421347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.131 [2024-11-18 02:07:45.421359] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.131 [2024-11-18 02:07:45.421370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.131 [2024-11-18 02:07:45.421381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.701 02:07:45 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:11.701 02:07:45 -- target/shutdown.sh@138 -- # sleep 1 00:25:12.638 02:07:46 -- target/shutdown.sh@141 -- # kill -9 1281506 00:25:12.638 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (1281506) - No such process 00:25:12.638 02:07:46 -- target/shutdown.sh@141 -- # true 00:25:12.638 02:07:46 -- target/shutdown.sh@143 -- # stoptarget 00:25:12.638 02:07:46 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:12.638 02:07:46 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:12.638 02:07:46 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:12.638 02:07:46 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:12.638 02:07:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:12.638 02:07:46 -- nvmf/common.sh@116 -- # sync 00:25:12.638 02:07:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:12.638 02:07:46 -- nvmf/common.sh@119 -- # set +e 00:25:12.638 02:07:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:12.638 02:07:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:12.638 rmmod nvme_tcp 00:25:12.638 rmmod nvme_fabrics 00:25:12.638 rmmod nvme_keyring 00:25:12.638 02:07:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:12.638 02:07:46 -- nvmf/common.sh@123 -- # set -e 00:25:12.638 02:07:46 -- nvmf/common.sh@124 -- # return 0 00:25:12.638 02:07:46 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:12.638 02:07:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:12.638 02:07:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:12.638 02:07:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:12.638 02:07:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:12.639 02:07:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:12.639 02:07:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:12.639 02:07:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:12.639 02:07:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:15.175 02:07:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:15.175 00:25:15.175 real 0m7.776s 00:25:15.175 user 0m19.337s 00:25:15.175 sys 0m1.481s 00:25:15.175 02:07:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:15.175 02:07:49 -- common/autotest_common.sh@10 -- # set +x 00:25:15.175 ************************************ 00:25:15.175 END TEST nvmf_shutdown_tc3 00:25:15.175 ************************************ 00:25:15.175 02:07:49 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:15.175 00:25:15.175 real 0m28.549s 00:25:15.175 user 1m22.479s 00:25:15.175 sys 0m6.335s 00:25:15.175 02:07:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:15.175 02:07:49 -- common/autotest_common.sh@10 -- # set +x 00:25:15.175 ************************************ 00:25:15.175 END TEST nvmf_shutdown 00:25:15.175 ************************************ 00:25:15.175 02:07:49 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:15.175 02:07:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:15.175 02:07:49 -- common/autotest_common.sh@10 -- # set +x 00:25:15.175 02:07:49 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:15.175 02:07:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:15.175 02:07:49 -- common/autotest_common.sh@10 -- # set +x 00:25:15.175 02:07:49 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:15.175 02:07:49 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:15.175 02:07:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:15.175 02:07:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:15.175 02:07:49 -- common/autotest_common.sh@10 -- # set +x 00:25:15.175 ************************************ 00:25:15.175 START TEST nvmf_multicontroller 00:25:15.175 ************************************ 00:25:15.175 02:07:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:15.175 * Looking for test storage... 00:25:15.175 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:15.175 02:07:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:15.175 02:07:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:15.175 02:07:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:15.175 02:07:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:15.175 02:07:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:15.175 02:07:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:15.175 02:07:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:15.175 02:07:49 -- scripts/common.sh@335 -- # IFS=.-: 00:25:15.176 02:07:49 -- scripts/common.sh@335 -- # read -ra ver1 00:25:15.176 02:07:49 -- scripts/common.sh@336 -- # IFS=.-: 00:25:15.176 02:07:49 -- scripts/common.sh@336 -- # read -ra ver2 00:25:15.176 02:07:49 -- scripts/common.sh@337 -- # local 'op=<' 00:25:15.176 02:07:49 -- scripts/common.sh@339 -- # ver1_l=2 00:25:15.176 02:07:49 -- scripts/common.sh@340 -- # ver2_l=1 00:25:15.176 02:07:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:15.176 02:07:49 -- scripts/common.sh@343 -- # case "$op" in 00:25:15.176 02:07:49 -- scripts/common.sh@344 -- # : 1 00:25:15.176 02:07:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:15.176 02:07:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:15.176 02:07:49 -- scripts/common.sh@364 -- # decimal 1 00:25:15.176 02:07:49 -- scripts/common.sh@352 -- # local d=1 00:25:15.176 02:07:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:15.176 02:07:49 -- scripts/common.sh@354 -- # echo 1 00:25:15.176 02:07:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:15.176 02:07:49 -- scripts/common.sh@365 -- # decimal 2 00:25:15.176 02:07:49 -- scripts/common.sh@352 -- # local d=2 00:25:15.176 02:07:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:15.176 02:07:49 -- scripts/common.sh@354 -- # echo 2 00:25:15.176 02:07:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:15.176 02:07:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:15.176 02:07:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:15.176 02:07:49 -- scripts/common.sh@367 -- # return 0 00:25:15.176 02:07:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:15.176 02:07:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:15.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:15.176 --rc genhtml_branch_coverage=1 00:25:15.176 --rc genhtml_function_coverage=1 00:25:15.176 --rc genhtml_legend=1 00:25:15.176 --rc geninfo_all_blocks=1 00:25:15.176 --rc geninfo_unexecuted_blocks=1 00:25:15.176 00:25:15.176 ' 00:25:15.176 02:07:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:15.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:15.176 --rc genhtml_branch_coverage=1 00:25:15.176 --rc genhtml_function_coverage=1 00:25:15.176 --rc genhtml_legend=1 00:25:15.176 --rc geninfo_all_blocks=1 00:25:15.176 --rc geninfo_unexecuted_blocks=1 00:25:15.176 00:25:15.176 ' 00:25:15.176 02:07:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:15.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:15.176 --rc genhtml_branch_coverage=1 00:25:15.176 --rc genhtml_function_coverage=1 00:25:15.176 --rc genhtml_legend=1 00:25:15.176 --rc geninfo_all_blocks=1 00:25:15.176 --rc geninfo_unexecuted_blocks=1 00:25:15.176 00:25:15.176 ' 00:25:15.176 02:07:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:15.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:15.176 --rc genhtml_branch_coverage=1 00:25:15.176 --rc genhtml_function_coverage=1 00:25:15.176 --rc genhtml_legend=1 00:25:15.176 --rc geninfo_all_blocks=1 00:25:15.176 --rc geninfo_unexecuted_blocks=1 00:25:15.176 00:25:15.176 ' 00:25:15.176 02:07:49 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:15.176 02:07:49 -- nvmf/common.sh@7 -- # uname -s 00:25:15.176 02:07:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:15.176 02:07:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:15.176 02:07:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:15.176 02:07:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:15.176 02:07:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:15.176 02:07:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:15.176 02:07:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:15.176 02:07:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:15.176 02:07:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:15.176 02:07:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:15.176 02:07:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:15.176 02:07:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:15.176 02:07:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:15.176 02:07:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:15.176 02:07:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:15.176 02:07:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:15.176 02:07:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:15.176 02:07:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:15.176 02:07:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:15.176 02:07:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:15.176 02:07:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:15.176 02:07:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:15.176 02:07:49 -- paths/export.sh@5 -- # export PATH 00:25:15.176 02:07:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:15.176 02:07:49 -- nvmf/common.sh@46 -- # : 0 00:25:15.176 02:07:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:15.176 02:07:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:15.176 02:07:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:15.176 02:07:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:15.176 02:07:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:15.176 02:07:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:15.176 02:07:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:15.176 02:07:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:15.176 02:07:49 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:15.176 02:07:49 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:15.176 02:07:49 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:15.176 02:07:49 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:15.176 02:07:49 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:15.176 02:07:49 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:15.176 02:07:49 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:15.176 02:07:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:15.176 02:07:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:15.176 02:07:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:15.176 02:07:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:15.176 02:07:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:15.176 02:07:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:15.176 02:07:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:15.176 02:07:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:15.176 02:07:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:15.176 02:07:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:15.176 02:07:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:15.176 02:07:49 -- common/autotest_common.sh@10 -- # set +x 00:25:17.082 02:07:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:17.082 02:07:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:17.082 02:07:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:17.082 02:07:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:17.082 02:07:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:17.082 02:07:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:17.082 02:07:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:17.082 02:07:51 -- nvmf/common.sh@294 -- # net_devs=() 00:25:17.082 02:07:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:17.082 02:07:51 -- nvmf/common.sh@295 -- # e810=() 00:25:17.082 02:07:51 -- nvmf/common.sh@295 -- # local -ga e810 00:25:17.082 02:07:51 -- nvmf/common.sh@296 -- # x722=() 00:25:17.082 02:07:51 -- nvmf/common.sh@296 -- # local -ga x722 00:25:17.082 02:07:51 -- nvmf/common.sh@297 -- # mlx=() 00:25:17.082 02:07:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:17.082 02:07:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:17.082 02:07:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:17.082 02:07:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:17.082 02:07:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:17.082 02:07:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:17.082 02:07:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:17.082 02:07:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:17.082 02:07:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:17.082 02:07:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:17.082 02:07:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:17.082 02:07:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:17.082 02:07:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:17.082 02:07:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:17.082 02:07:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:17.082 02:07:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:17.082 02:07:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:17.082 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:17.082 02:07:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:17.082 02:07:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:17.082 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:17.082 02:07:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:17.082 02:07:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:17.082 02:07:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:17.082 02:07:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:17.082 02:07:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:17.082 02:07:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:17.082 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:17.082 02:07:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:17.082 02:07:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:17.082 02:07:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:17.082 02:07:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:17.082 02:07:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:17.082 02:07:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:17.082 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:17.082 02:07:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:17.082 02:07:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:17.082 02:07:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:17.082 02:07:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:17.082 02:07:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:17.082 02:07:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:17.082 02:07:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:17.082 02:07:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:17.082 02:07:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:17.082 02:07:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:17.082 02:07:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:17.082 02:07:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:17.082 02:07:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:17.082 02:07:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:17.082 02:07:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:17.082 02:07:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:17.082 02:07:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:17.082 02:07:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:17.082 02:07:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:17.082 02:07:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:17.082 02:07:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:17.082 02:07:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:17.082 02:07:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:17.082 02:07:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:17.082 02:07:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:17.082 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:17.082 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.284 ms 00:25:17.082 00:25:17.082 --- 10.0.0.2 ping statistics --- 00:25:17.082 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:17.082 rtt min/avg/max/mdev = 0.284/0.284/0.284/0.000 ms 00:25:17.082 02:07:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:17.082 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:17.083 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.203 ms 00:25:17.083 00:25:17.083 --- 10.0.0.1 ping statistics --- 00:25:17.083 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:17.083 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:25:17.083 02:07:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:17.083 02:07:51 -- nvmf/common.sh@410 -- # return 0 00:25:17.083 02:07:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:17.083 02:07:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:17.083 02:07:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:17.083 02:07:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:17.083 02:07:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:17.083 02:07:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:17.083 02:07:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:17.083 02:07:51 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:17.083 02:07:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:17.083 02:07:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:17.083 02:07:51 -- common/autotest_common.sh@10 -- # set +x 00:25:17.341 02:07:51 -- nvmf/common.sh@469 -- # nvmfpid=1283929 00:25:17.341 02:07:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:17.341 02:07:51 -- nvmf/common.sh@470 -- # waitforlisten 1283929 00:25:17.341 02:07:51 -- common/autotest_common.sh@829 -- # '[' -z 1283929 ']' 00:25:17.341 02:07:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:17.341 02:07:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:17.341 02:07:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:17.341 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:17.341 02:07:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:17.341 02:07:51 -- common/autotest_common.sh@10 -- # set +x 00:25:17.341 [2024-11-18 02:07:51.524327] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:17.341 [2024-11-18 02:07:51.524396] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:17.341 EAL: No free 2048 kB hugepages reported on node 1 00:25:17.341 [2024-11-18 02:07:51.586717] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:17.341 [2024-11-18 02:07:51.670073] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:17.341 [2024-11-18 02:07:51.670227] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:17.341 [2024-11-18 02:07:51.670256] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:17.341 [2024-11-18 02:07:51.670269] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:17.341 [2024-11-18 02:07:51.670377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:17.341 [2024-11-18 02:07:51.670421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:17.341 [2024-11-18 02:07:51.670425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:18.279 02:07:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:18.279 02:07:52 -- common/autotest_common.sh@862 -- # return 0 00:25:18.279 02:07:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:18.279 02:07:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:18.279 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.279 02:07:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:18.279 02:07:52 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:18.279 02:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.279 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.279 [2024-11-18 02:07:52.556643] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:18.279 02:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.279 02:07:52 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:18.279 02:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.279 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.279 Malloc0 00:25:18.279 02:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.279 02:07:52 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:18.279 02:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.279 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.279 02:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.279 02:07:52 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:18.279 02:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.279 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.279 02:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.279 02:07:52 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:18.279 02:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.279 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.279 [2024-11-18 02:07:52.616816] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:18.279 02:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.279 02:07:52 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:18.279 02:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.279 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.279 [2024-11-18 02:07:52.624683] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:18.279 02:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.279 02:07:52 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:18.279 02:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.279 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.279 Malloc1 00:25:18.279 02:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.279 02:07:52 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:18.279 02:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.279 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.279 02:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.279 02:07:52 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:18.279 02:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.279 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.279 02:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.279 02:07:52 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:18.279 02:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.279 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.279 02:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.279 02:07:52 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:18.279 02:07:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.279 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.538 02:07:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.538 02:07:52 -- host/multicontroller.sh@44 -- # bdevperf_pid=1284085 00:25:18.538 02:07:52 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:18.538 02:07:52 -- host/multicontroller.sh@47 -- # waitforlisten 1284085 /var/tmp/bdevperf.sock 00:25:18.538 02:07:52 -- common/autotest_common.sh@829 -- # '[' -z 1284085 ']' 00:25:18.538 02:07:52 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:18.538 02:07:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:18.538 02:07:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:18.538 02:07:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:18.538 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:18.538 02:07:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:18.538 02:07:52 -- common/autotest_common.sh@10 -- # set +x 00:25:19.477 02:07:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:19.477 02:07:53 -- common/autotest_common.sh@862 -- # return 0 00:25:19.477 02:07:53 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:19.477 02:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:19.477 02:07:53 -- common/autotest_common.sh@10 -- # set +x 00:25:19.477 NVMe0n1 00:25:19.477 02:07:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:19.477 02:07:53 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:19.477 02:07:53 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:19.477 02:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:19.477 02:07:53 -- common/autotest_common.sh@10 -- # set +x 00:25:19.477 02:07:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:19.477 1 00:25:19.477 02:07:53 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:19.477 02:07:53 -- common/autotest_common.sh@650 -- # local es=0 00:25:19.477 02:07:53 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:19.477 02:07:53 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:19.477 02:07:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:19.477 02:07:53 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:19.477 02:07:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:19.477 02:07:53 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:19.477 02:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:19.477 02:07:53 -- common/autotest_common.sh@10 -- # set +x 00:25:19.477 request: 00:25:19.477 { 00:25:19.477 "name": "NVMe0", 00:25:19.477 "trtype": "tcp", 00:25:19.478 "traddr": "10.0.0.2", 00:25:19.478 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:19.478 "hostaddr": "10.0.0.2", 00:25:19.478 "hostsvcid": "60000", 00:25:19.478 "adrfam": "ipv4", 00:25:19.478 "trsvcid": "4420", 00:25:19.478 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:19.478 "method": "bdev_nvme_attach_controller", 00:25:19.478 "req_id": 1 00:25:19.478 } 00:25:19.478 Got JSON-RPC error response 00:25:19.478 response: 00:25:19.478 { 00:25:19.478 "code": -114, 00:25:19.478 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:19.478 } 00:25:19.478 02:07:53 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:19.478 02:07:53 -- common/autotest_common.sh@653 -- # es=1 00:25:19.478 02:07:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:19.478 02:07:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:19.478 02:07:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:19.478 02:07:53 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:19.478 02:07:53 -- common/autotest_common.sh@650 -- # local es=0 00:25:19.478 02:07:53 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:19.478 02:07:53 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:19.478 02:07:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:19.478 02:07:53 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:19.478 02:07:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:19.478 02:07:53 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:19.478 02:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:19.478 02:07:53 -- common/autotest_common.sh@10 -- # set +x 00:25:19.478 request: 00:25:19.478 { 00:25:19.478 "name": "NVMe0", 00:25:19.478 "trtype": "tcp", 00:25:19.478 "traddr": "10.0.0.2", 00:25:19.478 "hostaddr": "10.0.0.2", 00:25:19.478 "hostsvcid": "60000", 00:25:19.478 "adrfam": "ipv4", 00:25:19.478 "trsvcid": "4420", 00:25:19.478 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:19.478 "method": "bdev_nvme_attach_controller", 00:25:19.478 "req_id": 1 00:25:19.478 } 00:25:19.478 Got JSON-RPC error response 00:25:19.478 response: 00:25:19.478 { 00:25:19.478 "code": -114, 00:25:19.478 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:19.478 } 00:25:19.478 02:07:53 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:19.478 02:07:53 -- common/autotest_common.sh@653 -- # es=1 00:25:19.478 02:07:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:19.478 02:07:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:19.478 02:07:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:19.478 02:07:53 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:19.478 02:07:53 -- common/autotest_common.sh@650 -- # local es=0 00:25:19.478 02:07:53 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:19.478 02:07:53 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:19.478 02:07:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:19.478 02:07:53 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:19.478 02:07:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:19.478 02:07:53 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:19.478 02:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:19.478 02:07:53 -- common/autotest_common.sh@10 -- # set +x 00:25:19.478 request: 00:25:19.478 { 00:25:19.478 "name": "NVMe0", 00:25:19.478 "trtype": "tcp", 00:25:19.478 "traddr": "10.0.0.2", 00:25:19.478 "hostaddr": "10.0.0.2", 00:25:19.478 "hostsvcid": "60000", 00:25:19.478 "adrfam": "ipv4", 00:25:19.478 "trsvcid": "4420", 00:25:19.478 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:19.478 "multipath": "disable", 00:25:19.478 "method": "bdev_nvme_attach_controller", 00:25:19.478 "req_id": 1 00:25:19.478 } 00:25:19.478 Got JSON-RPC error response 00:25:19.478 response: 00:25:19.478 { 00:25:19.478 "code": -114, 00:25:19.478 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:19.478 } 00:25:19.478 02:07:53 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:19.478 02:07:53 -- common/autotest_common.sh@653 -- # es=1 00:25:19.478 02:07:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:19.478 02:07:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:19.478 02:07:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:19.478 02:07:53 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:19.478 02:07:53 -- common/autotest_common.sh@650 -- # local es=0 00:25:19.478 02:07:53 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:19.478 02:07:53 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:19.478 02:07:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:19.478 02:07:53 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:19.478 02:07:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:19.478 02:07:53 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:19.478 02:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:19.478 02:07:53 -- common/autotest_common.sh@10 -- # set +x 00:25:19.478 request: 00:25:19.478 { 00:25:19.478 "name": "NVMe0", 00:25:19.478 "trtype": "tcp", 00:25:19.478 "traddr": "10.0.0.2", 00:25:19.478 "hostaddr": "10.0.0.2", 00:25:19.478 "hostsvcid": "60000", 00:25:19.478 "adrfam": "ipv4", 00:25:19.478 "trsvcid": "4420", 00:25:19.478 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:19.478 "multipath": "failover", 00:25:19.478 "method": "bdev_nvme_attach_controller", 00:25:19.478 "req_id": 1 00:25:19.478 } 00:25:19.478 Got JSON-RPC error response 00:25:19.478 response: 00:25:19.478 { 00:25:19.478 "code": -114, 00:25:19.478 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:19.478 } 00:25:19.478 02:07:53 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:19.478 02:07:53 -- common/autotest_common.sh@653 -- # es=1 00:25:19.478 02:07:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:19.478 02:07:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:19.478 02:07:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:19.478 02:07:53 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:19.478 02:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:19.478 02:07:53 -- common/autotest_common.sh@10 -- # set +x 00:25:19.738 00:25:19.738 02:07:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:19.738 02:07:53 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:19.738 02:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:19.738 02:07:53 -- common/autotest_common.sh@10 -- # set +x 00:25:19.738 02:07:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:19.738 02:07:53 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:19.738 02:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:19.738 02:07:53 -- common/autotest_common.sh@10 -- # set +x 00:25:19.738 00:25:19.738 02:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:19.738 02:07:54 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:19.738 02:07:54 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:19.738 02:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:19.738 02:07:54 -- common/autotest_common.sh@10 -- # set +x 00:25:19.738 02:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:19.738 02:07:54 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:19.738 02:07:54 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:21.145 0 00:25:21.145 02:07:55 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:21.145 02:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:21.145 02:07:55 -- common/autotest_common.sh@10 -- # set +x 00:25:21.145 02:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:21.145 02:07:55 -- host/multicontroller.sh@100 -- # killprocess 1284085 00:25:21.145 02:07:55 -- common/autotest_common.sh@936 -- # '[' -z 1284085 ']' 00:25:21.145 02:07:55 -- common/autotest_common.sh@940 -- # kill -0 1284085 00:25:21.145 02:07:55 -- common/autotest_common.sh@941 -- # uname 00:25:21.145 02:07:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:21.145 02:07:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1284085 00:25:21.145 02:07:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:21.145 02:07:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:21.145 02:07:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1284085' 00:25:21.145 killing process with pid 1284085 00:25:21.145 02:07:55 -- common/autotest_common.sh@955 -- # kill 1284085 00:25:21.145 02:07:55 -- common/autotest_common.sh@960 -- # wait 1284085 00:25:21.145 02:07:55 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:21.145 02:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:21.145 02:07:55 -- common/autotest_common.sh@10 -- # set +x 00:25:21.145 02:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:21.145 02:07:55 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:21.145 02:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:21.145 02:07:55 -- common/autotest_common.sh@10 -- # set +x 00:25:21.145 02:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:21.145 02:07:55 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:21.145 02:07:55 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:21.145 02:07:55 -- common/autotest_common.sh@1607 -- # read -r file 00:25:21.145 02:07:55 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:21.145 02:07:55 -- common/autotest_common.sh@1606 -- # sort -u 00:25:21.145 02:07:55 -- common/autotest_common.sh@1608 -- # cat 00:25:21.145 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:21.145 [2024-11-18 02:07:52.728228] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:21.145 [2024-11-18 02:07:52.728334] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1284085 ] 00:25:21.145 EAL: No free 2048 kB hugepages reported on node 1 00:25:21.145 [2024-11-18 02:07:52.786704] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:21.145 [2024-11-18 02:07:52.871433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:21.145 [2024-11-18 02:07:53.997027] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name d4a7b0a3-cadc-4deb-b92f-f6e5f272466d already exists 00:25:21.145 [2024-11-18 02:07:53.997066] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:d4a7b0a3-cadc-4deb-b92f-f6e5f272466d alias for bdev NVMe1n1 00:25:21.145 [2024-11-18 02:07:53.997101] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:21.145 Running I/O for 1 seconds... 00:25:21.145 00:25:21.145 Latency(us) 00:25:21.145 [2024-11-18T01:07:55.547Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:21.145 [2024-11-18T01:07:55.547Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:21.145 NVMe0n1 : 1.00 19743.48 77.12 0.00 0.00 6466.09 4004.98 12379.02 00:25:21.145 [2024-11-18T01:07:55.547Z] =================================================================================================================== 00:25:21.145 [2024-11-18T01:07:55.547Z] Total : 19743.48 77.12 0.00 0.00 6466.09 4004.98 12379.02 00:25:21.145 Received shutdown signal, test time was about 1.000000 seconds 00:25:21.145 00:25:21.145 Latency(us) 00:25:21.145 [2024-11-18T01:07:55.547Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:21.145 [2024-11-18T01:07:55.547Z] =================================================================================================================== 00:25:21.145 [2024-11-18T01:07:55.547Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:21.145 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:21.145 02:07:55 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:21.145 02:07:55 -- common/autotest_common.sh@1607 -- # read -r file 00:25:21.145 02:07:55 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:21.145 02:07:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:21.145 02:07:55 -- nvmf/common.sh@116 -- # sync 00:25:21.145 02:07:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:21.145 02:07:55 -- nvmf/common.sh@119 -- # set +e 00:25:21.145 02:07:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:21.145 02:07:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:21.145 rmmod nvme_tcp 00:25:21.145 rmmod nvme_fabrics 00:25:21.145 rmmod nvme_keyring 00:25:21.145 02:07:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:21.145 02:07:55 -- nvmf/common.sh@123 -- # set -e 00:25:21.145 02:07:55 -- nvmf/common.sh@124 -- # return 0 00:25:21.145 02:07:55 -- nvmf/common.sh@477 -- # '[' -n 1283929 ']' 00:25:21.145 02:07:55 -- nvmf/common.sh@478 -- # killprocess 1283929 00:25:21.145 02:07:55 -- common/autotest_common.sh@936 -- # '[' -z 1283929 ']' 00:25:21.145 02:07:55 -- common/autotest_common.sh@940 -- # kill -0 1283929 00:25:21.145 02:07:55 -- common/autotest_common.sh@941 -- # uname 00:25:21.146 02:07:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:21.146 02:07:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1283929 00:25:21.146 02:07:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:21.146 02:07:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:21.146 02:07:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1283929' 00:25:21.146 killing process with pid 1283929 00:25:21.146 02:07:55 -- common/autotest_common.sh@955 -- # kill 1283929 00:25:21.146 02:07:55 -- common/autotest_common.sh@960 -- # wait 1283929 00:25:21.427 02:07:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:21.427 02:07:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:21.427 02:07:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:21.427 02:07:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:21.427 02:07:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:21.427 02:07:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:21.428 02:07:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:21.428 02:07:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:23.972 02:07:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:23.972 00:25:23.972 real 0m8.715s 00:25:23.972 user 0m16.214s 00:25:23.972 sys 0m2.401s 00:25:23.972 02:07:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:23.972 02:07:57 -- common/autotest_common.sh@10 -- # set +x 00:25:23.972 ************************************ 00:25:23.972 END TEST nvmf_multicontroller 00:25:23.972 ************************************ 00:25:23.972 02:07:57 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:23.972 02:07:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:23.972 02:07:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:23.972 02:07:57 -- common/autotest_common.sh@10 -- # set +x 00:25:23.972 ************************************ 00:25:23.972 START TEST nvmf_aer 00:25:23.972 ************************************ 00:25:23.972 02:07:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:23.972 * Looking for test storage... 00:25:23.972 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:23.972 02:07:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:23.972 02:07:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:23.972 02:07:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:23.972 02:07:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:23.972 02:07:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:23.972 02:07:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:23.972 02:07:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:23.972 02:07:57 -- scripts/common.sh@335 -- # IFS=.-: 00:25:23.972 02:07:57 -- scripts/common.sh@335 -- # read -ra ver1 00:25:23.972 02:07:57 -- scripts/common.sh@336 -- # IFS=.-: 00:25:23.972 02:07:57 -- scripts/common.sh@336 -- # read -ra ver2 00:25:23.972 02:07:57 -- scripts/common.sh@337 -- # local 'op=<' 00:25:23.972 02:07:57 -- scripts/common.sh@339 -- # ver1_l=2 00:25:23.972 02:07:57 -- scripts/common.sh@340 -- # ver2_l=1 00:25:23.972 02:07:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:23.972 02:07:57 -- scripts/common.sh@343 -- # case "$op" in 00:25:23.972 02:07:57 -- scripts/common.sh@344 -- # : 1 00:25:23.972 02:07:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:23.972 02:07:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:23.972 02:07:57 -- scripts/common.sh@364 -- # decimal 1 00:25:23.972 02:07:57 -- scripts/common.sh@352 -- # local d=1 00:25:23.972 02:07:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:23.972 02:07:57 -- scripts/common.sh@354 -- # echo 1 00:25:23.972 02:07:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:23.972 02:07:57 -- scripts/common.sh@365 -- # decimal 2 00:25:23.972 02:07:57 -- scripts/common.sh@352 -- # local d=2 00:25:23.972 02:07:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:23.972 02:07:57 -- scripts/common.sh@354 -- # echo 2 00:25:23.972 02:07:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:23.972 02:07:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:23.972 02:07:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:23.972 02:07:57 -- scripts/common.sh@367 -- # return 0 00:25:23.972 02:07:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:23.972 02:07:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:23.972 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:23.972 --rc genhtml_branch_coverage=1 00:25:23.972 --rc genhtml_function_coverage=1 00:25:23.972 --rc genhtml_legend=1 00:25:23.973 --rc geninfo_all_blocks=1 00:25:23.973 --rc geninfo_unexecuted_blocks=1 00:25:23.973 00:25:23.973 ' 00:25:23.973 02:07:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:23.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:23.973 --rc genhtml_branch_coverage=1 00:25:23.973 --rc genhtml_function_coverage=1 00:25:23.973 --rc genhtml_legend=1 00:25:23.973 --rc geninfo_all_blocks=1 00:25:23.973 --rc geninfo_unexecuted_blocks=1 00:25:23.973 00:25:23.973 ' 00:25:23.973 02:07:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:23.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:23.973 --rc genhtml_branch_coverage=1 00:25:23.973 --rc genhtml_function_coverage=1 00:25:23.973 --rc genhtml_legend=1 00:25:23.973 --rc geninfo_all_blocks=1 00:25:23.973 --rc geninfo_unexecuted_blocks=1 00:25:23.973 00:25:23.973 ' 00:25:23.973 02:07:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:23.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:23.973 --rc genhtml_branch_coverage=1 00:25:23.973 --rc genhtml_function_coverage=1 00:25:23.973 --rc genhtml_legend=1 00:25:23.973 --rc geninfo_all_blocks=1 00:25:23.973 --rc geninfo_unexecuted_blocks=1 00:25:23.973 00:25:23.973 ' 00:25:23.973 02:07:58 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:23.973 02:07:58 -- nvmf/common.sh@7 -- # uname -s 00:25:23.973 02:07:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:23.973 02:07:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:23.973 02:07:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:23.973 02:07:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:23.973 02:07:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:23.973 02:07:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:23.973 02:07:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:23.973 02:07:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:23.973 02:07:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:23.973 02:07:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:23.973 02:07:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:23.973 02:07:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:23.973 02:07:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:23.973 02:07:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:23.973 02:07:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:23.973 02:07:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:23.973 02:07:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:23.973 02:07:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:23.973 02:07:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:23.973 02:07:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:23.973 02:07:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:23.973 02:07:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:23.973 02:07:58 -- paths/export.sh@5 -- # export PATH 00:25:23.973 02:07:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:23.973 02:07:58 -- nvmf/common.sh@46 -- # : 0 00:25:23.973 02:07:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:23.973 02:07:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:23.973 02:07:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:23.973 02:07:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:23.973 02:07:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:23.973 02:07:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:23.973 02:07:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:23.973 02:07:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:23.973 02:07:58 -- host/aer.sh@11 -- # nvmftestinit 00:25:23.973 02:07:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:23.973 02:07:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:23.973 02:07:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:23.973 02:07:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:23.973 02:07:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:23.973 02:07:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:23.973 02:07:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:23.973 02:07:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:23.973 02:07:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:23.973 02:07:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:23.973 02:07:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:23.973 02:07:58 -- common/autotest_common.sh@10 -- # set +x 00:25:25.878 02:07:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:25.878 02:07:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:25.878 02:07:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:25.878 02:07:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:25.878 02:07:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:25.878 02:07:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:25.878 02:07:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:25.878 02:07:59 -- nvmf/common.sh@294 -- # net_devs=() 00:25:25.878 02:07:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:25.878 02:07:59 -- nvmf/common.sh@295 -- # e810=() 00:25:25.878 02:07:59 -- nvmf/common.sh@295 -- # local -ga e810 00:25:25.878 02:07:59 -- nvmf/common.sh@296 -- # x722=() 00:25:25.878 02:07:59 -- nvmf/common.sh@296 -- # local -ga x722 00:25:25.878 02:07:59 -- nvmf/common.sh@297 -- # mlx=() 00:25:25.878 02:07:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:25.878 02:07:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:25.878 02:07:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:25.878 02:07:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:25.878 02:07:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:25.878 02:07:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:25.878 02:07:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:25.878 02:07:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:25.878 02:07:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:25.878 02:07:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:25.878 02:07:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:25.878 02:07:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:25.878 02:07:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:25.878 02:07:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:25.878 02:07:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:25.878 02:07:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:25.878 02:07:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:25.878 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:25.878 02:07:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:25.878 02:07:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:25.878 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:25.878 02:07:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:25.878 02:07:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:25.878 02:07:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:25.878 02:07:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:25.878 02:07:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:25.878 02:07:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:25.878 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:25.878 02:07:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:25.878 02:07:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:25.878 02:07:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:25.878 02:07:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:25.878 02:07:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:25.878 02:07:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:25.878 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:25.878 02:07:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:25.878 02:07:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:25.878 02:07:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:25.878 02:07:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:25.878 02:07:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:25.878 02:07:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:25.878 02:07:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:25.878 02:07:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:25.878 02:07:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:25.878 02:07:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:25.878 02:07:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:25.878 02:07:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:25.878 02:07:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:25.878 02:07:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:25.878 02:07:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:25.878 02:07:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:25.878 02:07:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:25.878 02:07:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:25.878 02:08:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:25.878 02:08:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:25.878 02:08:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:25.878 02:08:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:25.878 02:08:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:25.878 02:08:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:25.878 02:08:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:25.878 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:25.878 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.166 ms 00:25:25.878 00:25:25.878 --- 10.0.0.2 ping statistics --- 00:25:25.878 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:25.878 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:25:25.878 02:08:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:25.878 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:25.878 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:25:25.878 00:25:25.878 --- 10.0.0.1 ping statistics --- 00:25:25.878 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:25.878 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:25:25.878 02:08:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:25.878 02:08:00 -- nvmf/common.sh@410 -- # return 0 00:25:25.878 02:08:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:25.878 02:08:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:25.878 02:08:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:25.878 02:08:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:25.878 02:08:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:25.879 02:08:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:25.879 02:08:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:25.879 02:08:00 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:25.879 02:08:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:25.879 02:08:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:25.879 02:08:00 -- common/autotest_common.sh@10 -- # set +x 00:25:25.879 02:08:00 -- nvmf/common.sh@469 -- # nvmfpid=1286460 00:25:25.879 02:08:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:25.879 02:08:00 -- nvmf/common.sh@470 -- # waitforlisten 1286460 00:25:25.879 02:08:00 -- common/autotest_common.sh@829 -- # '[' -z 1286460 ']' 00:25:25.879 02:08:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:25.879 02:08:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:25.879 02:08:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:25.879 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:25.879 02:08:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:25.879 02:08:00 -- common/autotest_common.sh@10 -- # set +x 00:25:25.879 [2024-11-18 02:08:00.133419] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:25.879 [2024-11-18 02:08:00.133499] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:25.879 EAL: No free 2048 kB hugepages reported on node 1 00:25:25.879 [2024-11-18 02:08:00.204579] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:26.138 [2024-11-18 02:08:00.296334] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:26.138 [2024-11-18 02:08:00.296484] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:26.138 [2024-11-18 02:08:00.296501] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:26.138 [2024-11-18 02:08:00.296513] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:26.138 [2024-11-18 02:08:00.296754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:26.138 [2024-11-18 02:08:00.296815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:26.138 [2024-11-18 02:08:00.296865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:26.138 [2024-11-18 02:08:00.296868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:27.075 02:08:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:27.075 02:08:01 -- common/autotest_common.sh@862 -- # return 0 00:25:27.075 02:08:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:27.075 02:08:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:27.075 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.075 02:08:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:27.075 02:08:01 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:27.075 02:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.075 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.075 [2024-11-18 02:08:01.168085] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:27.075 02:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.075 02:08:01 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:27.075 02:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.075 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.075 Malloc0 00:25:27.075 02:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.075 02:08:01 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:27.075 02:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.075 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.075 02:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.075 02:08:01 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:27.075 02:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.075 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.075 02:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.075 02:08:01 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:27.075 02:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.075 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.075 [2024-11-18 02:08:01.220893] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:27.075 02:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.075 02:08:01 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:27.075 02:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.075 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.076 [2024-11-18 02:08:01.228624] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:27.076 [ 00:25:27.076 { 00:25:27.076 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:27.076 "subtype": "Discovery", 00:25:27.076 "listen_addresses": [], 00:25:27.076 "allow_any_host": true, 00:25:27.076 "hosts": [] 00:25:27.076 }, 00:25:27.076 { 00:25:27.076 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:27.076 "subtype": "NVMe", 00:25:27.076 "listen_addresses": [ 00:25:27.076 { 00:25:27.076 "transport": "TCP", 00:25:27.076 "trtype": "TCP", 00:25:27.076 "adrfam": "IPv4", 00:25:27.076 "traddr": "10.0.0.2", 00:25:27.076 "trsvcid": "4420" 00:25:27.076 } 00:25:27.076 ], 00:25:27.076 "allow_any_host": true, 00:25:27.076 "hosts": [], 00:25:27.076 "serial_number": "SPDK00000000000001", 00:25:27.076 "model_number": "SPDK bdev Controller", 00:25:27.076 "max_namespaces": 2, 00:25:27.076 "min_cntlid": 1, 00:25:27.076 "max_cntlid": 65519, 00:25:27.076 "namespaces": [ 00:25:27.076 { 00:25:27.076 "nsid": 1, 00:25:27.076 "bdev_name": "Malloc0", 00:25:27.076 "name": "Malloc0", 00:25:27.076 "nguid": "DE5CFEE8BACF442F882D90618A071E8B", 00:25:27.076 "uuid": "de5cfee8-bacf-442f-882d-90618a071e8b" 00:25:27.076 } 00:25:27.076 ] 00:25:27.076 } 00:25:27.076 ] 00:25:27.076 02:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.076 02:08:01 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:27.076 02:08:01 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:27.076 02:08:01 -- host/aer.sh@33 -- # aerpid=1286624 00:25:27.076 02:08:01 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:27.076 02:08:01 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:27.076 02:08:01 -- common/autotest_common.sh@1254 -- # local i=0 00:25:27.076 02:08:01 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:27.076 02:08:01 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:25:27.076 02:08:01 -- common/autotest_common.sh@1257 -- # i=1 00:25:27.076 02:08:01 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:27.076 EAL: No free 2048 kB hugepages reported on node 1 00:25:27.076 02:08:01 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:27.076 02:08:01 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:25:27.076 02:08:01 -- common/autotest_common.sh@1257 -- # i=2 00:25:27.076 02:08:01 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:27.076 02:08:01 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:27.076 02:08:01 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:25:27.076 02:08:01 -- common/autotest_common.sh@1257 -- # i=3 00:25:27.076 02:08:01 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:27.335 02:08:01 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:27.335 02:08:01 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:27.335 02:08:01 -- common/autotest_common.sh@1265 -- # return 0 00:25:27.335 02:08:01 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:27.335 02:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.335 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.335 Malloc1 00:25:27.335 02:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.335 02:08:01 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:27.335 02:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.335 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.335 02:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.335 02:08:01 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:27.335 02:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.335 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.335 Asynchronous Event Request test 00:25:27.335 Attaching to 10.0.0.2 00:25:27.335 Attached to 10.0.0.2 00:25:27.335 Registering asynchronous event callbacks... 00:25:27.335 Starting namespace attribute notice tests for all controllers... 00:25:27.335 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:27.335 aer_cb - Changed Namespace 00:25:27.335 Cleaning up... 00:25:27.335 [ 00:25:27.335 { 00:25:27.335 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:27.335 "subtype": "Discovery", 00:25:27.335 "listen_addresses": [], 00:25:27.335 "allow_any_host": true, 00:25:27.335 "hosts": [] 00:25:27.335 }, 00:25:27.335 { 00:25:27.335 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:27.335 "subtype": "NVMe", 00:25:27.335 "listen_addresses": [ 00:25:27.335 { 00:25:27.335 "transport": "TCP", 00:25:27.335 "trtype": "TCP", 00:25:27.335 "adrfam": "IPv4", 00:25:27.335 "traddr": "10.0.0.2", 00:25:27.335 "trsvcid": "4420" 00:25:27.335 } 00:25:27.335 ], 00:25:27.335 "allow_any_host": true, 00:25:27.335 "hosts": [], 00:25:27.335 "serial_number": "SPDK00000000000001", 00:25:27.335 "model_number": "SPDK bdev Controller", 00:25:27.335 "max_namespaces": 2, 00:25:27.335 "min_cntlid": 1, 00:25:27.335 "max_cntlid": 65519, 00:25:27.335 "namespaces": [ 00:25:27.335 { 00:25:27.335 "nsid": 1, 00:25:27.335 "bdev_name": "Malloc0", 00:25:27.335 "name": "Malloc0", 00:25:27.335 "nguid": "DE5CFEE8BACF442F882D90618A071E8B", 00:25:27.335 "uuid": "de5cfee8-bacf-442f-882d-90618a071e8b" 00:25:27.335 }, 00:25:27.335 { 00:25:27.335 "nsid": 2, 00:25:27.335 "bdev_name": "Malloc1", 00:25:27.335 "name": "Malloc1", 00:25:27.335 "nguid": "A81F07CB27D8466E85BDBC056E4BA3FC", 00:25:27.335 "uuid": "a81f07cb-27d8-466e-85bd-bc056e4ba3fc" 00:25:27.335 } 00:25:27.335 ] 00:25:27.335 } 00:25:27.335 ] 00:25:27.335 02:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.335 02:08:01 -- host/aer.sh@43 -- # wait 1286624 00:25:27.335 02:08:01 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:27.335 02:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.335 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.335 02:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.335 02:08:01 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:27.335 02:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.335 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.335 02:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.335 02:08:01 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:27.335 02:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.335 02:08:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.335 02:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.335 02:08:01 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:27.335 02:08:01 -- host/aer.sh@51 -- # nvmftestfini 00:25:27.335 02:08:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:27.335 02:08:01 -- nvmf/common.sh@116 -- # sync 00:25:27.335 02:08:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:27.335 02:08:01 -- nvmf/common.sh@119 -- # set +e 00:25:27.335 02:08:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:27.335 02:08:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:27.335 rmmod nvme_tcp 00:25:27.335 rmmod nvme_fabrics 00:25:27.335 rmmod nvme_keyring 00:25:27.594 02:08:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:27.594 02:08:01 -- nvmf/common.sh@123 -- # set -e 00:25:27.594 02:08:01 -- nvmf/common.sh@124 -- # return 0 00:25:27.594 02:08:01 -- nvmf/common.sh@477 -- # '[' -n 1286460 ']' 00:25:27.594 02:08:01 -- nvmf/common.sh@478 -- # killprocess 1286460 00:25:27.595 02:08:01 -- common/autotest_common.sh@936 -- # '[' -z 1286460 ']' 00:25:27.595 02:08:01 -- common/autotest_common.sh@940 -- # kill -0 1286460 00:25:27.595 02:08:01 -- common/autotest_common.sh@941 -- # uname 00:25:27.595 02:08:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:27.595 02:08:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1286460 00:25:27.595 02:08:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:27.595 02:08:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:27.595 02:08:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1286460' 00:25:27.595 killing process with pid 1286460 00:25:27.595 02:08:01 -- common/autotest_common.sh@955 -- # kill 1286460 00:25:27.595 [2024-11-18 02:08:01.791856] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:27.595 02:08:01 -- common/autotest_common.sh@960 -- # wait 1286460 00:25:27.853 02:08:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:27.853 02:08:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:27.853 02:08:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:27.853 02:08:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:27.854 02:08:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:27.854 02:08:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:27.854 02:08:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:27.854 02:08:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:29.763 02:08:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:29.763 00:25:29.763 real 0m6.204s 00:25:29.763 user 0m7.795s 00:25:29.763 sys 0m1.939s 00:25:29.763 02:08:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:29.763 02:08:04 -- common/autotest_common.sh@10 -- # set +x 00:25:29.763 ************************************ 00:25:29.763 END TEST nvmf_aer 00:25:29.763 ************************************ 00:25:29.763 02:08:04 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:29.763 02:08:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:29.763 02:08:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:29.763 02:08:04 -- common/autotest_common.sh@10 -- # set +x 00:25:29.763 ************************************ 00:25:29.763 START TEST nvmf_async_init 00:25:29.763 ************************************ 00:25:29.763 02:08:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:29.763 * Looking for test storage... 00:25:29.763 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:29.763 02:08:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:29.763 02:08:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:29.763 02:08:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:30.022 02:08:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:30.022 02:08:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:30.022 02:08:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:30.022 02:08:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:30.022 02:08:04 -- scripts/common.sh@335 -- # IFS=.-: 00:25:30.022 02:08:04 -- scripts/common.sh@335 -- # read -ra ver1 00:25:30.022 02:08:04 -- scripts/common.sh@336 -- # IFS=.-: 00:25:30.022 02:08:04 -- scripts/common.sh@336 -- # read -ra ver2 00:25:30.022 02:08:04 -- scripts/common.sh@337 -- # local 'op=<' 00:25:30.022 02:08:04 -- scripts/common.sh@339 -- # ver1_l=2 00:25:30.022 02:08:04 -- scripts/common.sh@340 -- # ver2_l=1 00:25:30.022 02:08:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:30.022 02:08:04 -- scripts/common.sh@343 -- # case "$op" in 00:25:30.022 02:08:04 -- scripts/common.sh@344 -- # : 1 00:25:30.022 02:08:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:30.022 02:08:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:30.022 02:08:04 -- scripts/common.sh@364 -- # decimal 1 00:25:30.022 02:08:04 -- scripts/common.sh@352 -- # local d=1 00:25:30.022 02:08:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:30.022 02:08:04 -- scripts/common.sh@354 -- # echo 1 00:25:30.022 02:08:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:30.022 02:08:04 -- scripts/common.sh@365 -- # decimal 2 00:25:30.022 02:08:04 -- scripts/common.sh@352 -- # local d=2 00:25:30.022 02:08:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:30.022 02:08:04 -- scripts/common.sh@354 -- # echo 2 00:25:30.022 02:08:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:30.022 02:08:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:30.022 02:08:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:30.022 02:08:04 -- scripts/common.sh@367 -- # return 0 00:25:30.022 02:08:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:30.022 02:08:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:30.022 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:30.022 --rc genhtml_branch_coverage=1 00:25:30.022 --rc genhtml_function_coverage=1 00:25:30.022 --rc genhtml_legend=1 00:25:30.022 --rc geninfo_all_blocks=1 00:25:30.022 --rc geninfo_unexecuted_blocks=1 00:25:30.022 00:25:30.022 ' 00:25:30.022 02:08:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:30.022 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:30.022 --rc genhtml_branch_coverage=1 00:25:30.022 --rc genhtml_function_coverage=1 00:25:30.022 --rc genhtml_legend=1 00:25:30.022 --rc geninfo_all_blocks=1 00:25:30.022 --rc geninfo_unexecuted_blocks=1 00:25:30.022 00:25:30.022 ' 00:25:30.022 02:08:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:30.022 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:30.022 --rc genhtml_branch_coverage=1 00:25:30.022 --rc genhtml_function_coverage=1 00:25:30.022 --rc genhtml_legend=1 00:25:30.022 --rc geninfo_all_blocks=1 00:25:30.022 --rc geninfo_unexecuted_blocks=1 00:25:30.022 00:25:30.022 ' 00:25:30.022 02:08:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:30.022 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:30.022 --rc genhtml_branch_coverage=1 00:25:30.022 --rc genhtml_function_coverage=1 00:25:30.022 --rc genhtml_legend=1 00:25:30.022 --rc geninfo_all_blocks=1 00:25:30.022 --rc geninfo_unexecuted_blocks=1 00:25:30.022 00:25:30.022 ' 00:25:30.022 02:08:04 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:30.022 02:08:04 -- nvmf/common.sh@7 -- # uname -s 00:25:30.022 02:08:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:30.022 02:08:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:30.022 02:08:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:30.022 02:08:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:30.022 02:08:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:30.022 02:08:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:30.022 02:08:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:30.022 02:08:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:30.022 02:08:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:30.022 02:08:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:30.022 02:08:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:30.022 02:08:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:30.022 02:08:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:30.022 02:08:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:30.022 02:08:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:30.022 02:08:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:30.022 02:08:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:30.022 02:08:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:30.022 02:08:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:30.022 02:08:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:30.022 02:08:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:30.022 02:08:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:30.022 02:08:04 -- paths/export.sh@5 -- # export PATH 00:25:30.023 02:08:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:30.023 02:08:04 -- nvmf/common.sh@46 -- # : 0 00:25:30.023 02:08:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:30.023 02:08:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:30.023 02:08:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:30.023 02:08:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:30.023 02:08:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:30.023 02:08:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:30.023 02:08:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:30.023 02:08:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:30.023 02:08:04 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:30.023 02:08:04 -- host/async_init.sh@14 -- # null_block_size=512 00:25:30.023 02:08:04 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:30.023 02:08:04 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:30.023 02:08:04 -- host/async_init.sh@20 -- # uuidgen 00:25:30.023 02:08:04 -- host/async_init.sh@20 -- # tr -d - 00:25:30.023 02:08:04 -- host/async_init.sh@20 -- # nguid=ea673a9daa1141028e3f7a77b7faaf4a 00:25:30.023 02:08:04 -- host/async_init.sh@22 -- # nvmftestinit 00:25:30.023 02:08:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:30.023 02:08:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:30.023 02:08:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:30.023 02:08:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:30.023 02:08:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:30.023 02:08:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:30.023 02:08:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:30.023 02:08:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:30.023 02:08:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:30.023 02:08:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:30.023 02:08:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:30.023 02:08:04 -- common/autotest_common.sh@10 -- # set +x 00:25:31.930 02:08:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:31.930 02:08:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:31.930 02:08:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:31.930 02:08:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:31.930 02:08:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:31.930 02:08:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:31.930 02:08:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:31.930 02:08:06 -- nvmf/common.sh@294 -- # net_devs=() 00:25:31.930 02:08:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:31.930 02:08:06 -- nvmf/common.sh@295 -- # e810=() 00:25:31.930 02:08:06 -- nvmf/common.sh@295 -- # local -ga e810 00:25:31.930 02:08:06 -- nvmf/common.sh@296 -- # x722=() 00:25:31.930 02:08:06 -- nvmf/common.sh@296 -- # local -ga x722 00:25:31.930 02:08:06 -- nvmf/common.sh@297 -- # mlx=() 00:25:31.930 02:08:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:31.930 02:08:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:31.930 02:08:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:31.930 02:08:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:31.930 02:08:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:31.930 02:08:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:31.930 02:08:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:31.930 02:08:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:31.930 02:08:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:31.930 02:08:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:31.930 02:08:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:31.930 02:08:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:31.930 02:08:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:31.930 02:08:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:31.930 02:08:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:31.930 02:08:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:31.930 02:08:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:31.930 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:31.930 02:08:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:31.930 02:08:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:31.930 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:31.930 02:08:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:31.930 02:08:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:31.930 02:08:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:31.930 02:08:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:31.930 02:08:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:31.930 02:08:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:31.930 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:31.930 02:08:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:31.930 02:08:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:31.930 02:08:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:31.930 02:08:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:31.930 02:08:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:31.930 02:08:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:31.930 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:31.930 02:08:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:31.930 02:08:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:31.930 02:08:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:31.930 02:08:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:31.930 02:08:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:31.930 02:08:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:31.930 02:08:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:31.930 02:08:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:31.930 02:08:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:31.930 02:08:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:31.930 02:08:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:31.930 02:08:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:31.930 02:08:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:31.930 02:08:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:31.930 02:08:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:31.930 02:08:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:31.930 02:08:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:31.930 02:08:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:31.930 02:08:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:31.930 02:08:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:31.930 02:08:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:31.930 02:08:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:31.930 02:08:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:31.930 02:08:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:31.930 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:31.930 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.167 ms 00:25:31.930 00:25:31.930 --- 10.0.0.2 ping statistics --- 00:25:31.930 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:31.930 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:25:31.930 02:08:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:31.930 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:31.930 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:25:31.930 00:25:31.930 --- 10.0.0.1 ping statistics --- 00:25:31.930 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:31.930 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:25:31.930 02:08:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:31.930 02:08:06 -- nvmf/common.sh@410 -- # return 0 00:25:31.930 02:08:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:31.930 02:08:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:31.930 02:08:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:31.930 02:08:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:31.930 02:08:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:31.930 02:08:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:32.189 02:08:06 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:32.189 02:08:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:32.189 02:08:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:32.189 02:08:06 -- common/autotest_common.sh@10 -- # set +x 00:25:32.189 02:08:06 -- nvmf/common.sh@469 -- # nvmfpid=1288577 00:25:32.189 02:08:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:32.189 02:08:06 -- nvmf/common.sh@470 -- # waitforlisten 1288577 00:25:32.189 02:08:06 -- common/autotest_common.sh@829 -- # '[' -z 1288577 ']' 00:25:32.189 02:08:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:32.189 02:08:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:32.189 02:08:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:32.189 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:32.189 02:08:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:32.189 02:08:06 -- common/autotest_common.sh@10 -- # set +x 00:25:32.189 [2024-11-18 02:08:06.389307] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:32.189 [2024-11-18 02:08:06.389397] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:32.189 EAL: No free 2048 kB hugepages reported on node 1 00:25:32.189 [2024-11-18 02:08:06.455679] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:32.189 [2024-11-18 02:08:06.548651] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:32.189 [2024-11-18 02:08:06.548789] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:32.189 [2024-11-18 02:08:06.548807] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:32.189 [2024-11-18 02:08:06.548820] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:32.189 [2024-11-18 02:08:06.548848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:33.122 02:08:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:33.122 02:08:07 -- common/autotest_common.sh@862 -- # return 0 00:25:33.122 02:08:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:33.122 02:08:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:33.122 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.123 02:08:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:33.123 02:08:07 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:33.123 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.123 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.123 [2024-11-18 02:08:07.428187] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:33.123 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.123 02:08:07 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:33.123 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.123 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.123 null0 00:25:33.123 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.123 02:08:07 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:33.123 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.123 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.123 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.123 02:08:07 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:33.123 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.123 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.123 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.123 02:08:07 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g ea673a9daa1141028e3f7a77b7faaf4a 00:25:33.123 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.123 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.123 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.123 02:08:07 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:33.123 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.123 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.123 [2024-11-18 02:08:07.468466] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:33.123 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.123 02:08:07 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:33.123 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.123 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.380 nvme0n1 00:25:33.380 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.380 02:08:07 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:33.380 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.380 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.380 [ 00:25:33.380 { 00:25:33.380 "name": "nvme0n1", 00:25:33.380 "aliases": [ 00:25:33.380 "ea673a9d-aa11-4102-8e3f-7a77b7faaf4a" 00:25:33.380 ], 00:25:33.380 "product_name": "NVMe disk", 00:25:33.380 "block_size": 512, 00:25:33.380 "num_blocks": 2097152, 00:25:33.380 "uuid": "ea673a9d-aa11-4102-8e3f-7a77b7faaf4a", 00:25:33.380 "assigned_rate_limits": { 00:25:33.380 "rw_ios_per_sec": 0, 00:25:33.380 "rw_mbytes_per_sec": 0, 00:25:33.380 "r_mbytes_per_sec": 0, 00:25:33.380 "w_mbytes_per_sec": 0 00:25:33.380 }, 00:25:33.380 "claimed": false, 00:25:33.380 "zoned": false, 00:25:33.380 "supported_io_types": { 00:25:33.380 "read": true, 00:25:33.380 "write": true, 00:25:33.380 "unmap": false, 00:25:33.380 "write_zeroes": true, 00:25:33.380 "flush": true, 00:25:33.380 "reset": true, 00:25:33.380 "compare": true, 00:25:33.380 "compare_and_write": true, 00:25:33.380 "abort": true, 00:25:33.380 "nvme_admin": true, 00:25:33.380 "nvme_io": true 00:25:33.380 }, 00:25:33.380 "driver_specific": { 00:25:33.380 "nvme": [ 00:25:33.380 { 00:25:33.380 "trid": { 00:25:33.380 "trtype": "TCP", 00:25:33.380 "adrfam": "IPv4", 00:25:33.380 "traddr": "10.0.0.2", 00:25:33.380 "trsvcid": "4420", 00:25:33.380 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:33.380 }, 00:25:33.380 "ctrlr_data": { 00:25:33.380 "cntlid": 1, 00:25:33.380 "vendor_id": "0x8086", 00:25:33.380 "model_number": "SPDK bdev Controller", 00:25:33.380 "serial_number": "00000000000000000000", 00:25:33.380 "firmware_revision": "24.01.1", 00:25:33.380 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:33.380 "oacs": { 00:25:33.380 "security": 0, 00:25:33.380 "format": 0, 00:25:33.380 "firmware": 0, 00:25:33.380 "ns_manage": 0 00:25:33.380 }, 00:25:33.380 "multi_ctrlr": true, 00:25:33.380 "ana_reporting": false 00:25:33.380 }, 00:25:33.380 "vs": { 00:25:33.381 "nvme_version": "1.3" 00:25:33.381 }, 00:25:33.381 "ns_data": { 00:25:33.381 "id": 1, 00:25:33.381 "can_share": true 00:25:33.381 } 00:25:33.381 } 00:25:33.381 ], 00:25:33.381 "mp_policy": "active_passive" 00:25:33.381 } 00:25:33.381 } 00:25:33.381 ] 00:25:33.381 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.381 02:08:07 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:25:33.381 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.381 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.381 [2024-11-18 02:08:07.717119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:33.381 [2024-11-18 02:08:07.717220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16e1ba0 (9): Bad file descriptor 00:25:33.639 [2024-11-18 02:08:07.849458] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:33.639 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.639 02:08:07 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:33.639 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.639 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.639 [ 00:25:33.639 { 00:25:33.639 "name": "nvme0n1", 00:25:33.639 "aliases": [ 00:25:33.639 "ea673a9d-aa11-4102-8e3f-7a77b7faaf4a" 00:25:33.639 ], 00:25:33.639 "product_name": "NVMe disk", 00:25:33.639 "block_size": 512, 00:25:33.639 "num_blocks": 2097152, 00:25:33.639 "uuid": "ea673a9d-aa11-4102-8e3f-7a77b7faaf4a", 00:25:33.639 "assigned_rate_limits": { 00:25:33.639 "rw_ios_per_sec": 0, 00:25:33.639 "rw_mbytes_per_sec": 0, 00:25:33.639 "r_mbytes_per_sec": 0, 00:25:33.639 "w_mbytes_per_sec": 0 00:25:33.639 }, 00:25:33.639 "claimed": false, 00:25:33.639 "zoned": false, 00:25:33.639 "supported_io_types": { 00:25:33.639 "read": true, 00:25:33.639 "write": true, 00:25:33.639 "unmap": false, 00:25:33.639 "write_zeroes": true, 00:25:33.639 "flush": true, 00:25:33.639 "reset": true, 00:25:33.639 "compare": true, 00:25:33.639 "compare_and_write": true, 00:25:33.639 "abort": true, 00:25:33.639 "nvme_admin": true, 00:25:33.639 "nvme_io": true 00:25:33.639 }, 00:25:33.639 "driver_specific": { 00:25:33.639 "nvme": [ 00:25:33.639 { 00:25:33.639 "trid": { 00:25:33.639 "trtype": "TCP", 00:25:33.639 "adrfam": "IPv4", 00:25:33.639 "traddr": "10.0.0.2", 00:25:33.639 "trsvcid": "4420", 00:25:33.639 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:33.639 }, 00:25:33.639 "ctrlr_data": { 00:25:33.639 "cntlid": 2, 00:25:33.639 "vendor_id": "0x8086", 00:25:33.639 "model_number": "SPDK bdev Controller", 00:25:33.639 "serial_number": "00000000000000000000", 00:25:33.639 "firmware_revision": "24.01.1", 00:25:33.639 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:33.639 "oacs": { 00:25:33.639 "security": 0, 00:25:33.639 "format": 0, 00:25:33.639 "firmware": 0, 00:25:33.639 "ns_manage": 0 00:25:33.639 }, 00:25:33.639 "multi_ctrlr": true, 00:25:33.639 "ana_reporting": false 00:25:33.639 }, 00:25:33.639 "vs": { 00:25:33.639 "nvme_version": "1.3" 00:25:33.639 }, 00:25:33.639 "ns_data": { 00:25:33.639 "id": 1, 00:25:33.639 "can_share": true 00:25:33.639 } 00:25:33.639 } 00:25:33.639 ], 00:25:33.639 "mp_policy": "active_passive" 00:25:33.639 } 00:25:33.639 } 00:25:33.639 ] 00:25:33.639 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.639 02:08:07 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:33.639 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.639 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.639 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.639 02:08:07 -- host/async_init.sh@53 -- # mktemp 00:25:33.639 02:08:07 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.xGhFSEpNA4 00:25:33.639 02:08:07 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:25:33.639 02:08:07 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.xGhFSEpNA4 00:25:33.639 02:08:07 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:25:33.640 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.640 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.640 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.640 02:08:07 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:25:33.640 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.640 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.640 [2024-11-18 02:08:07.893726] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:25:33.640 [2024-11-18 02:08:07.893865] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:33.640 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.640 02:08:07 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.xGhFSEpNA4 00:25:33.640 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.640 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.640 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.640 02:08:07 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.xGhFSEpNA4 00:25:33.640 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.640 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.640 [2024-11-18 02:08:07.909764] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:25:33.640 nvme0n1 00:25:33.640 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.640 02:08:07 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:33.640 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.640 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.640 [ 00:25:33.640 { 00:25:33.640 "name": "nvme0n1", 00:25:33.640 "aliases": [ 00:25:33.640 "ea673a9d-aa11-4102-8e3f-7a77b7faaf4a" 00:25:33.640 ], 00:25:33.640 "product_name": "NVMe disk", 00:25:33.640 "block_size": 512, 00:25:33.640 "num_blocks": 2097152, 00:25:33.640 "uuid": "ea673a9d-aa11-4102-8e3f-7a77b7faaf4a", 00:25:33.640 "assigned_rate_limits": { 00:25:33.640 "rw_ios_per_sec": 0, 00:25:33.640 "rw_mbytes_per_sec": 0, 00:25:33.640 "r_mbytes_per_sec": 0, 00:25:33.640 "w_mbytes_per_sec": 0 00:25:33.640 }, 00:25:33.640 "claimed": false, 00:25:33.640 "zoned": false, 00:25:33.640 "supported_io_types": { 00:25:33.640 "read": true, 00:25:33.640 "write": true, 00:25:33.640 "unmap": false, 00:25:33.640 "write_zeroes": true, 00:25:33.640 "flush": true, 00:25:33.640 "reset": true, 00:25:33.640 "compare": true, 00:25:33.640 "compare_and_write": true, 00:25:33.640 "abort": true, 00:25:33.640 "nvme_admin": true, 00:25:33.640 "nvme_io": true 00:25:33.640 }, 00:25:33.640 "driver_specific": { 00:25:33.640 "nvme": [ 00:25:33.640 { 00:25:33.640 "trid": { 00:25:33.640 "trtype": "TCP", 00:25:33.640 "adrfam": "IPv4", 00:25:33.640 "traddr": "10.0.0.2", 00:25:33.640 "trsvcid": "4421", 00:25:33.640 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:33.640 }, 00:25:33.640 "ctrlr_data": { 00:25:33.640 "cntlid": 3, 00:25:33.640 "vendor_id": "0x8086", 00:25:33.640 "model_number": "SPDK bdev Controller", 00:25:33.640 "serial_number": "00000000000000000000", 00:25:33.640 "firmware_revision": "24.01.1", 00:25:33.640 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:33.640 "oacs": { 00:25:33.640 "security": 0, 00:25:33.640 "format": 0, 00:25:33.640 "firmware": 0, 00:25:33.640 "ns_manage": 0 00:25:33.640 }, 00:25:33.640 "multi_ctrlr": true, 00:25:33.640 "ana_reporting": false 00:25:33.640 }, 00:25:33.640 "vs": { 00:25:33.640 "nvme_version": "1.3" 00:25:33.640 }, 00:25:33.640 "ns_data": { 00:25:33.640 "id": 1, 00:25:33.640 "can_share": true 00:25:33.640 } 00:25:33.640 } 00:25:33.640 ], 00:25:33.640 "mp_policy": "active_passive" 00:25:33.640 } 00:25:33.640 } 00:25:33.640 ] 00:25:33.640 02:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.640 02:08:07 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:33.640 02:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.640 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:25:33.640 02:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.640 02:08:08 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.xGhFSEpNA4 00:25:33.640 02:08:08 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:25:33.640 02:08:08 -- host/async_init.sh@78 -- # nvmftestfini 00:25:33.640 02:08:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:33.640 02:08:08 -- nvmf/common.sh@116 -- # sync 00:25:33.640 02:08:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:33.640 02:08:08 -- nvmf/common.sh@119 -- # set +e 00:25:33.640 02:08:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:33.640 02:08:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:33.640 rmmod nvme_tcp 00:25:33.640 rmmod nvme_fabrics 00:25:33.640 rmmod nvme_keyring 00:25:33.899 02:08:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:33.899 02:08:08 -- nvmf/common.sh@123 -- # set -e 00:25:33.899 02:08:08 -- nvmf/common.sh@124 -- # return 0 00:25:33.899 02:08:08 -- nvmf/common.sh@477 -- # '[' -n 1288577 ']' 00:25:33.899 02:08:08 -- nvmf/common.sh@478 -- # killprocess 1288577 00:25:33.899 02:08:08 -- common/autotest_common.sh@936 -- # '[' -z 1288577 ']' 00:25:33.899 02:08:08 -- common/autotest_common.sh@940 -- # kill -0 1288577 00:25:33.899 02:08:08 -- common/autotest_common.sh@941 -- # uname 00:25:33.899 02:08:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:33.899 02:08:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1288577 00:25:33.899 02:08:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:33.899 02:08:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:33.899 02:08:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1288577' 00:25:33.899 killing process with pid 1288577 00:25:33.899 02:08:08 -- common/autotest_common.sh@955 -- # kill 1288577 00:25:33.899 02:08:08 -- common/autotest_common.sh@960 -- # wait 1288577 00:25:33.899 02:08:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:33.899 02:08:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:33.899 02:08:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:33.899 02:08:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:33.899 02:08:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:33.899 02:08:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:34.157 02:08:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:34.157 02:08:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:36.057 02:08:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:36.057 00:25:36.057 real 0m6.249s 00:25:36.057 user 0m3.063s 00:25:36.057 sys 0m1.858s 00:25:36.057 02:08:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:36.057 02:08:10 -- common/autotest_common.sh@10 -- # set +x 00:25:36.057 ************************************ 00:25:36.057 END TEST nvmf_async_init 00:25:36.057 ************************************ 00:25:36.057 02:08:10 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:36.057 02:08:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:36.057 02:08:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:36.057 02:08:10 -- common/autotest_common.sh@10 -- # set +x 00:25:36.057 ************************************ 00:25:36.057 START TEST dma 00:25:36.057 ************************************ 00:25:36.057 02:08:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:36.057 * Looking for test storage... 00:25:36.057 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:36.057 02:08:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:36.057 02:08:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:36.057 02:08:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:36.317 02:08:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:36.317 02:08:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:36.317 02:08:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:36.317 02:08:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:36.317 02:08:10 -- scripts/common.sh@335 -- # IFS=.-: 00:25:36.317 02:08:10 -- scripts/common.sh@335 -- # read -ra ver1 00:25:36.317 02:08:10 -- scripts/common.sh@336 -- # IFS=.-: 00:25:36.317 02:08:10 -- scripts/common.sh@336 -- # read -ra ver2 00:25:36.317 02:08:10 -- scripts/common.sh@337 -- # local 'op=<' 00:25:36.317 02:08:10 -- scripts/common.sh@339 -- # ver1_l=2 00:25:36.317 02:08:10 -- scripts/common.sh@340 -- # ver2_l=1 00:25:36.317 02:08:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:36.317 02:08:10 -- scripts/common.sh@343 -- # case "$op" in 00:25:36.317 02:08:10 -- scripts/common.sh@344 -- # : 1 00:25:36.317 02:08:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:36.317 02:08:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:36.317 02:08:10 -- scripts/common.sh@364 -- # decimal 1 00:25:36.317 02:08:10 -- scripts/common.sh@352 -- # local d=1 00:25:36.317 02:08:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:36.317 02:08:10 -- scripts/common.sh@354 -- # echo 1 00:25:36.317 02:08:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:36.317 02:08:10 -- scripts/common.sh@365 -- # decimal 2 00:25:36.317 02:08:10 -- scripts/common.sh@352 -- # local d=2 00:25:36.317 02:08:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:36.317 02:08:10 -- scripts/common.sh@354 -- # echo 2 00:25:36.317 02:08:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:36.317 02:08:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:36.317 02:08:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:36.317 02:08:10 -- scripts/common.sh@367 -- # return 0 00:25:36.317 02:08:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:36.317 02:08:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:36.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:36.317 --rc genhtml_branch_coverage=1 00:25:36.317 --rc genhtml_function_coverage=1 00:25:36.317 --rc genhtml_legend=1 00:25:36.317 --rc geninfo_all_blocks=1 00:25:36.317 --rc geninfo_unexecuted_blocks=1 00:25:36.317 00:25:36.317 ' 00:25:36.317 02:08:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:36.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:36.317 --rc genhtml_branch_coverage=1 00:25:36.317 --rc genhtml_function_coverage=1 00:25:36.317 --rc genhtml_legend=1 00:25:36.317 --rc geninfo_all_blocks=1 00:25:36.317 --rc geninfo_unexecuted_blocks=1 00:25:36.317 00:25:36.317 ' 00:25:36.317 02:08:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:36.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:36.317 --rc genhtml_branch_coverage=1 00:25:36.317 --rc genhtml_function_coverage=1 00:25:36.317 --rc genhtml_legend=1 00:25:36.317 --rc geninfo_all_blocks=1 00:25:36.317 --rc geninfo_unexecuted_blocks=1 00:25:36.317 00:25:36.317 ' 00:25:36.317 02:08:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:36.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:36.317 --rc genhtml_branch_coverage=1 00:25:36.317 --rc genhtml_function_coverage=1 00:25:36.317 --rc genhtml_legend=1 00:25:36.317 --rc geninfo_all_blocks=1 00:25:36.317 --rc geninfo_unexecuted_blocks=1 00:25:36.317 00:25:36.317 ' 00:25:36.317 02:08:10 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:36.317 02:08:10 -- nvmf/common.sh@7 -- # uname -s 00:25:36.317 02:08:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:36.317 02:08:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:36.317 02:08:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:36.317 02:08:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:36.317 02:08:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:36.317 02:08:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:36.317 02:08:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:36.317 02:08:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:36.317 02:08:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:36.317 02:08:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:36.317 02:08:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:36.317 02:08:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:36.317 02:08:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:36.317 02:08:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:36.318 02:08:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:36.318 02:08:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:36.318 02:08:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:36.318 02:08:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:36.318 02:08:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:36.318 02:08:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:36.318 02:08:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:36.318 02:08:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:36.318 02:08:10 -- paths/export.sh@5 -- # export PATH 00:25:36.318 02:08:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:36.318 02:08:10 -- nvmf/common.sh@46 -- # : 0 00:25:36.318 02:08:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:36.318 02:08:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:36.318 02:08:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:36.318 02:08:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:36.318 02:08:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:36.318 02:08:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:36.318 02:08:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:36.318 02:08:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:36.318 02:08:10 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:25:36.318 02:08:10 -- host/dma.sh@13 -- # exit 0 00:25:36.318 00:25:36.318 real 0m0.151s 00:25:36.318 user 0m0.096s 00:25:36.318 sys 0m0.064s 00:25:36.318 02:08:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:36.318 02:08:10 -- common/autotest_common.sh@10 -- # set +x 00:25:36.318 ************************************ 00:25:36.318 END TEST dma 00:25:36.318 ************************************ 00:25:36.318 02:08:10 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:36.318 02:08:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:36.318 02:08:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:36.318 02:08:10 -- common/autotest_common.sh@10 -- # set +x 00:25:36.318 ************************************ 00:25:36.318 START TEST nvmf_identify 00:25:36.318 ************************************ 00:25:36.318 02:08:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:36.318 * Looking for test storage... 00:25:36.318 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:36.318 02:08:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:36.318 02:08:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:36.318 02:08:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:36.318 02:08:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:36.318 02:08:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:36.318 02:08:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:36.318 02:08:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:36.318 02:08:10 -- scripts/common.sh@335 -- # IFS=.-: 00:25:36.318 02:08:10 -- scripts/common.sh@335 -- # read -ra ver1 00:25:36.318 02:08:10 -- scripts/common.sh@336 -- # IFS=.-: 00:25:36.318 02:08:10 -- scripts/common.sh@336 -- # read -ra ver2 00:25:36.318 02:08:10 -- scripts/common.sh@337 -- # local 'op=<' 00:25:36.318 02:08:10 -- scripts/common.sh@339 -- # ver1_l=2 00:25:36.318 02:08:10 -- scripts/common.sh@340 -- # ver2_l=1 00:25:36.318 02:08:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:36.318 02:08:10 -- scripts/common.sh@343 -- # case "$op" in 00:25:36.318 02:08:10 -- scripts/common.sh@344 -- # : 1 00:25:36.318 02:08:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:36.318 02:08:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:36.318 02:08:10 -- scripts/common.sh@364 -- # decimal 1 00:25:36.318 02:08:10 -- scripts/common.sh@352 -- # local d=1 00:25:36.318 02:08:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:36.318 02:08:10 -- scripts/common.sh@354 -- # echo 1 00:25:36.318 02:08:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:36.318 02:08:10 -- scripts/common.sh@365 -- # decimal 2 00:25:36.318 02:08:10 -- scripts/common.sh@352 -- # local d=2 00:25:36.318 02:08:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:36.318 02:08:10 -- scripts/common.sh@354 -- # echo 2 00:25:36.318 02:08:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:36.318 02:08:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:36.318 02:08:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:36.318 02:08:10 -- scripts/common.sh@367 -- # return 0 00:25:36.318 02:08:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:36.318 02:08:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:36.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:36.318 --rc genhtml_branch_coverage=1 00:25:36.318 --rc genhtml_function_coverage=1 00:25:36.318 --rc genhtml_legend=1 00:25:36.318 --rc geninfo_all_blocks=1 00:25:36.318 --rc geninfo_unexecuted_blocks=1 00:25:36.318 00:25:36.318 ' 00:25:36.318 02:08:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:36.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:36.318 --rc genhtml_branch_coverage=1 00:25:36.318 --rc genhtml_function_coverage=1 00:25:36.318 --rc genhtml_legend=1 00:25:36.318 --rc geninfo_all_blocks=1 00:25:36.318 --rc geninfo_unexecuted_blocks=1 00:25:36.318 00:25:36.318 ' 00:25:36.318 02:08:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:36.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:36.318 --rc genhtml_branch_coverage=1 00:25:36.318 --rc genhtml_function_coverage=1 00:25:36.318 --rc genhtml_legend=1 00:25:36.318 --rc geninfo_all_blocks=1 00:25:36.318 --rc geninfo_unexecuted_blocks=1 00:25:36.318 00:25:36.318 ' 00:25:36.318 02:08:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:36.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:36.318 --rc genhtml_branch_coverage=1 00:25:36.318 --rc genhtml_function_coverage=1 00:25:36.318 --rc genhtml_legend=1 00:25:36.318 --rc geninfo_all_blocks=1 00:25:36.318 --rc geninfo_unexecuted_blocks=1 00:25:36.318 00:25:36.318 ' 00:25:36.318 02:08:10 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:36.318 02:08:10 -- nvmf/common.sh@7 -- # uname -s 00:25:36.318 02:08:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:36.318 02:08:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:36.318 02:08:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:36.318 02:08:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:36.318 02:08:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:36.318 02:08:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:36.318 02:08:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:36.318 02:08:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:36.318 02:08:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:36.318 02:08:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:36.319 02:08:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:36.319 02:08:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:36.319 02:08:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:36.319 02:08:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:36.319 02:08:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:36.319 02:08:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:36.319 02:08:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:36.319 02:08:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:36.319 02:08:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:36.319 02:08:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:36.319 02:08:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:36.319 02:08:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:36.319 02:08:10 -- paths/export.sh@5 -- # export PATH 00:25:36.319 02:08:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:36.319 02:08:10 -- nvmf/common.sh@46 -- # : 0 00:25:36.319 02:08:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:36.319 02:08:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:36.319 02:08:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:36.319 02:08:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:36.319 02:08:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:36.319 02:08:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:36.319 02:08:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:36.319 02:08:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:36.319 02:08:10 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:36.319 02:08:10 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:36.319 02:08:10 -- host/identify.sh@14 -- # nvmftestinit 00:25:36.319 02:08:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:36.319 02:08:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:36.319 02:08:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:36.319 02:08:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:36.319 02:08:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:36.319 02:08:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:36.319 02:08:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:36.319 02:08:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:36.319 02:08:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:36.319 02:08:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:36.319 02:08:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:36.319 02:08:10 -- common/autotest_common.sh@10 -- # set +x 00:25:38.850 02:08:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:38.850 02:08:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:38.850 02:08:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:38.850 02:08:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:38.850 02:08:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:38.850 02:08:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:38.850 02:08:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:38.850 02:08:12 -- nvmf/common.sh@294 -- # net_devs=() 00:25:38.850 02:08:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:38.850 02:08:12 -- nvmf/common.sh@295 -- # e810=() 00:25:38.850 02:08:12 -- nvmf/common.sh@295 -- # local -ga e810 00:25:38.850 02:08:12 -- nvmf/common.sh@296 -- # x722=() 00:25:38.850 02:08:12 -- nvmf/common.sh@296 -- # local -ga x722 00:25:38.850 02:08:12 -- nvmf/common.sh@297 -- # mlx=() 00:25:38.850 02:08:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:38.850 02:08:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:38.850 02:08:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:38.850 02:08:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:38.850 02:08:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:38.850 02:08:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:38.850 02:08:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:38.850 02:08:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:38.850 02:08:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:38.850 02:08:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:38.850 02:08:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:38.850 02:08:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:38.850 02:08:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:38.851 02:08:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:38.851 02:08:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:38.851 02:08:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:38.851 02:08:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:38.851 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:38.851 02:08:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:38.851 02:08:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:38.851 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:38.851 02:08:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:38.851 02:08:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:38.851 02:08:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:38.851 02:08:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:38.851 02:08:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:38.851 02:08:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:38.851 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:38.851 02:08:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:38.851 02:08:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:38.851 02:08:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:38.851 02:08:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:38.851 02:08:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:38.851 02:08:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:38.851 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:38.851 02:08:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:38.851 02:08:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:38.851 02:08:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:38.851 02:08:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:38.851 02:08:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:38.851 02:08:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:38.851 02:08:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:38.851 02:08:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:38.851 02:08:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:38.851 02:08:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:38.851 02:08:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:38.851 02:08:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:38.851 02:08:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:38.851 02:08:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:38.851 02:08:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:38.851 02:08:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:38.851 02:08:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:38.851 02:08:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:38.851 02:08:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:38.851 02:08:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:38.851 02:08:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:38.851 02:08:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:38.851 02:08:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:38.851 02:08:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:38.851 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:38.851 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.337 ms 00:25:38.851 00:25:38.851 --- 10.0.0.2 ping statistics --- 00:25:38.851 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:38.851 rtt min/avg/max/mdev = 0.337/0.337/0.337/0.000 ms 00:25:38.851 02:08:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:38.851 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:38.851 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:25:38.851 00:25:38.851 --- 10.0.0.1 ping statistics --- 00:25:38.851 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:38.851 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:25:38.851 02:08:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:38.851 02:08:12 -- nvmf/common.sh@410 -- # return 0 00:25:38.851 02:08:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:38.851 02:08:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:38.851 02:08:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:38.851 02:08:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:38.851 02:08:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:38.851 02:08:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:38.851 02:08:12 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:25:38.851 02:08:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:38.851 02:08:12 -- common/autotest_common.sh@10 -- # set +x 00:25:38.851 02:08:12 -- host/identify.sh@19 -- # nvmfpid=1290863 00:25:38.851 02:08:12 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:38.851 02:08:12 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:38.851 02:08:12 -- host/identify.sh@23 -- # waitforlisten 1290863 00:25:38.851 02:08:12 -- common/autotest_common.sh@829 -- # '[' -z 1290863 ']' 00:25:38.851 02:08:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:38.851 02:08:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:38.851 02:08:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:38.851 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:38.851 02:08:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:38.851 02:08:12 -- common/autotest_common.sh@10 -- # set +x 00:25:38.851 [2024-11-18 02:08:13.030124] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:38.851 [2024-11-18 02:08:13.030205] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:38.851 EAL: No free 2048 kB hugepages reported on node 1 00:25:38.851 [2024-11-18 02:08:13.093473] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:38.851 [2024-11-18 02:08:13.178646] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:38.851 [2024-11-18 02:08:13.178788] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:38.851 [2024-11-18 02:08:13.178806] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:38.851 [2024-11-18 02:08:13.178818] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:38.851 [2024-11-18 02:08:13.179041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:38.851 [2024-11-18 02:08:13.179104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:38.851 [2024-11-18 02:08:13.179155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:38.851 [2024-11-18 02:08:13.179158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:39.787 02:08:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:39.787 02:08:13 -- common/autotest_common.sh@862 -- # return 0 00:25:39.787 02:08:13 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:39.787 02:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.787 02:08:13 -- common/autotest_common.sh@10 -- # set +x 00:25:39.787 [2024-11-18 02:08:13.996918] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:39.787 02:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.787 02:08:14 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:25:39.787 02:08:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:39.787 02:08:14 -- common/autotest_common.sh@10 -- # set +x 00:25:39.787 02:08:14 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:39.787 02:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.787 02:08:14 -- common/autotest_common.sh@10 -- # set +x 00:25:39.787 Malloc0 00:25:39.787 02:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.787 02:08:14 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:39.787 02:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.787 02:08:14 -- common/autotest_common.sh@10 -- # set +x 00:25:39.787 02:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.787 02:08:14 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:25:39.787 02:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.787 02:08:14 -- common/autotest_common.sh@10 -- # set +x 00:25:39.787 02:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.787 02:08:14 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:39.787 02:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.787 02:08:14 -- common/autotest_common.sh@10 -- # set +x 00:25:39.787 [2024-11-18 02:08:14.078669] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:39.787 02:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.787 02:08:14 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:39.787 02:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.787 02:08:14 -- common/autotest_common.sh@10 -- # set +x 00:25:39.787 02:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.787 02:08:14 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:25:39.787 02:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.787 02:08:14 -- common/autotest_common.sh@10 -- # set +x 00:25:39.787 [2024-11-18 02:08:14.094407] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:39.787 [ 00:25:39.787 { 00:25:39.787 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:39.787 "subtype": "Discovery", 00:25:39.787 "listen_addresses": [ 00:25:39.787 { 00:25:39.787 "transport": "TCP", 00:25:39.787 "trtype": "TCP", 00:25:39.787 "adrfam": "IPv4", 00:25:39.787 "traddr": "10.0.0.2", 00:25:39.787 "trsvcid": "4420" 00:25:39.787 } 00:25:39.787 ], 00:25:39.787 "allow_any_host": true, 00:25:39.787 "hosts": [] 00:25:39.787 }, 00:25:39.787 { 00:25:39.787 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:39.787 "subtype": "NVMe", 00:25:39.787 "listen_addresses": [ 00:25:39.787 { 00:25:39.787 "transport": "TCP", 00:25:39.787 "trtype": "TCP", 00:25:39.787 "adrfam": "IPv4", 00:25:39.787 "traddr": "10.0.0.2", 00:25:39.787 "trsvcid": "4420" 00:25:39.787 } 00:25:39.787 ], 00:25:39.787 "allow_any_host": true, 00:25:39.787 "hosts": [], 00:25:39.787 "serial_number": "SPDK00000000000001", 00:25:39.787 "model_number": "SPDK bdev Controller", 00:25:39.787 "max_namespaces": 32, 00:25:39.787 "min_cntlid": 1, 00:25:39.787 "max_cntlid": 65519, 00:25:39.787 "namespaces": [ 00:25:39.787 { 00:25:39.787 "nsid": 1, 00:25:39.787 "bdev_name": "Malloc0", 00:25:39.787 "name": "Malloc0", 00:25:39.787 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:25:39.787 "eui64": "ABCDEF0123456789", 00:25:39.787 "uuid": "d6c14ddf-63cf-4079-936c-890f6b3cc45c" 00:25:39.787 } 00:25:39.787 ] 00:25:39.787 } 00:25:39.787 ] 00:25:39.787 02:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.787 02:08:14 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:25:39.787 [2024-11-18 02:08:14.118813] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:39.787 [2024-11-18 02:08:14.118855] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1291018 ] 00:25:39.787 EAL: No free 2048 kB hugepages reported on node 1 00:25:39.787 [2024-11-18 02:08:14.153744] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:25:39.787 [2024-11-18 02:08:14.153806] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:39.787 [2024-11-18 02:08:14.153816] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:39.787 [2024-11-18 02:08:14.153833] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:39.787 [2024-11-18 02:08:14.153847] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:39.787 [2024-11-18 02:08:14.154087] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:25:39.787 [2024-11-18 02:08:14.154154] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x5f02f0 0 00:25:39.787 [2024-11-18 02:08:14.160334] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:39.787 [2024-11-18 02:08:14.160356] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:39.787 [2024-11-18 02:08:14.160365] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:39.787 [2024-11-18 02:08:14.160372] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:39.787 [2024-11-18 02:08:14.160425] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.787 [2024-11-18 02:08:14.160438] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.787 [2024-11-18 02:08:14.160450] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5f02f0) 00:25:39.787 [2024-11-18 02:08:14.160469] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:39.787 [2024-11-18 02:08:14.160496] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x648ec0, cid 0, qid 0 00:25:39.787 [2024-11-18 02:08:14.168340] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.787 [2024-11-18 02:08:14.168358] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.787 [2024-11-18 02:08:14.168366] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.787 [2024-11-18 02:08:14.168374] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x648ec0) on tqpair=0x5f02f0 00:25:39.787 [2024-11-18 02:08:14.168391] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:39.787 [2024-11-18 02:08:14.168402] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:25:39.787 [2024-11-18 02:08:14.168412] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:25:39.787 [2024-11-18 02:08:14.168431] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.787 [2024-11-18 02:08:14.168441] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.787 [2024-11-18 02:08:14.168448] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5f02f0) 00:25:39.787 [2024-11-18 02:08:14.168459] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.787 [2024-11-18 02:08:14.168484] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x648ec0, cid 0, qid 0 00:25:39.787 [2024-11-18 02:08:14.168576] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.787 [2024-11-18 02:08:14.168589] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.787 [2024-11-18 02:08:14.168596] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.787 [2024-11-18 02:08:14.168604] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x648ec0) on tqpair=0x5f02f0 00:25:39.787 [2024-11-18 02:08:14.168613] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:25:39.788 [2024-11-18 02:08:14.168626] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:25:39.788 [2024-11-18 02:08:14.168640] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.168647] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.168654] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5f02f0) 00:25:39.788 [2024-11-18 02:08:14.168665] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.788 [2024-11-18 02:08:14.168686] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x648ec0, cid 0, qid 0 00:25:39.788 [2024-11-18 02:08:14.168764] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.788 [2024-11-18 02:08:14.168779] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.788 [2024-11-18 02:08:14.168786] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.168793] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x648ec0) on tqpair=0x5f02f0 00:25:39.788 [2024-11-18 02:08:14.168802] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:25:39.788 [2024-11-18 02:08:14.168816] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:25:39.788 [2024-11-18 02:08:14.168829] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.168837] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.168848] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5f02f0) 00:25:39.788 [2024-11-18 02:08:14.168860] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.788 [2024-11-18 02:08:14.168881] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x648ec0, cid 0, qid 0 00:25:39.788 [2024-11-18 02:08:14.168957] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.788 [2024-11-18 02:08:14.168971] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.788 [2024-11-18 02:08:14.168979] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.168985] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x648ec0) on tqpair=0x5f02f0 00:25:39.788 [2024-11-18 02:08:14.168994] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:39.788 [2024-11-18 02:08:14.169012] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169021] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169028] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5f02f0) 00:25:39.788 [2024-11-18 02:08:14.169039] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.788 [2024-11-18 02:08:14.169060] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x648ec0, cid 0, qid 0 00:25:39.788 [2024-11-18 02:08:14.169134] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.788 [2024-11-18 02:08:14.169146] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.788 [2024-11-18 02:08:14.169154] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169160] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x648ec0) on tqpair=0x5f02f0 00:25:39.788 [2024-11-18 02:08:14.169169] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:25:39.788 [2024-11-18 02:08:14.169178] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:25:39.788 [2024-11-18 02:08:14.169191] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:39.788 [2024-11-18 02:08:14.169302] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:25:39.788 [2024-11-18 02:08:14.169317] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:39.788 [2024-11-18 02:08:14.169333] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169341] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169348] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5f02f0) 00:25:39.788 [2024-11-18 02:08:14.169359] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.788 [2024-11-18 02:08:14.169380] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x648ec0, cid 0, qid 0 00:25:39.788 [2024-11-18 02:08:14.169465] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.788 [2024-11-18 02:08:14.169480] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.788 [2024-11-18 02:08:14.169487] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169494] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x648ec0) on tqpair=0x5f02f0 00:25:39.788 [2024-11-18 02:08:14.169503] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:39.788 [2024-11-18 02:08:14.169520] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169534] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169541] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5f02f0) 00:25:39.788 [2024-11-18 02:08:14.169552] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.788 [2024-11-18 02:08:14.169573] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x648ec0, cid 0, qid 0 00:25:39.788 [2024-11-18 02:08:14.169651] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.788 [2024-11-18 02:08:14.169665] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.788 [2024-11-18 02:08:14.169673] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169680] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x648ec0) on tqpair=0x5f02f0 00:25:39.788 [2024-11-18 02:08:14.169688] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:39.788 [2024-11-18 02:08:14.169696] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:25:39.788 [2024-11-18 02:08:14.169710] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:25:39.788 [2024-11-18 02:08:14.169725] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:25:39.788 [2024-11-18 02:08:14.169740] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169748] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169755] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5f02f0) 00:25:39.788 [2024-11-18 02:08:14.169766] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.788 [2024-11-18 02:08:14.169787] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x648ec0, cid 0, qid 0 00:25:39.788 [2024-11-18 02:08:14.169910] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.788 [2024-11-18 02:08:14.169923] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.788 [2024-11-18 02:08:14.169930] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169937] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5f02f0): datao=0, datal=4096, cccid=0 00:25:39.788 [2024-11-18 02:08:14.169946] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x648ec0) on tqpair(0x5f02f0): expected_datao=0, payload_size=4096 00:25:39.788 [2024-11-18 02:08:14.169958] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169967] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.169979] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.788 [2024-11-18 02:08:14.169989] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.788 [2024-11-18 02:08:14.169995] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.170002] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x648ec0) on tqpair=0x5f02f0 00:25:39.788 [2024-11-18 02:08:14.170014] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:25:39.788 [2024-11-18 02:08:14.170023] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:25:39.788 [2024-11-18 02:08:14.170030] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:25:39.788 [2024-11-18 02:08:14.170040] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:25:39.788 [2024-11-18 02:08:14.170047] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:25:39.788 [2024-11-18 02:08:14.170060] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:25:39.788 [2024-11-18 02:08:14.170081] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:25:39.788 [2024-11-18 02:08:14.170095] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.170103] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.170110] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5f02f0) 00:25:39.788 [2024-11-18 02:08:14.170121] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:39.788 [2024-11-18 02:08:14.170143] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x648ec0, cid 0, qid 0 00:25:39.788 [2024-11-18 02:08:14.170248] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.788 [2024-11-18 02:08:14.170263] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.788 [2024-11-18 02:08:14.170270] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.170293] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x648ec0) on tqpair=0x5f02f0 00:25:39.788 [2024-11-18 02:08:14.170306] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.170321] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.170328] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5f02f0) 00:25:39.788 [2024-11-18 02:08:14.170339] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.788 [2024-11-18 02:08:14.170350] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.170357] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.788 [2024-11-18 02:08:14.170363] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x5f02f0) 00:25:39.789 [2024-11-18 02:08:14.170372] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.789 [2024-11-18 02:08:14.170382] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.789 [2024-11-18 02:08:14.170389] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.789 [2024-11-18 02:08:14.170395] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x5f02f0) 00:25:39.789 [2024-11-18 02:08:14.170404] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.789 [2024-11-18 02:08:14.170414] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.789 [2024-11-18 02:08:14.170421] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.789 [2024-11-18 02:08:14.170427] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:39.789 [2024-11-18 02:08:14.170437] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.789 [2024-11-18 02:08:14.170446] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:25:39.789 [2024-11-18 02:08:14.170466] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:39.789 [2024-11-18 02:08:14.170479] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.789 [2024-11-18 02:08:14.170487] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.789 [2024-11-18 02:08:14.170494] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5f02f0) 00:25:39.789 [2024-11-18 02:08:14.170504] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.789 [2024-11-18 02:08:14.170532] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x648ec0, cid 0, qid 0 00:25:39.789 [2024-11-18 02:08:14.170544] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x649020, cid 1, qid 0 00:25:39.789 [2024-11-18 02:08:14.170553] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x649180, cid 2, qid 0 00:25:39.789 [2024-11-18 02:08:14.170561] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:39.789 [2024-11-18 02:08:14.170569] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x649440, cid 4, qid 0 00:25:39.789 [2024-11-18 02:08:14.170709] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.789 [2024-11-18 02:08:14.170724] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.789 [2024-11-18 02:08:14.170731] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.789 [2024-11-18 02:08:14.170738] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x649440) on tqpair=0x5f02f0 00:25:39.789 [2024-11-18 02:08:14.170748] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:25:39.789 [2024-11-18 02:08:14.170757] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:25:39.789 [2024-11-18 02:08:14.170775] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.789 [2024-11-18 02:08:14.170785] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.789 [2024-11-18 02:08:14.170792] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5f02f0) 00:25:39.789 [2024-11-18 02:08:14.170802] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.789 [2024-11-18 02:08:14.170823] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x649440, cid 4, qid 0 00:25:39.789 [2024-11-18 02:08:14.170923] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.789 [2024-11-18 02:08:14.170938] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.789 [2024-11-18 02:08:14.170945] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.789 [2024-11-18 02:08:14.170952] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5f02f0): datao=0, datal=4096, cccid=4 00:25:39.789 [2024-11-18 02:08:14.170960] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x649440) on tqpair(0x5f02f0): expected_datao=0, payload_size=4096 00:25:39.789 [2024-11-18 02:08:14.170978] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.789 [2024-11-18 02:08:14.170988] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.212322] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.051 [2024-11-18 02:08:14.212344] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.051 [2024-11-18 02:08:14.212353] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.212361] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x649440) on tqpair=0x5f02f0 00:25:40.051 [2024-11-18 02:08:14.212382] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:25:40.051 [2024-11-18 02:08:14.212422] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.212434] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.212441] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5f02f0) 00:25:40.051 [2024-11-18 02:08:14.212453] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.051 [2024-11-18 02:08:14.212465] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.212472] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.212483] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x5f02f0) 00:25:40.051 [2024-11-18 02:08:14.212493] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:40.051 [2024-11-18 02:08:14.212523] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x649440, cid 4, qid 0 00:25:40.051 [2024-11-18 02:08:14.212536] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6495a0, cid 5, qid 0 00:25:40.051 [2024-11-18 02:08:14.212723] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:40.051 [2024-11-18 02:08:14.212737] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:40.051 [2024-11-18 02:08:14.212744] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.212750] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5f02f0): datao=0, datal=1024, cccid=4 00:25:40.051 [2024-11-18 02:08:14.212758] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x649440) on tqpair(0x5f02f0): expected_datao=0, payload_size=1024 00:25:40.051 [2024-11-18 02:08:14.212770] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.212777] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.212786] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.051 [2024-11-18 02:08:14.212796] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.051 [2024-11-18 02:08:14.212802] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.212809] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6495a0) on tqpair=0x5f02f0 00:25:40.051 [2024-11-18 02:08:14.254411] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.051 [2024-11-18 02:08:14.254431] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.051 [2024-11-18 02:08:14.254439] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.254446] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x649440) on tqpair=0x5f02f0 00:25:40.051 [2024-11-18 02:08:14.254464] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.254474] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.254481] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5f02f0) 00:25:40.051 [2024-11-18 02:08:14.254492] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.051 [2024-11-18 02:08:14.254523] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x649440, cid 4, qid 0 00:25:40.051 [2024-11-18 02:08:14.254639] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:40.051 [2024-11-18 02:08:14.254654] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:40.051 [2024-11-18 02:08:14.254661] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.254668] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5f02f0): datao=0, datal=3072, cccid=4 00:25:40.051 [2024-11-18 02:08:14.254676] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x649440) on tqpair(0x5f02f0): expected_datao=0, payload_size=3072 00:25:40.051 [2024-11-18 02:08:14.254688] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.254696] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.254708] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.051 [2024-11-18 02:08:14.254718] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.051 [2024-11-18 02:08:14.254725] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.254732] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x649440) on tqpair=0x5f02f0 00:25:40.051 [2024-11-18 02:08:14.254747] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.254756] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.254767] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5f02f0) 00:25:40.051 [2024-11-18 02:08:14.254779] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.051 [2024-11-18 02:08:14.254808] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x649440, cid 4, qid 0 00:25:40.051 [2024-11-18 02:08:14.254903] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:40.051 [2024-11-18 02:08:14.254915] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:40.051 [2024-11-18 02:08:14.254922] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.254929] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5f02f0): datao=0, datal=8, cccid=4 00:25:40.051 [2024-11-18 02:08:14.254937] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x649440) on tqpair(0x5f02f0): expected_datao=0, payload_size=8 00:25:40.051 [2024-11-18 02:08:14.254948] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.254955] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.299328] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.051 [2024-11-18 02:08:14.299348] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.051 [2024-11-18 02:08:14.299364] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.051 [2024-11-18 02:08:14.299371] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x649440) on tqpair=0x5f02f0 00:25:40.051 ===================================================== 00:25:40.051 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:25:40.051 ===================================================== 00:25:40.051 Controller Capabilities/Features 00:25:40.051 ================================ 00:25:40.051 Vendor ID: 0000 00:25:40.051 Subsystem Vendor ID: 0000 00:25:40.051 Serial Number: .................... 00:25:40.051 Model Number: ........................................ 00:25:40.051 Firmware Version: 24.01.1 00:25:40.051 Recommended Arb Burst: 0 00:25:40.051 IEEE OUI Identifier: 00 00 00 00:25:40.051 Multi-path I/O 00:25:40.051 May have multiple subsystem ports: No 00:25:40.051 May have multiple controllers: No 00:25:40.051 Associated with SR-IOV VF: No 00:25:40.051 Max Data Transfer Size: 131072 00:25:40.051 Max Number of Namespaces: 0 00:25:40.051 Max Number of I/O Queues: 1024 00:25:40.051 NVMe Specification Version (VS): 1.3 00:25:40.051 NVMe Specification Version (Identify): 1.3 00:25:40.051 Maximum Queue Entries: 128 00:25:40.051 Contiguous Queues Required: Yes 00:25:40.051 Arbitration Mechanisms Supported 00:25:40.051 Weighted Round Robin: Not Supported 00:25:40.051 Vendor Specific: Not Supported 00:25:40.051 Reset Timeout: 15000 ms 00:25:40.051 Doorbell Stride: 4 bytes 00:25:40.051 NVM Subsystem Reset: Not Supported 00:25:40.051 Command Sets Supported 00:25:40.051 NVM Command Set: Supported 00:25:40.051 Boot Partition: Not Supported 00:25:40.051 Memory Page Size Minimum: 4096 bytes 00:25:40.051 Memory Page Size Maximum: 4096 bytes 00:25:40.051 Persistent Memory Region: Not Supported 00:25:40.051 Optional Asynchronous Events Supported 00:25:40.051 Namespace Attribute Notices: Not Supported 00:25:40.051 Firmware Activation Notices: Not Supported 00:25:40.051 ANA Change Notices: Not Supported 00:25:40.051 PLE Aggregate Log Change Notices: Not Supported 00:25:40.051 LBA Status Info Alert Notices: Not Supported 00:25:40.051 EGE Aggregate Log Change Notices: Not Supported 00:25:40.051 Normal NVM Subsystem Shutdown event: Not Supported 00:25:40.051 Zone Descriptor Change Notices: Not Supported 00:25:40.051 Discovery Log Change Notices: Supported 00:25:40.051 Controller Attributes 00:25:40.052 128-bit Host Identifier: Not Supported 00:25:40.052 Non-Operational Permissive Mode: Not Supported 00:25:40.052 NVM Sets: Not Supported 00:25:40.052 Read Recovery Levels: Not Supported 00:25:40.052 Endurance Groups: Not Supported 00:25:40.052 Predictable Latency Mode: Not Supported 00:25:40.052 Traffic Based Keep ALive: Not Supported 00:25:40.052 Namespace Granularity: Not Supported 00:25:40.052 SQ Associations: Not Supported 00:25:40.052 UUID List: Not Supported 00:25:40.052 Multi-Domain Subsystem: Not Supported 00:25:40.052 Fixed Capacity Management: Not Supported 00:25:40.052 Variable Capacity Management: Not Supported 00:25:40.052 Delete Endurance Group: Not Supported 00:25:40.052 Delete NVM Set: Not Supported 00:25:40.052 Extended LBA Formats Supported: Not Supported 00:25:40.052 Flexible Data Placement Supported: Not Supported 00:25:40.052 00:25:40.052 Controller Memory Buffer Support 00:25:40.052 ================================ 00:25:40.052 Supported: No 00:25:40.052 00:25:40.052 Persistent Memory Region Support 00:25:40.052 ================================ 00:25:40.052 Supported: No 00:25:40.052 00:25:40.052 Admin Command Set Attributes 00:25:40.052 ============================ 00:25:40.052 Security Send/Receive: Not Supported 00:25:40.052 Format NVM: Not Supported 00:25:40.052 Firmware Activate/Download: Not Supported 00:25:40.052 Namespace Management: Not Supported 00:25:40.052 Device Self-Test: Not Supported 00:25:40.052 Directives: Not Supported 00:25:40.052 NVMe-MI: Not Supported 00:25:40.052 Virtualization Management: Not Supported 00:25:40.052 Doorbell Buffer Config: Not Supported 00:25:40.052 Get LBA Status Capability: Not Supported 00:25:40.052 Command & Feature Lockdown Capability: Not Supported 00:25:40.052 Abort Command Limit: 1 00:25:40.052 Async Event Request Limit: 4 00:25:40.052 Number of Firmware Slots: N/A 00:25:40.052 Firmware Slot 1 Read-Only: N/A 00:25:40.052 Firmware Activation Without Reset: N/A 00:25:40.052 Multiple Update Detection Support: N/A 00:25:40.052 Firmware Update Granularity: No Information Provided 00:25:40.052 Per-Namespace SMART Log: No 00:25:40.052 Asymmetric Namespace Access Log Page: Not Supported 00:25:40.052 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:25:40.052 Command Effects Log Page: Not Supported 00:25:40.052 Get Log Page Extended Data: Supported 00:25:40.052 Telemetry Log Pages: Not Supported 00:25:40.052 Persistent Event Log Pages: Not Supported 00:25:40.052 Supported Log Pages Log Page: May Support 00:25:40.052 Commands Supported & Effects Log Page: Not Supported 00:25:40.052 Feature Identifiers & Effects Log Page:May Support 00:25:40.052 NVMe-MI Commands & Effects Log Page: May Support 00:25:40.052 Data Area 4 for Telemetry Log: Not Supported 00:25:40.052 Error Log Page Entries Supported: 128 00:25:40.052 Keep Alive: Not Supported 00:25:40.052 00:25:40.052 NVM Command Set Attributes 00:25:40.052 ========================== 00:25:40.052 Submission Queue Entry Size 00:25:40.052 Max: 1 00:25:40.052 Min: 1 00:25:40.052 Completion Queue Entry Size 00:25:40.052 Max: 1 00:25:40.052 Min: 1 00:25:40.052 Number of Namespaces: 0 00:25:40.052 Compare Command: Not Supported 00:25:40.052 Write Uncorrectable Command: Not Supported 00:25:40.052 Dataset Management Command: Not Supported 00:25:40.052 Write Zeroes Command: Not Supported 00:25:40.052 Set Features Save Field: Not Supported 00:25:40.052 Reservations: Not Supported 00:25:40.052 Timestamp: Not Supported 00:25:40.052 Copy: Not Supported 00:25:40.052 Volatile Write Cache: Not Present 00:25:40.052 Atomic Write Unit (Normal): 1 00:25:40.052 Atomic Write Unit (PFail): 1 00:25:40.052 Atomic Compare & Write Unit: 1 00:25:40.052 Fused Compare & Write: Supported 00:25:40.052 Scatter-Gather List 00:25:40.052 SGL Command Set: Supported 00:25:40.052 SGL Keyed: Supported 00:25:40.052 SGL Bit Bucket Descriptor: Not Supported 00:25:40.052 SGL Metadata Pointer: Not Supported 00:25:40.052 Oversized SGL: Not Supported 00:25:40.052 SGL Metadata Address: Not Supported 00:25:40.052 SGL Offset: Supported 00:25:40.052 Transport SGL Data Block: Not Supported 00:25:40.052 Replay Protected Memory Block: Not Supported 00:25:40.052 00:25:40.052 Firmware Slot Information 00:25:40.052 ========================= 00:25:40.052 Active slot: 0 00:25:40.052 00:25:40.052 00:25:40.052 Error Log 00:25:40.052 ========= 00:25:40.052 00:25:40.052 Active Namespaces 00:25:40.052 ================= 00:25:40.052 Discovery Log Page 00:25:40.052 ================== 00:25:40.052 Generation Counter: 2 00:25:40.052 Number of Records: 2 00:25:40.052 Record Format: 0 00:25:40.052 00:25:40.052 Discovery Log Entry 0 00:25:40.052 ---------------------- 00:25:40.052 Transport Type: 3 (TCP) 00:25:40.052 Address Family: 1 (IPv4) 00:25:40.052 Subsystem Type: 3 (Current Discovery Subsystem) 00:25:40.052 Entry Flags: 00:25:40.052 Duplicate Returned Information: 1 00:25:40.052 Explicit Persistent Connection Support for Discovery: 1 00:25:40.052 Transport Requirements: 00:25:40.052 Secure Channel: Not Required 00:25:40.052 Port ID: 0 (0x0000) 00:25:40.052 Controller ID: 65535 (0xffff) 00:25:40.052 Admin Max SQ Size: 128 00:25:40.052 Transport Service Identifier: 4420 00:25:40.052 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:25:40.052 Transport Address: 10.0.0.2 00:25:40.052 Discovery Log Entry 1 00:25:40.052 ---------------------- 00:25:40.052 Transport Type: 3 (TCP) 00:25:40.052 Address Family: 1 (IPv4) 00:25:40.052 Subsystem Type: 2 (NVM Subsystem) 00:25:40.052 Entry Flags: 00:25:40.052 Duplicate Returned Information: 0 00:25:40.052 Explicit Persistent Connection Support for Discovery: 0 00:25:40.052 Transport Requirements: 00:25:40.052 Secure Channel: Not Required 00:25:40.052 Port ID: 0 (0x0000) 00:25:40.052 Controller ID: 65535 (0xffff) 00:25:40.052 Admin Max SQ Size: 128 00:25:40.052 Transport Service Identifier: 4420 00:25:40.052 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:25:40.052 Transport Address: 10.0.0.2 [2024-11-18 02:08:14.299492] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:25:40.052 [2024-11-18 02:08:14.299518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:40.052 [2024-11-18 02:08:14.299531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:40.052 [2024-11-18 02:08:14.299541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:40.052 [2024-11-18 02:08:14.299551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:40.052 [2024-11-18 02:08:14.299565] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.052 [2024-11-18 02:08:14.299573] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.052 [2024-11-18 02:08:14.299580] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.052 [2024-11-18 02:08:14.299592] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.052 [2024-11-18 02:08:14.299617] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.052 [2024-11-18 02:08:14.299725] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.052 [2024-11-18 02:08:14.299738] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.052 [2024-11-18 02:08:14.299745] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.052 [2024-11-18 02:08:14.299752] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.052 [2024-11-18 02:08:14.299765] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.052 [2024-11-18 02:08:14.299772] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.052 [2024-11-18 02:08:14.299779] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.052 [2024-11-18 02:08:14.299790] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.052 [2024-11-18 02:08:14.299817] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.052 [2024-11-18 02:08:14.299922] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.052 [2024-11-18 02:08:14.299934] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.052 [2024-11-18 02:08:14.299945] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.052 [2024-11-18 02:08:14.299953] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.052 [2024-11-18 02:08:14.299962] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:25:40.052 [2024-11-18 02:08:14.299970] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:25:40.052 [2024-11-18 02:08:14.299987] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.052 [2024-11-18 02:08:14.299996] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300003] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.053 [2024-11-18 02:08:14.300014] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.053 [2024-11-18 02:08:14.300036] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.053 [2024-11-18 02:08:14.300118] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.053 [2024-11-18 02:08:14.300132] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.053 [2024-11-18 02:08:14.300139] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300146] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.053 [2024-11-18 02:08:14.300163] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300172] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300179] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.053 [2024-11-18 02:08:14.300190] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.053 [2024-11-18 02:08:14.300211] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.053 [2024-11-18 02:08:14.300291] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.053 [2024-11-18 02:08:14.300306] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.053 [2024-11-18 02:08:14.300324] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300332] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.053 [2024-11-18 02:08:14.300349] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300359] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300366] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.053 [2024-11-18 02:08:14.300377] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.053 [2024-11-18 02:08:14.300398] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.053 [2024-11-18 02:08:14.300481] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.053 [2024-11-18 02:08:14.300496] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.053 [2024-11-18 02:08:14.300503] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300510] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.053 [2024-11-18 02:08:14.300527] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300536] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300543] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.053 [2024-11-18 02:08:14.300554] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.053 [2024-11-18 02:08:14.300575] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.053 [2024-11-18 02:08:14.300644] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.053 [2024-11-18 02:08:14.300658] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.053 [2024-11-18 02:08:14.300665] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300672] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.053 [2024-11-18 02:08:14.300688] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300698] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300705] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.053 [2024-11-18 02:08:14.300716] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.053 [2024-11-18 02:08:14.300736] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.053 [2024-11-18 02:08:14.300813] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.053 [2024-11-18 02:08:14.300825] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.053 [2024-11-18 02:08:14.300832] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300839] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.053 [2024-11-18 02:08:14.300855] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300865] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.300871] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.053 [2024-11-18 02:08:14.300882] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.053 [2024-11-18 02:08:14.300902] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.053 [2024-11-18 02:08:14.300979] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.053 [2024-11-18 02:08:14.300991] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.053 [2024-11-18 02:08:14.300999] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301006] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.053 [2024-11-18 02:08:14.301022] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301032] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301038] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.053 [2024-11-18 02:08:14.301049] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.053 [2024-11-18 02:08:14.301069] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.053 [2024-11-18 02:08:14.301145] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.053 [2024-11-18 02:08:14.301159] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.053 [2024-11-18 02:08:14.301166] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301173] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.053 [2024-11-18 02:08:14.301190] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301200] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301206] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.053 [2024-11-18 02:08:14.301217] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.053 [2024-11-18 02:08:14.301237] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.053 [2024-11-18 02:08:14.301322] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.053 [2024-11-18 02:08:14.301336] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.053 [2024-11-18 02:08:14.301344] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301351] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.053 [2024-11-18 02:08:14.301366] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301375] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301382] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.053 [2024-11-18 02:08:14.301393] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.053 [2024-11-18 02:08:14.301414] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.053 [2024-11-18 02:08:14.301493] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.053 [2024-11-18 02:08:14.301507] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.053 [2024-11-18 02:08:14.301514] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301521] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.053 [2024-11-18 02:08:14.301537] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301546] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301553] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.053 [2024-11-18 02:08:14.301564] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.053 [2024-11-18 02:08:14.301584] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.053 [2024-11-18 02:08:14.301664] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.053 [2024-11-18 02:08:14.301679] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.053 [2024-11-18 02:08:14.301686] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301693] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.053 [2024-11-18 02:08:14.301709] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301719] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301726] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.053 [2024-11-18 02:08:14.301737] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.053 [2024-11-18 02:08:14.301757] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.053 [2024-11-18 02:08:14.301828] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.053 [2024-11-18 02:08:14.301841] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.053 [2024-11-18 02:08:14.301848] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301855] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.053 [2024-11-18 02:08:14.301871] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301881] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.301888] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.053 [2024-11-18 02:08:14.301898] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.053 [2024-11-18 02:08:14.301919] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.053 [2024-11-18 02:08:14.301995] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.053 [2024-11-18 02:08:14.302007] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.053 [2024-11-18 02:08:14.302018] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.053 [2024-11-18 02:08:14.302026] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.054 [2024-11-18 02:08:14.302042] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302052] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302059] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.054 [2024-11-18 02:08:14.302069] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.054 [2024-11-18 02:08:14.302090] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.054 [2024-11-18 02:08:14.302170] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.054 [2024-11-18 02:08:14.302185] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.054 [2024-11-18 02:08:14.302192] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302199] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.054 [2024-11-18 02:08:14.302215] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302224] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302231] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.054 [2024-11-18 02:08:14.302242] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.054 [2024-11-18 02:08:14.302262] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.054 [2024-11-18 02:08:14.302343] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.054 [2024-11-18 02:08:14.302357] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.054 [2024-11-18 02:08:14.302364] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302371] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.054 [2024-11-18 02:08:14.302388] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302397] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302404] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.054 [2024-11-18 02:08:14.302414] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.054 [2024-11-18 02:08:14.302445] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.054 [2024-11-18 02:08:14.302520] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.054 [2024-11-18 02:08:14.302534] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.054 [2024-11-18 02:08:14.302542] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302549] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.054 [2024-11-18 02:08:14.302566] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302575] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302582] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.054 [2024-11-18 02:08:14.302592] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.054 [2024-11-18 02:08:14.302613] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.054 [2024-11-18 02:08:14.302692] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.054 [2024-11-18 02:08:14.302706] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.054 [2024-11-18 02:08:14.302713] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302724] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.054 [2024-11-18 02:08:14.302742] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302751] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302758] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.054 [2024-11-18 02:08:14.302769] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.054 [2024-11-18 02:08:14.302789] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.054 [2024-11-18 02:08:14.302860] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.054 [2024-11-18 02:08:14.302872] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.054 [2024-11-18 02:08:14.302879] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302886] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.054 [2024-11-18 02:08:14.302902] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302912] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.302918] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.054 [2024-11-18 02:08:14.302929] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.054 [2024-11-18 02:08:14.302950] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.054 [2024-11-18 02:08:14.303026] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.054 [2024-11-18 02:08:14.303039] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.054 [2024-11-18 02:08:14.303045] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.303052] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.054 [2024-11-18 02:08:14.303069] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.303078] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.303085] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.054 [2024-11-18 02:08:14.303095] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.054 [2024-11-18 02:08:14.303116] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.054 [2024-11-18 02:08:14.303195] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.054 [2024-11-18 02:08:14.303208] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.054 [2024-11-18 02:08:14.303215] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.303221] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.054 [2024-11-18 02:08:14.303238] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.303247] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.303254] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.054 [2024-11-18 02:08:14.303264] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.054 [2024-11-18 02:08:14.303285] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.054 [2024-11-18 02:08:14.307326] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.054 [2024-11-18 02:08:14.307342] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.054 [2024-11-18 02:08:14.307349] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.307356] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.054 [2024-11-18 02:08:14.307399] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.307411] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.307418] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5f02f0) 00:25:40.054 [2024-11-18 02:08:14.307429] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.054 [2024-11-18 02:08:14.307461] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6492e0, cid 3, qid 0 00:25:40.054 [2024-11-18 02:08:14.307550] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.054 [2024-11-18 02:08:14.307563] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.054 [2024-11-18 02:08:14.307570] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.307577] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6492e0) on tqpair=0x5f02f0 00:25:40.054 [2024-11-18 02:08:14.307590] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 7 milliseconds 00:25:40.054 00:25:40.054 02:08:14 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:25:40.054 [2024-11-18 02:08:14.339983] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:40.054 [2024-11-18 02:08:14.340025] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1291026 ] 00:25:40.054 EAL: No free 2048 kB hugepages reported on node 1 00:25:40.054 [2024-11-18 02:08:14.373042] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:25:40.054 [2024-11-18 02:08:14.373093] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:40.054 [2024-11-18 02:08:14.373103] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:40.054 [2024-11-18 02:08:14.373119] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:40.054 [2024-11-18 02:08:14.373131] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:40.054 [2024-11-18 02:08:14.376358] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:25:40.054 [2024-11-18 02:08:14.376401] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x22372f0 0 00:25:40.054 [2024-11-18 02:08:14.384335] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:40.054 [2024-11-18 02:08:14.384355] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:40.054 [2024-11-18 02:08:14.384363] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:40.054 [2024-11-18 02:08:14.384370] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:40.054 [2024-11-18 02:08:14.384421] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.384434] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.054 [2024-11-18 02:08:14.384441] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22372f0) 00:25:40.054 [2024-11-18 02:08:14.384455] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:40.054 [2024-11-18 02:08:14.384482] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x228fec0, cid 0, qid 0 00:25:40.055 [2024-11-18 02:08:14.391335] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.055 [2024-11-18 02:08:14.391358] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.055 [2024-11-18 02:08:14.391366] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.391373] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x228fec0) on tqpair=0x22372f0 00:25:40.055 [2024-11-18 02:08:14.391408] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:40.055 [2024-11-18 02:08:14.391419] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:25:40.055 [2024-11-18 02:08:14.391429] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:25:40.055 [2024-11-18 02:08:14.391446] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.391455] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.391461] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22372f0) 00:25:40.055 [2024-11-18 02:08:14.391473] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.055 [2024-11-18 02:08:14.391497] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x228fec0, cid 0, qid 0 00:25:40.055 [2024-11-18 02:08:14.391632] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.055 [2024-11-18 02:08:14.391645] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.055 [2024-11-18 02:08:14.391652] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.391659] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x228fec0) on tqpair=0x22372f0 00:25:40.055 [2024-11-18 02:08:14.391669] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:25:40.055 [2024-11-18 02:08:14.391682] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:25:40.055 [2024-11-18 02:08:14.391694] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.391701] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.391708] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22372f0) 00:25:40.055 [2024-11-18 02:08:14.391719] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.055 [2024-11-18 02:08:14.391740] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x228fec0, cid 0, qid 0 00:25:40.055 [2024-11-18 02:08:14.391866] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.055 [2024-11-18 02:08:14.391878] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.055 [2024-11-18 02:08:14.391885] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.391892] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x228fec0) on tqpair=0x22372f0 00:25:40.055 [2024-11-18 02:08:14.391902] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:25:40.055 [2024-11-18 02:08:14.391916] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:25:40.055 [2024-11-18 02:08:14.391928] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.391936] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.391942] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22372f0) 00:25:40.055 [2024-11-18 02:08:14.391953] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.055 [2024-11-18 02:08:14.391973] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x228fec0, cid 0, qid 0 00:25:40.055 [2024-11-18 02:08:14.392054] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.055 [2024-11-18 02:08:14.392068] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.055 [2024-11-18 02:08:14.392079] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.392086] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x228fec0) on tqpair=0x22372f0 00:25:40.055 [2024-11-18 02:08:14.392097] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:40.055 [2024-11-18 02:08:14.392113] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.392123] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.392130] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22372f0) 00:25:40.055 [2024-11-18 02:08:14.392140] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.055 [2024-11-18 02:08:14.392162] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x228fec0, cid 0, qid 0 00:25:40.055 [2024-11-18 02:08:14.392256] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.055 [2024-11-18 02:08:14.392270] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.055 [2024-11-18 02:08:14.392277] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.392284] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x228fec0) on tqpair=0x22372f0 00:25:40.055 [2024-11-18 02:08:14.392293] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:25:40.055 [2024-11-18 02:08:14.392302] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:25:40.055 [2024-11-18 02:08:14.392322] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:40.055 [2024-11-18 02:08:14.392434] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:25:40.055 [2024-11-18 02:08:14.392441] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:40.055 [2024-11-18 02:08:14.392453] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.392461] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.392468] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22372f0) 00:25:40.055 [2024-11-18 02:08:14.392479] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.055 [2024-11-18 02:08:14.392500] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x228fec0, cid 0, qid 0 00:25:40.055 [2024-11-18 02:08:14.392629] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.055 [2024-11-18 02:08:14.392643] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.055 [2024-11-18 02:08:14.392650] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.392656] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x228fec0) on tqpair=0x22372f0 00:25:40.055 [2024-11-18 02:08:14.392666] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:40.055 [2024-11-18 02:08:14.392683] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.392692] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.392698] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22372f0) 00:25:40.055 [2024-11-18 02:08:14.392709] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.055 [2024-11-18 02:08:14.392730] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x228fec0, cid 0, qid 0 00:25:40.055 [2024-11-18 02:08:14.392831] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.055 [2024-11-18 02:08:14.392848] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.055 [2024-11-18 02:08:14.392856] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.392863] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x228fec0) on tqpair=0x22372f0 00:25:40.055 [2024-11-18 02:08:14.392872] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:40.055 [2024-11-18 02:08:14.392881] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:25:40.055 [2024-11-18 02:08:14.392894] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:25:40.055 [2024-11-18 02:08:14.392912] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:25:40.055 [2024-11-18 02:08:14.392926] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.392933] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.055 [2024-11-18 02:08:14.392940] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22372f0) 00:25:40.055 [2024-11-18 02:08:14.392951] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.055 [2024-11-18 02:08:14.392972] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x228fec0, cid 0, qid 0 00:25:40.055 [2024-11-18 02:08:14.393082] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:40.055 [2024-11-18 02:08:14.393096] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:40.056 [2024-11-18 02:08:14.393103] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393110] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22372f0): datao=0, datal=4096, cccid=0 00:25:40.056 [2024-11-18 02:08:14.393118] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x228fec0) on tqpair(0x22372f0): expected_datao=0, payload_size=4096 00:25:40.056 [2024-11-18 02:08:14.393136] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393146] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393161] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.056 [2024-11-18 02:08:14.393172] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.056 [2024-11-18 02:08:14.393179] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393186] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x228fec0) on tqpair=0x22372f0 00:25:40.056 [2024-11-18 02:08:14.393198] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:25:40.056 [2024-11-18 02:08:14.393207] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:25:40.056 [2024-11-18 02:08:14.393214] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:25:40.056 [2024-11-18 02:08:14.393221] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:25:40.056 [2024-11-18 02:08:14.393229] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:25:40.056 [2024-11-18 02:08:14.393237] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:25:40.056 [2024-11-18 02:08:14.393255] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:25:40.056 [2024-11-18 02:08:14.393269] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393277] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393283] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22372f0) 00:25:40.056 [2024-11-18 02:08:14.393298] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:40.056 [2024-11-18 02:08:14.393329] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x228fec0, cid 0, qid 0 00:25:40.056 [2024-11-18 02:08:14.393408] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.056 [2024-11-18 02:08:14.393422] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.056 [2024-11-18 02:08:14.393429] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393436] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x228fec0) on tqpair=0x22372f0 00:25:40.056 [2024-11-18 02:08:14.393448] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393455] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393462] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22372f0) 00:25:40.056 [2024-11-18 02:08:14.393472] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:40.056 [2024-11-18 02:08:14.393482] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393489] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393496] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x22372f0) 00:25:40.056 [2024-11-18 02:08:14.393505] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:40.056 [2024-11-18 02:08:14.393515] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393522] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393528] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x22372f0) 00:25:40.056 [2024-11-18 02:08:14.393537] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:40.056 [2024-11-18 02:08:14.393547] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393554] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393560] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22372f0) 00:25:40.056 [2024-11-18 02:08:14.393569] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:40.056 [2024-11-18 02:08:14.393578] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:25:40.056 [2024-11-18 02:08:14.393597] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:40.056 [2024-11-18 02:08:14.393610] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393617] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393623] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x22372f0) 00:25:40.056 [2024-11-18 02:08:14.393634] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.056 [2024-11-18 02:08:14.393656] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x228fec0, cid 0, qid 0 00:25:40.056 [2024-11-18 02:08:14.393682] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2290020, cid 1, qid 0 00:25:40.056 [2024-11-18 02:08:14.393690] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2290180, cid 2, qid 0 00:25:40.056 [2024-11-18 02:08:14.393698] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22902e0, cid 3, qid 0 00:25:40.056 [2024-11-18 02:08:14.393706] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2290440, cid 4, qid 0 00:25:40.056 [2024-11-18 02:08:14.393937] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.056 [2024-11-18 02:08:14.393952] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.056 [2024-11-18 02:08:14.393959] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.393966] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2290440) on tqpair=0x22372f0 00:25:40.056 [2024-11-18 02:08:14.393975] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:25:40.056 [2024-11-18 02:08:14.393984] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:25:40.056 [2024-11-18 02:08:14.393998] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:25:40.056 [2024-11-18 02:08:14.394013] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:25:40.056 [2024-11-18 02:08:14.394026] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.394033] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.394039] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x22372f0) 00:25:40.056 [2024-11-18 02:08:14.394050] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:40.056 [2024-11-18 02:08:14.394071] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2290440, cid 4, qid 0 00:25:40.056 [2024-11-18 02:08:14.394196] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.056 [2024-11-18 02:08:14.394208] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.056 [2024-11-18 02:08:14.394215] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.394222] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2290440) on tqpair=0x22372f0 00:25:40.056 [2024-11-18 02:08:14.394287] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:25:40.056 [2024-11-18 02:08:14.394305] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:25:40.056 [2024-11-18 02:08:14.394327] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.394335] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.394342] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x22372f0) 00:25:40.056 [2024-11-18 02:08:14.394352] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.056 [2024-11-18 02:08:14.394374] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2290440, cid 4, qid 0 00:25:40.056 [2024-11-18 02:08:14.394473] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:40.056 [2024-11-18 02:08:14.394488] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:40.056 [2024-11-18 02:08:14.394495] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.394502] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22372f0): datao=0, datal=4096, cccid=4 00:25:40.056 [2024-11-18 02:08:14.394510] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2290440) on tqpair(0x22372f0): expected_datao=0, payload_size=4096 00:25:40.056 [2024-11-18 02:08:14.394528] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.394537] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.436328] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.056 [2024-11-18 02:08:14.436357] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.056 [2024-11-18 02:08:14.436365] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.436377] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2290440) on tqpair=0x22372f0 00:25:40.056 [2024-11-18 02:08:14.436399] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:25:40.056 [2024-11-18 02:08:14.436415] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:25:40.056 [2024-11-18 02:08:14.436434] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:25:40.056 [2024-11-18 02:08:14.436448] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.436456] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.056 [2024-11-18 02:08:14.436463] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x22372f0) 00:25:40.056 [2024-11-18 02:08:14.436475] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.056 [2024-11-18 02:08:14.436499] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2290440, cid 4, qid 0 00:25:40.056 [2024-11-18 02:08:14.436637] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:40.056 [2024-11-18 02:08:14.436652] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:40.056 [2024-11-18 02:08:14.436659] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:40.057 [2024-11-18 02:08:14.436666] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22372f0): datao=0, datal=4096, cccid=4 00:25:40.057 [2024-11-18 02:08:14.436674] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2290440) on tqpair(0x22372f0): expected_datao=0, payload_size=4096 00:25:40.057 [2024-11-18 02:08:14.436685] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:40.057 [2024-11-18 02:08:14.436693] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:40.057 [2024-11-18 02:08:14.436727] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.057 [2024-11-18 02:08:14.436739] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.057 [2024-11-18 02:08:14.436746] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.057 [2024-11-18 02:08:14.436753] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2290440) on tqpair=0x22372f0 00:25:40.057 [2024-11-18 02:08:14.436777] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:25:40.057 [2024-11-18 02:08:14.436796] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:25:40.057 [2024-11-18 02:08:14.436810] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.057 [2024-11-18 02:08:14.436817] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.057 [2024-11-18 02:08:14.436824] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x22372f0) 00:25:40.057 [2024-11-18 02:08:14.436835] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.057 [2024-11-18 02:08:14.436857] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2290440, cid 4, qid 0 00:25:40.057 [2024-11-18 02:08:14.436960] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:40.057 [2024-11-18 02:08:14.436974] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:40.057 [2024-11-18 02:08:14.436981] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:40.057 [2024-11-18 02:08:14.436988] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22372f0): datao=0, datal=4096, cccid=4 00:25:40.057 [2024-11-18 02:08:14.436996] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2290440) on tqpair(0x22372f0): expected_datao=0, payload_size=4096 00:25:40.057 [2024-11-18 02:08:14.437013] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:40.057 [2024-11-18 02:08:14.437023] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:40.317 [2024-11-18 02:08:14.477450] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.317 [2024-11-18 02:08:14.477472] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.317 [2024-11-18 02:08:14.477481] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.317 [2024-11-18 02:08:14.477488] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2290440) on tqpair=0x22372f0 00:25:40.317 [2024-11-18 02:08:14.477503] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:25:40.317 [2024-11-18 02:08:14.477519] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:25:40.317 [2024-11-18 02:08:14.477536] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:25:40.317 [2024-11-18 02:08:14.477547] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:25:40.317 [2024-11-18 02:08:14.477567] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:25:40.317 [2024-11-18 02:08:14.477575] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:25:40.317 [2024-11-18 02:08:14.477583] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:25:40.317 [2024-11-18 02:08:14.477592] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:25:40.317 [2024-11-18 02:08:14.477612] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.317 [2024-11-18 02:08:14.477621] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.317 [2024-11-18 02:08:14.477628] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x22372f0) 00:25:40.317 [2024-11-18 02:08:14.477639] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.317 [2024-11-18 02:08:14.477651] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.317 [2024-11-18 02:08:14.477658] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.317 [2024-11-18 02:08:14.477665] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x22372f0) 00:25:40.317 [2024-11-18 02:08:14.477675] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:40.317 [2024-11-18 02:08:14.477703] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2290440, cid 4, qid 0 00:25:40.317 [2024-11-18 02:08:14.477716] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22905a0, cid 5, qid 0 00:25:40.318 [2024-11-18 02:08:14.477845] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.318 [2024-11-18 02:08:14.477860] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.318 [2024-11-18 02:08:14.477867] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.477874] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2290440) on tqpair=0x22372f0 00:25:40.318 [2024-11-18 02:08:14.477896] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.318 [2024-11-18 02:08:14.477905] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.318 [2024-11-18 02:08:14.477912] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.477919] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22905a0) on tqpair=0x22372f0 00:25:40.318 [2024-11-18 02:08:14.477935] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.477945] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.477951] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x22372f0) 00:25:40.318 [2024-11-18 02:08:14.477966] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.318 [2024-11-18 02:08:14.477989] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22905a0, cid 5, qid 0 00:25:40.318 [2024-11-18 02:08:14.478072] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.318 [2024-11-18 02:08:14.478085] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.318 [2024-11-18 02:08:14.478092] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478099] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22905a0) on tqpair=0x22372f0 00:25:40.318 [2024-11-18 02:08:14.478115] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478124] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478131] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x22372f0) 00:25:40.318 [2024-11-18 02:08:14.478141] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.318 [2024-11-18 02:08:14.478161] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22905a0, cid 5, qid 0 00:25:40.318 [2024-11-18 02:08:14.478286] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.318 [2024-11-18 02:08:14.478298] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.318 [2024-11-18 02:08:14.478305] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478321] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22905a0) on tqpair=0x22372f0 00:25:40.318 [2024-11-18 02:08:14.478339] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478348] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478355] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x22372f0) 00:25:40.318 [2024-11-18 02:08:14.478366] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.318 [2024-11-18 02:08:14.478387] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22905a0, cid 5, qid 0 00:25:40.318 [2024-11-18 02:08:14.478462] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.318 [2024-11-18 02:08:14.478475] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.318 [2024-11-18 02:08:14.478481] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478488] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22905a0) on tqpair=0x22372f0 00:25:40.318 [2024-11-18 02:08:14.478508] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478518] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478525] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x22372f0) 00:25:40.318 [2024-11-18 02:08:14.478535] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.318 [2024-11-18 02:08:14.478547] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478555] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478561] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x22372f0) 00:25:40.318 [2024-11-18 02:08:14.478571] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.318 [2024-11-18 02:08:14.478582] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478589] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478596] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x22372f0) 00:25:40.318 [2024-11-18 02:08:14.478609] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.318 [2024-11-18 02:08:14.478622] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478629] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478636] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x22372f0) 00:25:40.318 [2024-11-18 02:08:14.478646] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.318 [2024-11-18 02:08:14.478667] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22905a0, cid 5, qid 0 00:25:40.318 [2024-11-18 02:08:14.478679] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2290440, cid 4, qid 0 00:25:40.318 [2024-11-18 02:08:14.478687] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2290700, cid 6, qid 0 00:25:40.318 [2024-11-18 02:08:14.478695] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2290860, cid 7, qid 0 00:25:40.318 [2024-11-18 02:08:14.478872] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:40.318 [2024-11-18 02:08:14.478887] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:40.318 [2024-11-18 02:08:14.478894] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478901] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22372f0): datao=0, datal=8192, cccid=5 00:25:40.318 [2024-11-18 02:08:14.478909] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22905a0) on tqpair(0x22372f0): expected_datao=0, payload_size=8192 00:25:40.318 [2024-11-18 02:08:14.478951] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478963] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478972] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:40.318 [2024-11-18 02:08:14.478981] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:40.318 [2024-11-18 02:08:14.478987] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.478994] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22372f0): datao=0, datal=512, cccid=4 00:25:40.318 [2024-11-18 02:08:14.479002] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2290440) on tqpair(0x22372f0): expected_datao=0, payload_size=512 00:25:40.318 [2024-11-18 02:08:14.479012] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.479019] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.479028] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:40.318 [2024-11-18 02:08:14.479037] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:40.318 [2024-11-18 02:08:14.479043] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.479050] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22372f0): datao=0, datal=512, cccid=6 00:25:40.318 [2024-11-18 02:08:14.479057] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2290700) on tqpair(0x22372f0): expected_datao=0, payload_size=512 00:25:40.318 [2024-11-18 02:08:14.479068] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.479075] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.479084] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:40.318 [2024-11-18 02:08:14.479093] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:40.318 [2024-11-18 02:08:14.479099] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.479106] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22372f0): datao=0, datal=4096, cccid=7 00:25:40.318 [2024-11-18 02:08:14.479113] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2290860) on tqpair(0x22372f0): expected_datao=0, payload_size=4096 00:25:40.318 [2024-11-18 02:08:14.479128] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.479136] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.479148] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.318 [2024-11-18 02:08:14.479158] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.318 [2024-11-18 02:08:14.479165] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.479172] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22905a0) on tqpair=0x22372f0 00:25:40.318 [2024-11-18 02:08:14.479193] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.318 [2024-11-18 02:08:14.479205] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.318 [2024-11-18 02:08:14.479212] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.479218] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2290440) on tqpair=0x22372f0 00:25:40.318 [2024-11-18 02:08:14.479234] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.318 [2024-11-18 02:08:14.479245] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.318 [2024-11-18 02:08:14.479252] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.479273] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2290700) on tqpair=0x22372f0 00:25:40.318 [2024-11-18 02:08:14.479285] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.318 [2024-11-18 02:08:14.479294] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.318 [2024-11-18 02:08:14.479300] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.318 [2024-11-18 02:08:14.479306] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2290860) on tqpair=0x22372f0 00:25:40.318 ===================================================== 00:25:40.319 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:40.319 ===================================================== 00:25:40.319 Controller Capabilities/Features 00:25:40.319 ================================ 00:25:40.319 Vendor ID: 8086 00:25:40.319 Subsystem Vendor ID: 8086 00:25:40.319 Serial Number: SPDK00000000000001 00:25:40.319 Model Number: SPDK bdev Controller 00:25:40.319 Firmware Version: 24.01.1 00:25:40.319 Recommended Arb Burst: 6 00:25:40.319 IEEE OUI Identifier: e4 d2 5c 00:25:40.319 Multi-path I/O 00:25:40.319 May have multiple subsystem ports: Yes 00:25:40.319 May have multiple controllers: Yes 00:25:40.319 Associated with SR-IOV VF: No 00:25:40.319 Max Data Transfer Size: 131072 00:25:40.319 Max Number of Namespaces: 32 00:25:40.319 Max Number of I/O Queues: 127 00:25:40.319 NVMe Specification Version (VS): 1.3 00:25:40.319 NVMe Specification Version (Identify): 1.3 00:25:40.319 Maximum Queue Entries: 128 00:25:40.319 Contiguous Queues Required: Yes 00:25:40.319 Arbitration Mechanisms Supported 00:25:40.319 Weighted Round Robin: Not Supported 00:25:40.319 Vendor Specific: Not Supported 00:25:40.319 Reset Timeout: 15000 ms 00:25:40.319 Doorbell Stride: 4 bytes 00:25:40.319 NVM Subsystem Reset: Not Supported 00:25:40.319 Command Sets Supported 00:25:40.319 NVM Command Set: Supported 00:25:40.319 Boot Partition: Not Supported 00:25:40.319 Memory Page Size Minimum: 4096 bytes 00:25:40.319 Memory Page Size Maximum: 4096 bytes 00:25:40.319 Persistent Memory Region: Not Supported 00:25:40.319 Optional Asynchronous Events Supported 00:25:40.319 Namespace Attribute Notices: Supported 00:25:40.319 Firmware Activation Notices: Not Supported 00:25:40.319 ANA Change Notices: Not Supported 00:25:40.319 PLE Aggregate Log Change Notices: Not Supported 00:25:40.319 LBA Status Info Alert Notices: Not Supported 00:25:40.319 EGE Aggregate Log Change Notices: Not Supported 00:25:40.319 Normal NVM Subsystem Shutdown event: Not Supported 00:25:40.319 Zone Descriptor Change Notices: Not Supported 00:25:40.319 Discovery Log Change Notices: Not Supported 00:25:40.319 Controller Attributes 00:25:40.319 128-bit Host Identifier: Supported 00:25:40.319 Non-Operational Permissive Mode: Not Supported 00:25:40.319 NVM Sets: Not Supported 00:25:40.319 Read Recovery Levels: Not Supported 00:25:40.319 Endurance Groups: Not Supported 00:25:40.319 Predictable Latency Mode: Not Supported 00:25:40.319 Traffic Based Keep ALive: Not Supported 00:25:40.319 Namespace Granularity: Not Supported 00:25:40.319 SQ Associations: Not Supported 00:25:40.319 UUID List: Not Supported 00:25:40.319 Multi-Domain Subsystem: Not Supported 00:25:40.319 Fixed Capacity Management: Not Supported 00:25:40.319 Variable Capacity Management: Not Supported 00:25:40.319 Delete Endurance Group: Not Supported 00:25:40.319 Delete NVM Set: Not Supported 00:25:40.319 Extended LBA Formats Supported: Not Supported 00:25:40.319 Flexible Data Placement Supported: Not Supported 00:25:40.319 00:25:40.319 Controller Memory Buffer Support 00:25:40.319 ================================ 00:25:40.319 Supported: No 00:25:40.319 00:25:40.319 Persistent Memory Region Support 00:25:40.319 ================================ 00:25:40.319 Supported: No 00:25:40.319 00:25:40.319 Admin Command Set Attributes 00:25:40.319 ============================ 00:25:40.319 Security Send/Receive: Not Supported 00:25:40.319 Format NVM: Not Supported 00:25:40.319 Firmware Activate/Download: Not Supported 00:25:40.319 Namespace Management: Not Supported 00:25:40.319 Device Self-Test: Not Supported 00:25:40.319 Directives: Not Supported 00:25:40.319 NVMe-MI: Not Supported 00:25:40.319 Virtualization Management: Not Supported 00:25:40.319 Doorbell Buffer Config: Not Supported 00:25:40.319 Get LBA Status Capability: Not Supported 00:25:40.319 Command & Feature Lockdown Capability: Not Supported 00:25:40.319 Abort Command Limit: 4 00:25:40.319 Async Event Request Limit: 4 00:25:40.319 Number of Firmware Slots: N/A 00:25:40.319 Firmware Slot 1 Read-Only: N/A 00:25:40.319 Firmware Activation Without Reset: N/A 00:25:40.319 Multiple Update Detection Support: N/A 00:25:40.319 Firmware Update Granularity: No Information Provided 00:25:40.319 Per-Namespace SMART Log: No 00:25:40.319 Asymmetric Namespace Access Log Page: Not Supported 00:25:40.319 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:25:40.319 Command Effects Log Page: Supported 00:25:40.319 Get Log Page Extended Data: Supported 00:25:40.319 Telemetry Log Pages: Not Supported 00:25:40.319 Persistent Event Log Pages: Not Supported 00:25:40.319 Supported Log Pages Log Page: May Support 00:25:40.319 Commands Supported & Effects Log Page: Not Supported 00:25:40.319 Feature Identifiers & Effects Log Page:May Support 00:25:40.319 NVMe-MI Commands & Effects Log Page: May Support 00:25:40.319 Data Area 4 for Telemetry Log: Not Supported 00:25:40.319 Error Log Page Entries Supported: 128 00:25:40.319 Keep Alive: Supported 00:25:40.319 Keep Alive Granularity: 10000 ms 00:25:40.319 00:25:40.319 NVM Command Set Attributes 00:25:40.319 ========================== 00:25:40.319 Submission Queue Entry Size 00:25:40.319 Max: 64 00:25:40.319 Min: 64 00:25:40.319 Completion Queue Entry Size 00:25:40.319 Max: 16 00:25:40.319 Min: 16 00:25:40.319 Number of Namespaces: 32 00:25:40.319 Compare Command: Supported 00:25:40.319 Write Uncorrectable Command: Not Supported 00:25:40.319 Dataset Management Command: Supported 00:25:40.319 Write Zeroes Command: Supported 00:25:40.319 Set Features Save Field: Not Supported 00:25:40.319 Reservations: Supported 00:25:40.319 Timestamp: Not Supported 00:25:40.319 Copy: Supported 00:25:40.319 Volatile Write Cache: Present 00:25:40.319 Atomic Write Unit (Normal): 1 00:25:40.319 Atomic Write Unit (PFail): 1 00:25:40.319 Atomic Compare & Write Unit: 1 00:25:40.319 Fused Compare & Write: Supported 00:25:40.319 Scatter-Gather List 00:25:40.319 SGL Command Set: Supported 00:25:40.319 SGL Keyed: Supported 00:25:40.319 SGL Bit Bucket Descriptor: Not Supported 00:25:40.319 SGL Metadata Pointer: Not Supported 00:25:40.319 Oversized SGL: Not Supported 00:25:40.319 SGL Metadata Address: Not Supported 00:25:40.319 SGL Offset: Supported 00:25:40.319 Transport SGL Data Block: Not Supported 00:25:40.319 Replay Protected Memory Block: Not Supported 00:25:40.319 00:25:40.319 Firmware Slot Information 00:25:40.319 ========================= 00:25:40.319 Active slot: 1 00:25:40.319 Slot 1 Firmware Revision: 24.01.1 00:25:40.319 00:25:40.319 00:25:40.319 Commands Supported and Effects 00:25:40.319 ============================== 00:25:40.319 Admin Commands 00:25:40.319 -------------- 00:25:40.319 Get Log Page (02h): Supported 00:25:40.319 Identify (06h): Supported 00:25:40.319 Abort (08h): Supported 00:25:40.319 Set Features (09h): Supported 00:25:40.319 Get Features (0Ah): Supported 00:25:40.319 Asynchronous Event Request (0Ch): Supported 00:25:40.319 Keep Alive (18h): Supported 00:25:40.319 I/O Commands 00:25:40.319 ------------ 00:25:40.319 Flush (00h): Supported LBA-Change 00:25:40.319 Write (01h): Supported LBA-Change 00:25:40.319 Read (02h): Supported 00:25:40.319 Compare (05h): Supported 00:25:40.319 Write Zeroes (08h): Supported LBA-Change 00:25:40.319 Dataset Management (09h): Supported LBA-Change 00:25:40.319 Copy (19h): Supported LBA-Change 00:25:40.319 Unknown (79h): Supported LBA-Change 00:25:40.319 Unknown (7Ah): Supported 00:25:40.319 00:25:40.319 Error Log 00:25:40.319 ========= 00:25:40.319 00:25:40.319 Arbitration 00:25:40.319 =========== 00:25:40.319 Arbitration Burst: 1 00:25:40.319 00:25:40.319 Power Management 00:25:40.319 ================ 00:25:40.319 Number of Power States: 1 00:25:40.319 Current Power State: Power State #0 00:25:40.319 Power State #0: 00:25:40.319 Max Power: 0.00 W 00:25:40.319 Non-Operational State: Operational 00:25:40.319 Entry Latency: Not Reported 00:25:40.319 Exit Latency: Not Reported 00:25:40.319 Relative Read Throughput: 0 00:25:40.319 Relative Read Latency: 0 00:25:40.319 Relative Write Throughput: 0 00:25:40.319 Relative Write Latency: 0 00:25:40.319 Idle Power: Not Reported 00:25:40.319 Active Power: Not Reported 00:25:40.319 Non-Operational Permissive Mode: Not Supported 00:25:40.319 00:25:40.319 Health Information 00:25:40.319 ================== 00:25:40.320 Critical Warnings: 00:25:40.320 Available Spare Space: OK 00:25:40.320 Temperature: OK 00:25:40.320 Device Reliability: OK 00:25:40.320 Read Only: No 00:25:40.320 Volatile Memory Backup: OK 00:25:40.320 Current Temperature: 0 Kelvin (-273 Celsius) 00:25:40.320 Temperature Threshold: [2024-11-18 02:08:14.479473] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.479486] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.479493] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x22372f0) 00:25:40.320 [2024-11-18 02:08:14.479504] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.320 [2024-11-18 02:08:14.479527] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2290860, cid 7, qid 0 00:25:40.320 [2024-11-18 02:08:14.479662] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.320 [2024-11-18 02:08:14.479675] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.320 [2024-11-18 02:08:14.479682] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.479688] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2290860) on tqpair=0x22372f0 00:25:40.320 [2024-11-18 02:08:14.479729] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:25:40.320 [2024-11-18 02:08:14.479751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:40.320 [2024-11-18 02:08:14.479764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:40.320 [2024-11-18 02:08:14.479774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:40.320 [2024-11-18 02:08:14.479783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:40.320 [2024-11-18 02:08:14.479796] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.479804] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.479811] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22372f0) 00:25:40.320 [2024-11-18 02:08:14.479821] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.320 [2024-11-18 02:08:14.479847] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22902e0, cid 3, qid 0 00:25:40.320 [2024-11-18 02:08:14.479928] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.320 [2024-11-18 02:08:14.479942] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.320 [2024-11-18 02:08:14.479949] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.479956] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22902e0) on tqpair=0x22372f0 00:25:40.320 [2024-11-18 02:08:14.479968] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.479976] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.479982] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22372f0) 00:25:40.320 [2024-11-18 02:08:14.479993] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.320 [2024-11-18 02:08:14.480019] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22902e0, cid 3, qid 0 00:25:40.320 [2024-11-18 02:08:14.480107] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.320 [2024-11-18 02:08:14.480120] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.320 [2024-11-18 02:08:14.480127] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.480134] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22902e0) on tqpair=0x22372f0 00:25:40.320 [2024-11-18 02:08:14.480143] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:25:40.320 [2024-11-18 02:08:14.480151] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:25:40.320 [2024-11-18 02:08:14.480167] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.480176] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.480182] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22372f0) 00:25:40.320 [2024-11-18 02:08:14.480193] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.320 [2024-11-18 02:08:14.480213] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22902e0, cid 3, qid 0 00:25:40.320 [2024-11-18 02:08:14.480291] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.320 [2024-11-18 02:08:14.480304] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.320 [2024-11-18 02:08:14.484338] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.484349] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22902e0) on tqpair=0x22372f0 00:25:40.320 [2024-11-18 02:08:14.484369] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.484379] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.484399] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22372f0) 00:25:40.320 [2024-11-18 02:08:14.484411] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.320 [2024-11-18 02:08:14.484433] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22902e0, cid 3, qid 0 00:25:40.320 [2024-11-18 02:08:14.484562] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:40.320 [2024-11-18 02:08:14.484577] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:40.320 [2024-11-18 02:08:14.484584] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:40.320 [2024-11-18 02:08:14.484591] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22902e0) on tqpair=0x22372f0 00:25:40.320 [2024-11-18 02:08:14.484605] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:25:40.320 0 Kelvin (-273 Celsius) 00:25:40.320 Available Spare: 0% 00:25:40.320 Available Spare Threshold: 0% 00:25:40.320 Life Percentage Used: 0% 00:25:40.320 Data Units Read: 0 00:25:40.320 Data Units Written: 0 00:25:40.320 Host Read Commands: 0 00:25:40.320 Host Write Commands: 0 00:25:40.320 Controller Busy Time: 0 minutes 00:25:40.320 Power Cycles: 0 00:25:40.320 Power On Hours: 0 hours 00:25:40.320 Unsafe Shutdowns: 0 00:25:40.320 Unrecoverable Media Errors: 0 00:25:40.320 Lifetime Error Log Entries: 0 00:25:40.320 Warning Temperature Time: 0 minutes 00:25:40.320 Critical Temperature Time: 0 minutes 00:25:40.320 00:25:40.320 Number of Queues 00:25:40.320 ================ 00:25:40.320 Number of I/O Submission Queues: 127 00:25:40.320 Number of I/O Completion Queues: 127 00:25:40.320 00:25:40.320 Active Namespaces 00:25:40.320 ================= 00:25:40.320 Namespace ID:1 00:25:40.320 Error Recovery Timeout: Unlimited 00:25:40.320 Command Set Identifier: NVM (00h) 00:25:40.320 Deallocate: Supported 00:25:40.320 Deallocated/Unwritten Error: Not Supported 00:25:40.320 Deallocated Read Value: Unknown 00:25:40.320 Deallocate in Write Zeroes: Not Supported 00:25:40.320 Deallocated Guard Field: 0xFFFF 00:25:40.320 Flush: Supported 00:25:40.320 Reservation: Supported 00:25:40.320 Namespace Sharing Capabilities: Multiple Controllers 00:25:40.320 Size (in LBAs): 131072 (0GiB) 00:25:40.320 Capacity (in LBAs): 131072 (0GiB) 00:25:40.320 Utilization (in LBAs): 131072 (0GiB) 00:25:40.320 NGUID: ABCDEF0123456789ABCDEF0123456789 00:25:40.320 EUI64: ABCDEF0123456789 00:25:40.320 UUID: d6c14ddf-63cf-4079-936c-890f6b3cc45c 00:25:40.320 Thin Provisioning: Not Supported 00:25:40.320 Per-NS Atomic Units: Yes 00:25:40.320 Atomic Boundary Size (Normal): 0 00:25:40.320 Atomic Boundary Size (PFail): 0 00:25:40.320 Atomic Boundary Offset: 0 00:25:40.320 Maximum Single Source Range Length: 65535 00:25:40.320 Maximum Copy Length: 65535 00:25:40.320 Maximum Source Range Count: 1 00:25:40.320 NGUID/EUI64 Never Reused: No 00:25:40.320 Namespace Write Protected: No 00:25:40.320 Number of LBA Formats: 1 00:25:40.320 Current LBA Format: LBA Format #00 00:25:40.320 LBA Format #00: Data Size: 512 Metadata Size: 0 00:25:40.320 00:25:40.320 02:08:14 -- host/identify.sh@51 -- # sync 00:25:40.320 02:08:14 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:40.320 02:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.320 02:08:14 -- common/autotest_common.sh@10 -- # set +x 00:25:40.320 02:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.320 02:08:14 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:25:40.320 02:08:14 -- host/identify.sh@56 -- # nvmftestfini 00:25:40.320 02:08:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:40.320 02:08:14 -- nvmf/common.sh@116 -- # sync 00:25:40.320 02:08:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:40.320 02:08:14 -- nvmf/common.sh@119 -- # set +e 00:25:40.320 02:08:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:40.320 02:08:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:40.320 rmmod nvme_tcp 00:25:40.320 rmmod nvme_fabrics 00:25:40.320 rmmod nvme_keyring 00:25:40.320 02:08:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:40.320 02:08:14 -- nvmf/common.sh@123 -- # set -e 00:25:40.320 02:08:14 -- nvmf/common.sh@124 -- # return 0 00:25:40.320 02:08:14 -- nvmf/common.sh@477 -- # '[' -n 1290863 ']' 00:25:40.321 02:08:14 -- nvmf/common.sh@478 -- # killprocess 1290863 00:25:40.321 02:08:14 -- common/autotest_common.sh@936 -- # '[' -z 1290863 ']' 00:25:40.321 02:08:14 -- common/autotest_common.sh@940 -- # kill -0 1290863 00:25:40.321 02:08:14 -- common/autotest_common.sh@941 -- # uname 00:25:40.321 02:08:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:40.321 02:08:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1290863 00:25:40.321 02:08:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:40.321 02:08:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:40.321 02:08:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1290863' 00:25:40.321 killing process with pid 1290863 00:25:40.321 02:08:14 -- common/autotest_common.sh@955 -- # kill 1290863 00:25:40.321 [2024-11-18 02:08:14.603091] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:40.321 02:08:14 -- common/autotest_common.sh@960 -- # wait 1290863 00:25:40.579 02:08:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:40.579 02:08:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:40.579 02:08:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:40.579 02:08:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:40.579 02:08:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:40.579 02:08:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:40.579 02:08:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:40.579 02:08:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:43.117 02:08:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:43.117 00:25:43.117 real 0m6.342s 00:25:43.117 user 0m7.589s 00:25:43.117 sys 0m2.067s 00:25:43.117 02:08:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:43.117 02:08:16 -- common/autotest_common.sh@10 -- # set +x 00:25:43.117 ************************************ 00:25:43.117 END TEST nvmf_identify 00:25:43.117 ************************************ 00:25:43.117 02:08:16 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:43.117 02:08:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:43.117 02:08:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:43.117 02:08:16 -- common/autotest_common.sh@10 -- # set +x 00:25:43.117 ************************************ 00:25:43.117 START TEST nvmf_perf 00:25:43.117 ************************************ 00:25:43.117 02:08:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:43.117 * Looking for test storage... 00:25:43.117 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:43.117 02:08:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:43.117 02:08:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:43.117 02:08:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:43.117 02:08:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:43.117 02:08:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:43.117 02:08:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:43.117 02:08:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:43.117 02:08:17 -- scripts/common.sh@335 -- # IFS=.-: 00:25:43.117 02:08:17 -- scripts/common.sh@335 -- # read -ra ver1 00:25:43.117 02:08:17 -- scripts/common.sh@336 -- # IFS=.-: 00:25:43.117 02:08:17 -- scripts/common.sh@336 -- # read -ra ver2 00:25:43.117 02:08:17 -- scripts/common.sh@337 -- # local 'op=<' 00:25:43.117 02:08:17 -- scripts/common.sh@339 -- # ver1_l=2 00:25:43.117 02:08:17 -- scripts/common.sh@340 -- # ver2_l=1 00:25:43.117 02:08:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:43.117 02:08:17 -- scripts/common.sh@343 -- # case "$op" in 00:25:43.117 02:08:17 -- scripts/common.sh@344 -- # : 1 00:25:43.117 02:08:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:43.117 02:08:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:43.117 02:08:17 -- scripts/common.sh@364 -- # decimal 1 00:25:43.117 02:08:17 -- scripts/common.sh@352 -- # local d=1 00:25:43.117 02:08:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:43.117 02:08:17 -- scripts/common.sh@354 -- # echo 1 00:25:43.117 02:08:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:43.117 02:08:17 -- scripts/common.sh@365 -- # decimal 2 00:25:43.117 02:08:17 -- scripts/common.sh@352 -- # local d=2 00:25:43.117 02:08:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:43.117 02:08:17 -- scripts/common.sh@354 -- # echo 2 00:25:43.117 02:08:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:43.117 02:08:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:43.117 02:08:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:43.117 02:08:17 -- scripts/common.sh@367 -- # return 0 00:25:43.117 02:08:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:43.117 02:08:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:43.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.117 --rc genhtml_branch_coverage=1 00:25:43.117 --rc genhtml_function_coverage=1 00:25:43.117 --rc genhtml_legend=1 00:25:43.117 --rc geninfo_all_blocks=1 00:25:43.117 --rc geninfo_unexecuted_blocks=1 00:25:43.117 00:25:43.117 ' 00:25:43.117 02:08:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:43.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.117 --rc genhtml_branch_coverage=1 00:25:43.117 --rc genhtml_function_coverage=1 00:25:43.117 --rc genhtml_legend=1 00:25:43.117 --rc geninfo_all_blocks=1 00:25:43.117 --rc geninfo_unexecuted_blocks=1 00:25:43.117 00:25:43.117 ' 00:25:43.117 02:08:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:43.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.117 --rc genhtml_branch_coverage=1 00:25:43.117 --rc genhtml_function_coverage=1 00:25:43.117 --rc genhtml_legend=1 00:25:43.117 --rc geninfo_all_blocks=1 00:25:43.117 --rc geninfo_unexecuted_blocks=1 00:25:43.117 00:25:43.117 ' 00:25:43.117 02:08:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:43.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.117 --rc genhtml_branch_coverage=1 00:25:43.117 --rc genhtml_function_coverage=1 00:25:43.117 --rc genhtml_legend=1 00:25:43.117 --rc geninfo_all_blocks=1 00:25:43.117 --rc geninfo_unexecuted_blocks=1 00:25:43.117 00:25:43.117 ' 00:25:43.117 02:08:17 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:43.117 02:08:17 -- nvmf/common.sh@7 -- # uname -s 00:25:43.117 02:08:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:43.117 02:08:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:43.117 02:08:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:43.117 02:08:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:43.117 02:08:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:43.117 02:08:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:43.117 02:08:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:43.117 02:08:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:43.117 02:08:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:43.117 02:08:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:43.117 02:08:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:43.117 02:08:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:43.117 02:08:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:43.118 02:08:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:43.118 02:08:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:43.118 02:08:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:43.118 02:08:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:43.118 02:08:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:43.118 02:08:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:43.118 02:08:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.118 02:08:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.118 02:08:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.118 02:08:17 -- paths/export.sh@5 -- # export PATH 00:25:43.118 02:08:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.118 02:08:17 -- nvmf/common.sh@46 -- # : 0 00:25:43.118 02:08:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:43.118 02:08:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:43.118 02:08:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:43.118 02:08:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:43.118 02:08:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:43.118 02:08:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:43.118 02:08:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:43.118 02:08:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:43.118 02:08:17 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:25:43.118 02:08:17 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:25:43.118 02:08:17 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:43.118 02:08:17 -- host/perf.sh@17 -- # nvmftestinit 00:25:43.118 02:08:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:43.118 02:08:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:43.118 02:08:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:43.118 02:08:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:43.118 02:08:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:43.118 02:08:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:43.118 02:08:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:43.118 02:08:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:43.118 02:08:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:43.118 02:08:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:43.118 02:08:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:43.118 02:08:17 -- common/autotest_common.sh@10 -- # set +x 00:25:45.024 02:08:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:45.024 02:08:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:45.024 02:08:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:45.024 02:08:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:45.024 02:08:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:45.024 02:08:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:45.024 02:08:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:45.024 02:08:19 -- nvmf/common.sh@294 -- # net_devs=() 00:25:45.024 02:08:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:45.024 02:08:19 -- nvmf/common.sh@295 -- # e810=() 00:25:45.024 02:08:19 -- nvmf/common.sh@295 -- # local -ga e810 00:25:45.024 02:08:19 -- nvmf/common.sh@296 -- # x722=() 00:25:45.024 02:08:19 -- nvmf/common.sh@296 -- # local -ga x722 00:25:45.024 02:08:19 -- nvmf/common.sh@297 -- # mlx=() 00:25:45.024 02:08:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:45.024 02:08:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:45.024 02:08:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:45.024 02:08:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:45.024 02:08:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:45.024 02:08:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:45.024 02:08:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:45.024 02:08:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:45.024 02:08:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:45.024 02:08:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:45.024 02:08:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:45.024 02:08:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:45.024 02:08:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:45.024 02:08:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:45.024 02:08:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:45.024 02:08:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:45.024 02:08:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:45.024 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:45.024 02:08:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:45.024 02:08:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:45.024 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:45.024 02:08:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:45.024 02:08:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:45.024 02:08:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:45.024 02:08:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:45.024 02:08:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:45.024 02:08:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:45.024 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:45.024 02:08:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:45.024 02:08:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:45.024 02:08:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:45.024 02:08:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:45.024 02:08:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:45.024 02:08:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:45.024 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:45.024 02:08:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:45.024 02:08:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:45.024 02:08:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:45.024 02:08:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:45.024 02:08:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:45.024 02:08:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:45.024 02:08:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:45.024 02:08:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:45.024 02:08:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:45.024 02:08:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:45.024 02:08:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:45.024 02:08:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:45.024 02:08:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:45.024 02:08:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:45.024 02:08:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:45.024 02:08:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:45.024 02:08:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:45.024 02:08:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:45.024 02:08:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:45.024 02:08:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:45.024 02:08:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:45.024 02:08:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:45.024 02:08:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:45.024 02:08:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:45.024 02:08:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:45.024 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:45.024 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.310 ms 00:25:45.024 00:25:45.024 --- 10.0.0.2 ping statistics --- 00:25:45.024 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:45.024 rtt min/avg/max/mdev = 0.310/0.310/0.310/0.000 ms 00:25:45.024 02:08:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:45.024 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:45.024 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:25:45.024 00:25:45.024 --- 10.0.0.1 ping statistics --- 00:25:45.024 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:45.024 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:25:45.025 02:08:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:45.025 02:08:19 -- nvmf/common.sh@410 -- # return 0 00:25:45.025 02:08:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:45.025 02:08:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:45.025 02:08:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:45.025 02:08:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:45.025 02:08:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:45.025 02:08:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:45.025 02:08:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:45.025 02:08:19 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:25:45.025 02:08:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:45.025 02:08:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:45.025 02:08:19 -- common/autotest_common.sh@10 -- # set +x 00:25:45.025 02:08:19 -- nvmf/common.sh@469 -- # nvmfpid=1293090 00:25:45.025 02:08:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:45.025 02:08:19 -- nvmf/common.sh@470 -- # waitforlisten 1293090 00:25:45.025 02:08:19 -- common/autotest_common.sh@829 -- # '[' -z 1293090 ']' 00:25:45.025 02:08:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:45.025 02:08:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:45.025 02:08:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:45.025 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:45.025 02:08:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:45.025 02:08:19 -- common/autotest_common.sh@10 -- # set +x 00:25:45.025 [2024-11-18 02:08:19.226160] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:45.025 [2024-11-18 02:08:19.226253] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:45.025 EAL: No free 2048 kB hugepages reported on node 1 00:25:45.025 [2024-11-18 02:08:19.292979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:45.025 [2024-11-18 02:08:19.381305] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:45.025 [2024-11-18 02:08:19.381481] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:45.025 [2024-11-18 02:08:19.381498] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:45.025 [2024-11-18 02:08:19.381510] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:45.025 [2024-11-18 02:08:19.381780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:45.025 [2024-11-18 02:08:19.381843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:45.025 [2024-11-18 02:08:19.381895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:45.025 [2024-11-18 02:08:19.381898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:45.962 02:08:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:45.962 02:08:20 -- common/autotest_common.sh@862 -- # return 0 00:25:45.962 02:08:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:45.962 02:08:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:45.962 02:08:20 -- common/autotest_common.sh@10 -- # set +x 00:25:45.962 02:08:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:45.962 02:08:20 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:45.962 02:08:20 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:25:49.250 02:08:23 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:25:49.250 02:08:23 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:25:49.508 02:08:23 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:25:49.508 02:08:23 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:25:49.766 02:08:23 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:25:49.766 02:08:23 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:25:49.766 02:08:23 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:25:49.766 02:08:23 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:25:49.766 02:08:23 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:25:50.023 [2024-11-18 02:08:24.184823] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:50.023 02:08:24 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:50.281 02:08:24 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:50.281 02:08:24 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:50.539 02:08:24 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:50.540 02:08:24 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:25:50.798 02:08:24 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:51.057 [2024-11-18 02:08:25.216718] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:51.057 02:08:25 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:51.315 02:08:25 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:25:51.315 02:08:25 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:51.315 02:08:25 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:25:51.315 02:08:25 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:52.695 Initializing NVMe Controllers 00:25:52.695 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:25:52.695 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:25:52.695 Initialization complete. Launching workers. 00:25:52.695 ======================================================== 00:25:52.695 Latency(us) 00:25:52.695 Device Information : IOPS MiB/s Average min max 00:25:52.695 PCIE (0000:88:00.0) NSID 1 from core 0: 84800.94 331.25 376.94 31.81 6232.90 00:25:52.695 ======================================================== 00:25:52.695 Total : 84800.94 331.25 376.94 31.81 6232.90 00:25:52.695 00:25:52.695 02:08:26 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:52.695 EAL: No free 2048 kB hugepages reported on node 1 00:25:53.630 Initializing NVMe Controllers 00:25:53.631 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:53.631 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:53.631 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:53.631 Initialization complete. Launching workers. 00:25:53.631 ======================================================== 00:25:53.631 Latency(us) 00:25:53.631 Device Information : IOPS MiB/s Average min max 00:25:53.631 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 117.00 0.46 8858.11 147.05 45116.76 00:25:53.631 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 51.00 0.20 19695.38 6986.21 47909.79 00:25:53.631 ======================================================== 00:25:53.631 Total : 168.00 0.66 12148.00 147.05 47909.79 00:25:53.631 00:25:53.631 02:08:27 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:53.631 EAL: No free 2048 kB hugepages reported on node 1 00:25:55.008 Initializing NVMe Controllers 00:25:55.008 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:55.008 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:55.008 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:55.008 Initialization complete. Launching workers. 00:25:55.008 ======================================================== 00:25:55.008 Latency(us) 00:25:55.008 Device Information : IOPS MiB/s Average min max 00:25:55.008 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8145.98 31.82 3935.31 611.99 10233.14 00:25:55.008 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3824.99 14.94 8404.47 5135.23 19116.47 00:25:55.008 ======================================================== 00:25:55.008 Total : 11970.98 46.76 5363.30 611.99 19116.47 00:25:55.008 00:25:55.008 02:08:29 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:25:55.008 02:08:29 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:25:55.008 02:08:29 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:55.008 EAL: No free 2048 kB hugepages reported on node 1 00:25:57.543 Initializing NVMe Controllers 00:25:57.543 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:57.543 Controller IO queue size 128, less than required. 00:25:57.543 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:57.543 Controller IO queue size 128, less than required. 00:25:57.543 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:57.543 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:57.543 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:57.543 Initialization complete. Launching workers. 00:25:57.543 ======================================================== 00:25:57.543 Latency(us) 00:25:57.543 Device Information : IOPS MiB/s Average min max 00:25:57.543 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1699.85 424.96 75887.14 53705.32 134618.25 00:25:57.543 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 597.72 149.43 221578.96 84228.01 337999.95 00:25:57.543 ======================================================== 00:25:57.543 Total : 2297.57 574.39 113789.16 53705.32 337999.95 00:25:57.543 00:25:57.543 02:08:31 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:25:57.543 EAL: No free 2048 kB hugepages reported on node 1 00:25:57.803 No valid NVMe controllers or AIO or URING devices found 00:25:57.803 Initializing NVMe Controllers 00:25:57.803 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:57.803 Controller IO queue size 128, less than required. 00:25:57.803 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:57.803 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:25:57.803 Controller IO queue size 128, less than required. 00:25:57.803 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:57.803 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:25:57.803 WARNING: Some requested NVMe devices were skipped 00:25:57.803 02:08:32 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:25:57.803 EAL: No free 2048 kB hugepages reported on node 1 00:26:00.490 Initializing NVMe Controllers 00:26:00.490 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:00.490 Controller IO queue size 128, less than required. 00:26:00.490 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:00.490 Controller IO queue size 128, less than required. 00:26:00.490 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:00.490 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:00.490 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:00.490 Initialization complete. Launching workers. 00:26:00.490 00:26:00.490 ==================== 00:26:00.490 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:00.490 TCP transport: 00:26:00.490 polls: 8911 00:26:00.490 idle_polls: 5868 00:26:00.490 sock_completions: 3043 00:26:00.490 nvme_completions: 5688 00:26:00.490 submitted_requests: 8734 00:26:00.490 queued_requests: 1 00:26:00.490 00:26:00.490 ==================== 00:26:00.490 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:00.490 TCP transport: 00:26:00.490 polls: 12095 00:26:00.490 idle_polls: 8416 00:26:00.490 sock_completions: 3679 00:26:00.490 nvme_completions: 6166 00:26:00.490 submitted_requests: 9404 00:26:00.490 queued_requests: 1 00:26:00.490 ======================================================== 00:26:00.490 Latency(us) 00:26:00.490 Device Information : IOPS MiB/s Average min max 00:26:00.490 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1485.14 371.28 88440.55 54248.54 158291.63 00:26:00.490 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1604.61 401.15 80582.00 46083.31 127202.04 00:26:00.490 ======================================================== 00:26:00.490 Total : 3089.74 772.44 84359.34 46083.31 158291.63 00:26:00.490 00:26:00.490 02:08:34 -- host/perf.sh@66 -- # sync 00:26:00.490 02:08:34 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:00.754 02:08:35 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:00.754 02:08:35 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:00.754 02:08:35 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:04.045 02:08:38 -- host/perf.sh@72 -- # ls_guid=e7ed0e73-c2b9-485e-a7dc-0c30e1196333 00:26:04.045 02:08:38 -- host/perf.sh@73 -- # get_lvs_free_mb e7ed0e73-c2b9-485e-a7dc-0c30e1196333 00:26:04.045 02:08:38 -- common/autotest_common.sh@1353 -- # local lvs_uuid=e7ed0e73-c2b9-485e-a7dc-0c30e1196333 00:26:04.045 02:08:38 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:04.045 02:08:38 -- common/autotest_common.sh@1355 -- # local fc 00:26:04.045 02:08:38 -- common/autotest_common.sh@1356 -- # local cs 00:26:04.045 02:08:38 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:04.304 02:08:38 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:04.304 { 00:26:04.304 "uuid": "e7ed0e73-c2b9-485e-a7dc-0c30e1196333", 00:26:04.304 "name": "lvs_0", 00:26:04.304 "base_bdev": "Nvme0n1", 00:26:04.304 "total_data_clusters": 238234, 00:26:04.304 "free_clusters": 238234, 00:26:04.304 "block_size": 512, 00:26:04.304 "cluster_size": 4194304 00:26:04.304 } 00:26:04.304 ]' 00:26:04.304 02:08:38 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="e7ed0e73-c2b9-485e-a7dc-0c30e1196333") .free_clusters' 00:26:04.304 02:08:38 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:04.304 02:08:38 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="e7ed0e73-c2b9-485e-a7dc-0c30e1196333") .cluster_size' 00:26:04.304 02:08:38 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:04.304 02:08:38 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:04.304 02:08:38 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:04.304 952936 00:26:04.304 02:08:38 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:04.304 02:08:38 -- host/perf.sh@78 -- # free_mb=20480 00:26:04.304 02:08:38 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e7ed0e73-c2b9-485e-a7dc-0c30e1196333 lbd_0 20480 00:26:05.242 02:08:39 -- host/perf.sh@80 -- # lb_guid=2924d7ee-7728-4b58-81f1-f8446fb993f7 00:26:05.242 02:08:39 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 2924d7ee-7728-4b58-81f1-f8446fb993f7 lvs_n_0 00:26:05.810 02:08:40 -- host/perf.sh@83 -- # ls_nested_guid=923e81ac-1172-4346-aa7f-c35fc7b17cab 00:26:05.810 02:08:40 -- host/perf.sh@84 -- # get_lvs_free_mb 923e81ac-1172-4346-aa7f-c35fc7b17cab 00:26:05.810 02:08:40 -- common/autotest_common.sh@1353 -- # local lvs_uuid=923e81ac-1172-4346-aa7f-c35fc7b17cab 00:26:05.810 02:08:40 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:05.810 02:08:40 -- common/autotest_common.sh@1355 -- # local fc 00:26:05.810 02:08:40 -- common/autotest_common.sh@1356 -- # local cs 00:26:05.810 02:08:40 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:06.068 02:08:40 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:06.068 { 00:26:06.068 "uuid": "e7ed0e73-c2b9-485e-a7dc-0c30e1196333", 00:26:06.068 "name": "lvs_0", 00:26:06.068 "base_bdev": "Nvme0n1", 00:26:06.068 "total_data_clusters": 238234, 00:26:06.068 "free_clusters": 233114, 00:26:06.068 "block_size": 512, 00:26:06.068 "cluster_size": 4194304 00:26:06.068 }, 00:26:06.068 { 00:26:06.068 "uuid": "923e81ac-1172-4346-aa7f-c35fc7b17cab", 00:26:06.068 "name": "lvs_n_0", 00:26:06.068 "base_bdev": "2924d7ee-7728-4b58-81f1-f8446fb993f7", 00:26:06.068 "total_data_clusters": 5114, 00:26:06.068 "free_clusters": 5114, 00:26:06.068 "block_size": 512, 00:26:06.068 "cluster_size": 4194304 00:26:06.068 } 00:26:06.068 ]' 00:26:06.068 02:08:40 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="923e81ac-1172-4346-aa7f-c35fc7b17cab") .free_clusters' 00:26:06.068 02:08:40 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:06.068 02:08:40 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="923e81ac-1172-4346-aa7f-c35fc7b17cab") .cluster_size' 00:26:06.068 02:08:40 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:06.068 02:08:40 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:06.068 02:08:40 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:06.068 20456 00:26:06.068 02:08:40 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:06.068 02:08:40 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 923e81ac-1172-4346-aa7f-c35fc7b17cab lbd_nest_0 20456 00:26:06.326 02:08:40 -- host/perf.sh@88 -- # lb_nested_guid=5e9c6222-af13-4a98-8ac2-08db331ec2b6 00:26:06.326 02:08:40 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:06.585 02:08:40 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:06.585 02:08:40 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 5e9c6222-af13-4a98-8ac2-08db331ec2b6 00:26:06.843 02:08:41 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:07.101 02:08:41 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:07.101 02:08:41 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:07.101 02:08:41 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:07.101 02:08:41 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:07.101 02:08:41 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:07.101 EAL: No free 2048 kB hugepages reported on node 1 00:26:19.325 Initializing NVMe Controllers 00:26:19.325 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:19.325 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:19.325 Initialization complete. Launching workers. 00:26:19.325 ======================================================== 00:26:19.325 Latency(us) 00:26:19.325 Device Information : IOPS MiB/s Average min max 00:26:19.325 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 46.68 0.02 21495.19 162.04 44847.30 00:26:19.325 ======================================================== 00:26:19.325 Total : 46.68 0.02 21495.19 162.04 44847.30 00:26:19.325 00:26:19.325 02:08:51 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:19.325 02:08:51 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:19.325 EAL: No free 2048 kB hugepages reported on node 1 00:26:29.312 Initializing NVMe Controllers 00:26:29.312 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:29.312 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:29.312 Initialization complete. Launching workers. 00:26:29.312 ======================================================== 00:26:29.312 Latency(us) 00:26:29.312 Device Information : IOPS MiB/s Average min max 00:26:29.312 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 77.00 9.62 12993.61 5040.15 50881.94 00:26:29.312 ======================================================== 00:26:29.312 Total : 77.00 9.62 12993.61 5040.15 50881.94 00:26:29.312 00:26:29.312 02:09:02 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:29.312 02:09:02 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:29.312 02:09:02 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:29.312 EAL: No free 2048 kB hugepages reported on node 1 00:26:39.291 Initializing NVMe Controllers 00:26:39.291 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:39.291 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:39.291 Initialization complete. Launching workers. 00:26:39.291 ======================================================== 00:26:39.291 Latency(us) 00:26:39.291 Device Information : IOPS MiB/s Average min max 00:26:39.291 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7920.00 3.87 4040.47 329.04 11546.63 00:26:39.291 ======================================================== 00:26:39.291 Total : 7920.00 3.87 4040.47 329.04 11546.63 00:26:39.291 00:26:39.291 02:09:12 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:39.291 02:09:12 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:39.291 EAL: No free 2048 kB hugepages reported on node 1 00:26:49.275 Initializing NVMe Controllers 00:26:49.275 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:49.275 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:49.275 Initialization complete. Launching workers. 00:26:49.275 ======================================================== 00:26:49.275 Latency(us) 00:26:49.275 Device Information : IOPS MiB/s Average min max 00:26:49.275 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4078.18 509.77 7847.54 582.14 17630.66 00:26:49.275 ======================================================== 00:26:49.275 Total : 4078.18 509.77 7847.54 582.14 17630.66 00:26:49.275 00:26:49.275 02:09:22 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:49.275 02:09:22 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:49.275 02:09:22 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:49.275 EAL: No free 2048 kB hugepages reported on node 1 00:26:59.317 Initializing NVMe Controllers 00:26:59.317 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:59.317 Controller IO queue size 128, less than required. 00:26:59.317 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:59.317 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:59.317 Initialization complete. Launching workers. 00:26:59.317 ======================================================== 00:26:59.317 Latency(us) 00:26:59.317 Device Information : IOPS MiB/s Average min max 00:26:59.317 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12134.20 5.92 10555.77 1818.93 24436.82 00:26:59.317 ======================================================== 00:26:59.317 Total : 12134.20 5.92 10555.77 1818.93 24436.82 00:26:59.317 00:26:59.317 02:09:33 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:59.317 02:09:33 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:59.317 EAL: No free 2048 kB hugepages reported on node 1 00:27:09.304 Initializing NVMe Controllers 00:27:09.304 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:09.304 Controller IO queue size 128, less than required. 00:27:09.304 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:09.304 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:09.304 Initialization complete. Launching workers. 00:27:09.304 ======================================================== 00:27:09.304 Latency(us) 00:27:09.304 Device Information : IOPS MiB/s Average min max 00:27:09.304 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1151.20 143.90 111729.42 15574.85 245660.16 00:27:09.304 ======================================================== 00:27:09.304 Total : 1151.20 143.90 111729.42 15574.85 245660.16 00:27:09.304 00:27:09.304 02:09:43 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:09.563 02:09:43 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 5e9c6222-af13-4a98-8ac2-08db331ec2b6 00:27:10.498 02:09:44 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:10.498 02:09:44 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 2924d7ee-7728-4b58-81f1-f8446fb993f7 00:27:10.756 02:09:45 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:11.014 02:09:45 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:11.014 02:09:45 -- host/perf.sh@114 -- # nvmftestfini 00:27:11.014 02:09:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:11.014 02:09:45 -- nvmf/common.sh@116 -- # sync 00:27:11.014 02:09:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:11.014 02:09:45 -- nvmf/common.sh@119 -- # set +e 00:27:11.014 02:09:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:11.014 02:09:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:11.014 rmmod nvme_tcp 00:27:11.015 rmmod nvme_fabrics 00:27:11.015 rmmod nvme_keyring 00:27:11.272 02:09:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:11.272 02:09:45 -- nvmf/common.sh@123 -- # set -e 00:27:11.272 02:09:45 -- nvmf/common.sh@124 -- # return 0 00:27:11.272 02:09:45 -- nvmf/common.sh@477 -- # '[' -n 1293090 ']' 00:27:11.272 02:09:45 -- nvmf/common.sh@478 -- # killprocess 1293090 00:27:11.272 02:09:45 -- common/autotest_common.sh@936 -- # '[' -z 1293090 ']' 00:27:11.272 02:09:45 -- common/autotest_common.sh@940 -- # kill -0 1293090 00:27:11.272 02:09:45 -- common/autotest_common.sh@941 -- # uname 00:27:11.272 02:09:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:11.272 02:09:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1293090 00:27:11.272 02:09:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:11.272 02:09:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:11.272 02:09:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1293090' 00:27:11.272 killing process with pid 1293090 00:27:11.272 02:09:45 -- common/autotest_common.sh@955 -- # kill 1293090 00:27:11.272 02:09:45 -- common/autotest_common.sh@960 -- # wait 1293090 00:27:13.175 02:09:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:13.175 02:09:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:13.175 02:09:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:13.175 02:09:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:13.175 02:09:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:13.175 02:09:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:13.175 02:09:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:13.175 02:09:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:15.083 02:09:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:15.083 00:27:15.083 real 1m32.205s 00:27:15.083 user 5m41.979s 00:27:15.083 sys 0m15.577s 00:27:15.083 02:09:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:15.083 02:09:49 -- common/autotest_common.sh@10 -- # set +x 00:27:15.083 ************************************ 00:27:15.083 END TEST nvmf_perf 00:27:15.083 ************************************ 00:27:15.083 02:09:49 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:15.083 02:09:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:15.083 02:09:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:15.083 02:09:49 -- common/autotest_common.sh@10 -- # set +x 00:27:15.083 ************************************ 00:27:15.083 START TEST nvmf_fio_host 00:27:15.083 ************************************ 00:27:15.083 02:09:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:15.083 * Looking for test storage... 00:27:15.083 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:15.083 02:09:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:15.083 02:09:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:15.083 02:09:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:15.083 02:09:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:15.083 02:09:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:15.083 02:09:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:15.083 02:09:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:15.083 02:09:49 -- scripts/common.sh@335 -- # IFS=.-: 00:27:15.083 02:09:49 -- scripts/common.sh@335 -- # read -ra ver1 00:27:15.083 02:09:49 -- scripts/common.sh@336 -- # IFS=.-: 00:27:15.083 02:09:49 -- scripts/common.sh@336 -- # read -ra ver2 00:27:15.083 02:09:49 -- scripts/common.sh@337 -- # local 'op=<' 00:27:15.083 02:09:49 -- scripts/common.sh@339 -- # ver1_l=2 00:27:15.083 02:09:49 -- scripts/common.sh@340 -- # ver2_l=1 00:27:15.083 02:09:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:15.083 02:09:49 -- scripts/common.sh@343 -- # case "$op" in 00:27:15.083 02:09:49 -- scripts/common.sh@344 -- # : 1 00:27:15.083 02:09:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:15.083 02:09:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:15.083 02:09:49 -- scripts/common.sh@364 -- # decimal 1 00:27:15.083 02:09:49 -- scripts/common.sh@352 -- # local d=1 00:27:15.083 02:09:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:15.083 02:09:49 -- scripts/common.sh@354 -- # echo 1 00:27:15.083 02:09:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:15.083 02:09:49 -- scripts/common.sh@365 -- # decimal 2 00:27:15.083 02:09:49 -- scripts/common.sh@352 -- # local d=2 00:27:15.083 02:09:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:15.083 02:09:49 -- scripts/common.sh@354 -- # echo 2 00:27:15.083 02:09:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:15.083 02:09:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:15.083 02:09:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:15.083 02:09:49 -- scripts/common.sh@367 -- # return 0 00:27:15.083 02:09:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:15.083 02:09:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:15.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:15.083 --rc genhtml_branch_coverage=1 00:27:15.083 --rc genhtml_function_coverage=1 00:27:15.083 --rc genhtml_legend=1 00:27:15.083 --rc geninfo_all_blocks=1 00:27:15.083 --rc geninfo_unexecuted_blocks=1 00:27:15.083 00:27:15.083 ' 00:27:15.083 02:09:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:15.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:15.083 --rc genhtml_branch_coverage=1 00:27:15.083 --rc genhtml_function_coverage=1 00:27:15.083 --rc genhtml_legend=1 00:27:15.083 --rc geninfo_all_blocks=1 00:27:15.083 --rc geninfo_unexecuted_blocks=1 00:27:15.083 00:27:15.083 ' 00:27:15.083 02:09:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:15.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:15.083 --rc genhtml_branch_coverage=1 00:27:15.083 --rc genhtml_function_coverage=1 00:27:15.083 --rc genhtml_legend=1 00:27:15.083 --rc geninfo_all_blocks=1 00:27:15.083 --rc geninfo_unexecuted_blocks=1 00:27:15.083 00:27:15.083 ' 00:27:15.083 02:09:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:15.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:15.083 --rc genhtml_branch_coverage=1 00:27:15.083 --rc genhtml_function_coverage=1 00:27:15.083 --rc genhtml_legend=1 00:27:15.083 --rc geninfo_all_blocks=1 00:27:15.083 --rc geninfo_unexecuted_blocks=1 00:27:15.083 00:27:15.083 ' 00:27:15.083 02:09:49 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:15.083 02:09:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:15.083 02:09:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:15.083 02:09:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:15.083 02:09:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.083 02:09:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.083 02:09:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.083 02:09:49 -- paths/export.sh@5 -- # export PATH 00:27:15.083 02:09:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.083 02:09:49 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:15.083 02:09:49 -- nvmf/common.sh@7 -- # uname -s 00:27:15.083 02:09:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:15.083 02:09:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:15.083 02:09:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:15.083 02:09:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:15.083 02:09:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:15.083 02:09:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:15.083 02:09:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:15.083 02:09:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:15.083 02:09:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:15.083 02:09:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:15.083 02:09:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:15.083 02:09:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:15.083 02:09:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:15.083 02:09:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:15.083 02:09:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:15.083 02:09:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:15.083 02:09:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:15.084 02:09:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:15.084 02:09:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:15.084 02:09:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.084 02:09:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.084 02:09:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.084 02:09:49 -- paths/export.sh@5 -- # export PATH 00:27:15.084 02:09:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.084 02:09:49 -- nvmf/common.sh@46 -- # : 0 00:27:15.084 02:09:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:15.084 02:09:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:15.084 02:09:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:15.084 02:09:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:15.084 02:09:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:15.084 02:09:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:15.084 02:09:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:15.084 02:09:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:15.084 02:09:49 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:15.084 02:09:49 -- host/fio.sh@14 -- # nvmftestinit 00:27:15.084 02:09:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:15.084 02:09:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:15.084 02:09:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:15.084 02:09:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:15.084 02:09:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:15.084 02:09:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:15.084 02:09:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:15.084 02:09:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:15.084 02:09:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:15.084 02:09:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:15.084 02:09:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:15.084 02:09:49 -- common/autotest_common.sh@10 -- # set +x 00:27:16.992 02:09:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:16.992 02:09:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:16.992 02:09:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:16.992 02:09:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:16.992 02:09:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:16.992 02:09:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:16.992 02:09:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:16.992 02:09:51 -- nvmf/common.sh@294 -- # net_devs=() 00:27:16.992 02:09:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:16.992 02:09:51 -- nvmf/common.sh@295 -- # e810=() 00:27:16.992 02:09:51 -- nvmf/common.sh@295 -- # local -ga e810 00:27:16.992 02:09:51 -- nvmf/common.sh@296 -- # x722=() 00:27:16.992 02:09:51 -- nvmf/common.sh@296 -- # local -ga x722 00:27:16.992 02:09:51 -- nvmf/common.sh@297 -- # mlx=() 00:27:16.992 02:09:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:16.992 02:09:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:16.992 02:09:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:16.992 02:09:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:16.992 02:09:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:16.992 02:09:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:16.992 02:09:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:16.992 02:09:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:16.992 02:09:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:16.992 02:09:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:16.992 02:09:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:16.992 02:09:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:16.992 02:09:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:16.992 02:09:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:16.992 02:09:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:16.992 02:09:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:16.992 02:09:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:16.992 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:16.992 02:09:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:16.992 02:09:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:16.992 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:16.992 02:09:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:16.992 02:09:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:16.992 02:09:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:16.992 02:09:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:16.992 02:09:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:16.992 02:09:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:16.992 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:16.992 02:09:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:16.992 02:09:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:16.992 02:09:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:16.992 02:09:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:16.992 02:09:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:16.992 02:09:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:16.992 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:16.992 02:09:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:16.992 02:09:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:16.992 02:09:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:16.992 02:09:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:16.992 02:09:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:16.992 02:09:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:16.992 02:09:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:16.992 02:09:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:16.992 02:09:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:16.992 02:09:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:16.992 02:09:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:16.992 02:09:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:16.992 02:09:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:16.992 02:09:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:16.992 02:09:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:16.992 02:09:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:16.992 02:09:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:16.992 02:09:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:16.992 02:09:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:16.992 02:09:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:16.992 02:09:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:16.992 02:09:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:16.992 02:09:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:16.992 02:09:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:16.992 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:16.992 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:27:16.992 00:27:16.992 --- 10.0.0.2 ping statistics --- 00:27:16.992 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:16.992 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:27:16.992 02:09:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:16.992 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:16.992 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:27:16.992 00:27:16.992 --- 10.0.0.1 ping statistics --- 00:27:16.992 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:16.992 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:27:16.992 02:09:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:16.992 02:09:51 -- nvmf/common.sh@410 -- # return 0 00:27:16.992 02:09:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:16.992 02:09:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:16.992 02:09:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:16.992 02:09:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:16.992 02:09:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:16.992 02:09:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:16.992 02:09:51 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:16.992 02:09:51 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:16.992 02:09:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:16.992 02:09:51 -- common/autotest_common.sh@10 -- # set +x 00:27:16.992 02:09:51 -- host/fio.sh@24 -- # nvmfpid=1306160 00:27:16.992 02:09:51 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:16.992 02:09:51 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:16.992 02:09:51 -- host/fio.sh@28 -- # waitforlisten 1306160 00:27:16.992 02:09:51 -- common/autotest_common.sh@829 -- # '[' -z 1306160 ']' 00:27:16.992 02:09:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:16.992 02:09:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:16.992 02:09:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:16.992 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:16.992 02:09:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:16.992 02:09:51 -- common/autotest_common.sh@10 -- # set +x 00:27:17.251 [2024-11-18 02:09:51.431903] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:17.251 [2024-11-18 02:09:51.431986] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:17.251 EAL: No free 2048 kB hugepages reported on node 1 00:27:17.251 [2024-11-18 02:09:51.495250] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:17.251 [2024-11-18 02:09:51.581954] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:17.251 [2024-11-18 02:09:51.582104] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:17.251 [2024-11-18 02:09:51.582122] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:17.251 [2024-11-18 02:09:51.582134] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:17.251 [2024-11-18 02:09:51.582202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:17.251 [2024-11-18 02:09:51.582231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:17.251 [2024-11-18 02:09:51.582298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:17.251 [2024-11-18 02:09:51.582300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:18.186 02:09:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:18.186 02:09:52 -- common/autotest_common.sh@862 -- # return 0 00:27:18.186 02:09:52 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:18.444 [2024-11-18 02:09:52.667749] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:18.444 02:09:52 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:18.444 02:09:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:18.444 02:09:52 -- common/autotest_common.sh@10 -- # set +x 00:27:18.444 02:09:52 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:18.703 Malloc1 00:27:18.703 02:09:52 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:18.962 02:09:53 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:19.220 02:09:53 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:19.478 [2024-11-18 02:09:53.738024] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:19.478 02:09:53 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:19.736 02:09:54 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:19.736 02:09:54 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:19.736 02:09:54 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:19.736 02:09:54 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:19.736 02:09:54 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:19.736 02:09:54 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:19.736 02:09:54 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:19.736 02:09:54 -- common/autotest_common.sh@1330 -- # shift 00:27:19.736 02:09:54 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:19.736 02:09:54 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:19.736 02:09:54 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:19.736 02:09:54 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:19.736 02:09:54 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:19.736 02:09:54 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:19.736 02:09:54 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:19.736 02:09:54 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:19.736 02:09:54 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:19.736 02:09:54 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:19.736 02:09:54 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:19.736 02:09:54 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:19.736 02:09:54 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:19.736 02:09:54 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:19.736 02:09:54 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:19.996 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:19.996 fio-3.35 00:27:19.996 Starting 1 thread 00:27:19.996 EAL: No free 2048 kB hugepages reported on node 1 00:27:22.546 00:27:22.546 test: (groupid=0, jobs=1): err= 0: pid=1306651: Mon Nov 18 02:09:56 2024 00:27:22.546 read: IOPS=9591, BW=37.5MiB/s (39.3MB/s)(75.2MiB/2006msec) 00:27:22.546 slat (nsec): min=1841, max=114485, avg=2395.60, stdev=1451.00 00:27:22.546 clat (usec): min=2229, max=12972, avg=7364.51, stdev=547.86 00:27:22.546 lat (usec): min=2250, max=12974, avg=7366.90, stdev=547.78 00:27:22.546 clat percentiles (usec): 00:27:22.546 | 1.00th=[ 6128], 5.00th=[ 6521], 10.00th=[ 6718], 20.00th=[ 6980], 00:27:22.546 | 30.00th=[ 7111], 40.00th=[ 7242], 50.00th=[ 7373], 60.00th=[ 7504], 00:27:22.546 | 70.00th=[ 7635], 80.00th=[ 7767], 90.00th=[ 7963], 95.00th=[ 8225], 00:27:22.546 | 99.00th=[ 8586], 99.50th=[ 8717], 99.90th=[10945], 99.95th=[11600], 00:27:22.546 | 99.99th=[12780] 00:27:22.546 bw ( KiB/s): min=37280, max=38952, per=99.91%, avg=38334.00, stdev=762.60, samples=4 00:27:22.546 iops : min= 9320, max= 9738, avg=9583.50, stdev=190.65, samples=4 00:27:22.546 write: IOPS=9597, BW=37.5MiB/s (39.3MB/s)(75.2MiB/2006msec); 0 zone resets 00:27:22.546 slat (nsec): min=1967, max=93870, avg=2545.27, stdev=1294.03 00:27:22.546 clat (usec): min=1126, max=10795, avg=5914.98, stdev=469.73 00:27:22.546 lat (usec): min=1133, max=10798, avg=5917.53, stdev=469.68 00:27:22.546 clat percentiles (usec): 00:27:22.546 | 1.00th=[ 4883], 5.00th=[ 5211], 10.00th=[ 5407], 20.00th=[ 5538], 00:27:22.546 | 30.00th=[ 5669], 40.00th=[ 5800], 50.00th=[ 5932], 60.00th=[ 5997], 00:27:22.546 | 70.00th=[ 6128], 80.00th=[ 6259], 90.00th=[ 6456], 95.00th=[ 6587], 00:27:22.546 | 99.00th=[ 6915], 99.50th=[ 7046], 99.90th=[ 9110], 99.95th=[ 9765], 00:27:22.546 | 99.99th=[10814] 00:27:22.546 bw ( KiB/s): min=38024, max=38776, per=100.00%, avg=38400.00, stdev=324.30, samples=4 00:27:22.546 iops : min= 9506, max= 9694, avg=9600.00, stdev=81.08, samples=4 00:27:22.546 lat (msec) : 2=0.02%, 4=0.10%, 10=99.79%, 20=0.08% 00:27:22.546 cpu : usr=66.08%, sys=32.07%, ctx=75, majf=0, minf=36 00:27:22.546 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:22.546 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:22.546 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:22.546 issued rwts: total=19241,19253,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:22.546 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:22.546 00:27:22.546 Run status group 0 (all jobs): 00:27:22.546 READ: bw=37.5MiB/s (39.3MB/s), 37.5MiB/s-37.5MiB/s (39.3MB/s-39.3MB/s), io=75.2MiB (78.8MB), run=2006-2006msec 00:27:22.546 WRITE: bw=37.5MiB/s (39.3MB/s), 37.5MiB/s-37.5MiB/s (39.3MB/s-39.3MB/s), io=75.2MiB (78.9MB), run=2006-2006msec 00:27:22.546 02:09:56 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:22.546 02:09:56 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:22.546 02:09:56 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:22.546 02:09:56 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:22.546 02:09:56 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:22.546 02:09:56 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:22.546 02:09:56 -- common/autotest_common.sh@1330 -- # shift 00:27:22.546 02:09:56 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:22.546 02:09:56 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:22.546 02:09:56 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:22.546 02:09:56 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:22.546 02:09:56 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:22.546 02:09:56 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:22.546 02:09:56 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:22.546 02:09:56 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:22.546 02:09:56 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:22.546 02:09:56 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:22.546 02:09:56 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:22.546 02:09:56 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:22.546 02:09:56 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:22.546 02:09:56 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:22.546 02:09:56 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:22.546 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:22.546 fio-3.35 00:27:22.546 Starting 1 thread 00:27:22.546 EAL: No free 2048 kB hugepages reported on node 1 00:27:25.077 00:27:25.077 test: (groupid=0, jobs=1): err= 0: pid=1307003: Mon Nov 18 02:09:59 2024 00:27:25.077 read: IOPS=9000, BW=141MiB/s (147MB/s)(282MiB/2006msec) 00:27:25.077 slat (nsec): min=2698, max=91193, avg=3686.47, stdev=1946.92 00:27:25.077 clat (usec): min=2331, max=15659, avg=8239.54, stdev=1845.48 00:27:25.077 lat (usec): min=2334, max=15661, avg=8243.23, stdev=1845.54 00:27:25.077 clat percentiles (usec): 00:27:25.077 | 1.00th=[ 4490], 5.00th=[ 5276], 10.00th=[ 5800], 20.00th=[ 6521], 00:27:25.077 | 30.00th=[ 7177], 40.00th=[ 7767], 50.00th=[ 8356], 60.00th=[ 8848], 00:27:25.077 | 70.00th=[ 9372], 80.00th=[ 9765], 90.00th=[10421], 95.00th=[11076], 00:27:25.077 | 99.00th=[12911], 99.50th=[13566], 99.90th=[14877], 99.95th=[15270], 00:27:25.077 | 99.99th=[15664] 00:27:25.077 bw ( KiB/s): min=66208, max=82688, per=50.92%, avg=73336.00, stdev=7789.68, samples=4 00:27:25.077 iops : min= 4138, max= 5168, avg=4583.50, stdev=486.85, samples=4 00:27:25.077 write: IOPS=5430, BW=84.9MiB/s (89.0MB/s)(149MiB/1759msec); 0 zone resets 00:27:25.077 slat (usec): min=30, max=188, avg=34.31, stdev= 6.20 00:27:25.077 clat (usec): min=4517, max=18040, avg=10627.78, stdev=1876.03 00:27:25.077 lat (usec): min=4548, max=18087, avg=10662.08, stdev=1876.37 00:27:25.077 clat percentiles (usec): 00:27:25.077 | 1.00th=[ 7111], 5.00th=[ 8029], 10.00th=[ 8455], 20.00th=[ 8979], 00:27:25.077 | 30.00th=[ 9503], 40.00th=[ 9896], 50.00th=[10421], 60.00th=[10814], 00:27:25.077 | 70.00th=[11469], 80.00th=[12256], 90.00th=[13304], 95.00th=[14091], 00:27:25.077 | 99.00th=[15401], 99.50th=[16057], 99.90th=[17695], 99.95th=[17695], 00:27:25.077 | 99.99th=[17957] 00:27:25.077 bw ( KiB/s): min=69408, max=85024, per=87.95%, avg=76424.00, stdev=7465.51, samples=4 00:27:25.077 iops : min= 4338, max= 5314, avg=4776.50, stdev=466.59, samples=4 00:27:25.077 lat (msec) : 4=0.29%, 10=69.71%, 20=30.00% 00:27:25.077 cpu : usr=79.36%, sys=19.49%, ctx=30, majf=0, minf=62 00:27:25.077 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:27:25.077 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:25.077 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:25.077 issued rwts: total=18056,9553,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:25.077 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:25.077 00:27:25.077 Run status group 0 (all jobs): 00:27:25.077 READ: bw=141MiB/s (147MB/s), 141MiB/s-141MiB/s (147MB/s-147MB/s), io=282MiB (296MB), run=2006-2006msec 00:27:25.077 WRITE: bw=84.9MiB/s (89.0MB/s), 84.9MiB/s-84.9MiB/s (89.0MB/s-89.0MB/s), io=149MiB (157MB), run=1759-1759msec 00:27:25.077 02:09:59 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:25.077 02:09:59 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:25.077 02:09:59 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:25.077 02:09:59 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:25.077 02:09:59 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:25.077 02:09:59 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:25.077 02:09:59 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:25.077 02:09:59 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:25.077 02:09:59 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:25.334 02:09:59 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:25.334 02:09:59 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:25.334 02:09:59 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:28.613 Nvme0n1 00:27:28.613 02:10:02 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:31.138 02:10:05 -- host/fio.sh@53 -- # ls_guid=23d43bb9-0b93-4433-8742-6931d41f4a31 00:27:31.138 02:10:05 -- host/fio.sh@54 -- # get_lvs_free_mb 23d43bb9-0b93-4433-8742-6931d41f4a31 00:27:31.138 02:10:05 -- common/autotest_common.sh@1353 -- # local lvs_uuid=23d43bb9-0b93-4433-8742-6931d41f4a31 00:27:31.138 02:10:05 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:31.138 02:10:05 -- common/autotest_common.sh@1355 -- # local fc 00:27:31.138 02:10:05 -- common/autotest_common.sh@1356 -- # local cs 00:27:31.138 02:10:05 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:31.395 02:10:05 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:31.395 { 00:27:31.395 "uuid": "23d43bb9-0b93-4433-8742-6931d41f4a31", 00:27:31.395 "name": "lvs_0", 00:27:31.395 "base_bdev": "Nvme0n1", 00:27:31.395 "total_data_clusters": 930, 00:27:31.395 "free_clusters": 930, 00:27:31.395 "block_size": 512, 00:27:31.395 "cluster_size": 1073741824 00:27:31.395 } 00:27:31.395 ]' 00:27:31.396 02:10:05 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="23d43bb9-0b93-4433-8742-6931d41f4a31") .free_clusters' 00:27:31.396 02:10:05 -- common/autotest_common.sh@1358 -- # fc=930 00:27:31.396 02:10:05 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="23d43bb9-0b93-4433-8742-6931d41f4a31") .cluster_size' 00:27:31.653 02:10:05 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:27:31.653 02:10:05 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:27:31.653 02:10:05 -- common/autotest_common.sh@1363 -- # echo 952320 00:27:31.653 952320 00:27:31.653 02:10:05 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:31.911 3e8124b4-2c63-46a4-9eb8-294eaabffcef 00:27:31.911 02:10:06 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:32.169 02:10:06 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:32.427 02:10:06 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:32.685 02:10:06 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:32.685 02:10:06 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:32.685 02:10:06 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:32.685 02:10:06 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:32.685 02:10:06 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:32.685 02:10:06 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:32.685 02:10:06 -- common/autotest_common.sh@1330 -- # shift 00:27:32.685 02:10:06 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:32.685 02:10:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:32.685 02:10:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:32.685 02:10:06 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:32.685 02:10:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:32.685 02:10:07 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:32.685 02:10:07 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:32.685 02:10:07 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:32.685 02:10:07 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:32.685 02:10:07 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:32.685 02:10:07 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:32.685 02:10:07 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:32.685 02:10:07 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:32.685 02:10:07 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:32.685 02:10:07 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:32.943 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:32.943 fio-3.35 00:27:32.943 Starting 1 thread 00:27:32.943 EAL: No free 2048 kB hugepages reported on node 1 00:27:35.469 00:27:35.469 test: (groupid=0, jobs=1): err= 0: pid=1308320: Mon Nov 18 02:10:09 2024 00:27:35.469 read: IOPS=6368, BW=24.9MiB/s (26.1MB/s)(49.9MiB/2007msec) 00:27:35.469 slat (nsec): min=1943, max=163089, avg=2573.75, stdev=2144.38 00:27:35.469 clat (usec): min=954, max=170776, avg=11021.18, stdev=11324.34 00:27:35.469 lat (usec): min=958, max=170815, avg=11023.75, stdev=11324.72 00:27:35.469 clat percentiles (msec): 00:27:35.469 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:27:35.469 | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:27:35.469 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:27:35.469 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:27:35.469 | 99.99th=[ 171] 00:27:35.469 bw ( KiB/s): min=17712, max=28160, per=99.81%, avg=25424.00, stdev=5142.87, samples=4 00:27:35.469 iops : min= 4428, max= 7040, avg=6356.00, stdev=1285.72, samples=4 00:27:35.469 write: IOPS=6369, BW=24.9MiB/s (26.1MB/s)(49.9MiB/2007msec); 0 zone resets 00:27:35.469 slat (usec): min=2, max=134, avg= 2.67, stdev= 1.57 00:27:35.469 clat (usec): min=248, max=168437, avg=8887.61, stdev=10615.76 00:27:35.469 lat (usec): min=252, max=168445, avg=8890.28, stdev=10616.12 00:27:35.469 clat percentiles (msec): 00:27:35.469 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:27:35.469 | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:27:35.469 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:27:35.469 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:27:35.469 | 99.99th=[ 169] 00:27:35.469 bw ( KiB/s): min=18728, max=27840, per=99.89%, avg=25450.00, stdev=4482.65, samples=4 00:27:35.469 iops : min= 4682, max= 6960, avg=6362.50, stdev=1120.66, samples=4 00:27:35.469 lat (usec) : 250=0.01%, 750=0.01%, 1000=0.01% 00:27:35.469 lat (msec) : 2=0.04%, 4=0.13%, 10=68.88%, 20=30.44%, 250=0.50% 00:27:35.469 cpu : usr=65.00%, sys=33.65%, ctx=98, majf=0, minf=36 00:27:35.469 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:35.469 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:35.469 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:35.469 issued rwts: total=12781,12783,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:35.469 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:35.469 00:27:35.469 Run status group 0 (all jobs): 00:27:35.469 READ: bw=24.9MiB/s (26.1MB/s), 24.9MiB/s-24.9MiB/s (26.1MB/s-26.1MB/s), io=49.9MiB (52.3MB), run=2007-2007msec 00:27:35.469 WRITE: bw=24.9MiB/s (26.1MB/s), 24.9MiB/s-24.9MiB/s (26.1MB/s-26.1MB/s), io=49.9MiB (52.4MB), run=2007-2007msec 00:27:35.469 02:10:09 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:35.469 02:10:09 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:27:36.841 02:10:11 -- host/fio.sh@64 -- # ls_nested_guid=88d02645-1db2-4d2f-a9f2-00505c5ce659 00:27:36.841 02:10:11 -- host/fio.sh@65 -- # get_lvs_free_mb 88d02645-1db2-4d2f-a9f2-00505c5ce659 00:27:36.841 02:10:11 -- common/autotest_common.sh@1353 -- # local lvs_uuid=88d02645-1db2-4d2f-a9f2-00505c5ce659 00:27:36.841 02:10:11 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:36.841 02:10:11 -- common/autotest_common.sh@1355 -- # local fc 00:27:36.841 02:10:11 -- common/autotest_common.sh@1356 -- # local cs 00:27:36.841 02:10:11 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:37.099 02:10:11 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:37.099 { 00:27:37.099 "uuid": "23d43bb9-0b93-4433-8742-6931d41f4a31", 00:27:37.099 "name": "lvs_0", 00:27:37.099 "base_bdev": "Nvme0n1", 00:27:37.099 "total_data_clusters": 930, 00:27:37.099 "free_clusters": 0, 00:27:37.099 "block_size": 512, 00:27:37.099 "cluster_size": 1073741824 00:27:37.099 }, 00:27:37.099 { 00:27:37.099 "uuid": "88d02645-1db2-4d2f-a9f2-00505c5ce659", 00:27:37.099 "name": "lvs_n_0", 00:27:37.099 "base_bdev": "3e8124b4-2c63-46a4-9eb8-294eaabffcef", 00:27:37.099 "total_data_clusters": 237847, 00:27:37.099 "free_clusters": 237847, 00:27:37.099 "block_size": 512, 00:27:37.099 "cluster_size": 4194304 00:27:37.099 } 00:27:37.099 ]' 00:27:37.099 02:10:11 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="88d02645-1db2-4d2f-a9f2-00505c5ce659") .free_clusters' 00:27:37.099 02:10:11 -- common/autotest_common.sh@1358 -- # fc=237847 00:27:37.099 02:10:11 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="88d02645-1db2-4d2f-a9f2-00505c5ce659") .cluster_size' 00:27:37.099 02:10:11 -- common/autotest_common.sh@1359 -- # cs=4194304 00:27:37.099 02:10:11 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:27:37.099 02:10:11 -- common/autotest_common.sh@1363 -- # echo 951388 00:27:37.099 951388 00:27:37.099 02:10:11 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:27:37.700 813fdd2a-0a81-4905-9b67-dfa3a08b44cb 00:27:37.700 02:10:12 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:27:37.982 02:10:12 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:27:38.240 02:10:12 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:27:38.497 02:10:12 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:38.497 02:10:12 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:38.497 02:10:12 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:38.497 02:10:12 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:38.497 02:10:12 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:38.497 02:10:12 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:38.497 02:10:12 -- common/autotest_common.sh@1330 -- # shift 00:27:38.497 02:10:12 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:38.497 02:10:12 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:38.497 02:10:12 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:38.497 02:10:12 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:38.497 02:10:12 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:38.497 02:10:12 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:38.497 02:10:12 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:38.497 02:10:12 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:38.497 02:10:12 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:38.497 02:10:12 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:38.497 02:10:12 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:38.497 02:10:12 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:38.497 02:10:12 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:38.497 02:10:12 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:38.497 02:10:12 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:38.756 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:38.756 fio-3.35 00:27:38.756 Starting 1 thread 00:27:38.756 EAL: No free 2048 kB hugepages reported on node 1 00:27:41.283 00:27:41.283 test: (groupid=0, jobs=1): err= 0: pid=1309115: Mon Nov 18 02:10:15 2024 00:27:41.283 read: IOPS=5911, BW=23.1MiB/s (24.2MB/s)(46.4MiB/2008msec) 00:27:41.283 slat (nsec): min=1935, max=154757, avg=2673.56, stdev=2338.96 00:27:41.283 clat (usec): min=4200, max=19598, avg=11915.39, stdev=1046.33 00:27:41.283 lat (usec): min=4213, max=19614, avg=11918.06, stdev=1046.27 00:27:41.283 clat percentiles (usec): 00:27:41.283 | 1.00th=[ 9634], 5.00th=[10290], 10.00th=[10683], 20.00th=[11076], 00:27:41.283 | 30.00th=[11469], 40.00th=[11731], 50.00th=[11994], 60.00th=[12125], 00:27:41.283 | 70.00th=[12387], 80.00th=[12780], 90.00th=[13173], 95.00th=[13566], 00:27:41.283 | 99.00th=[14091], 99.50th=[14484], 99.90th=[18482], 99.95th=[18744], 00:27:41.283 | 99.99th=[19530] 00:27:41.283 bw ( KiB/s): min=22912, max=24112, per=99.86%, avg=23612.00, stdev=503.49, samples=4 00:27:41.283 iops : min= 5728, max= 6028, avg=5903.00, stdev=125.87, samples=4 00:27:41.283 write: IOPS=5910, BW=23.1MiB/s (24.2MB/s)(46.4MiB/2008msec); 0 zone resets 00:27:41.283 slat (usec): min=2, max=132, avg= 2.75, stdev= 1.93 00:27:41.283 clat (usec): min=2024, max=16958, avg=9643.09, stdev=877.63 00:27:41.283 lat (usec): min=2033, max=16960, avg=9645.84, stdev=877.62 00:27:41.283 clat percentiles (usec): 00:27:41.283 | 1.00th=[ 7701], 5.00th=[ 8356], 10.00th=[ 8586], 20.00th=[ 8979], 00:27:41.283 | 30.00th=[ 9241], 40.00th=[ 9503], 50.00th=[ 9634], 60.00th=[ 9896], 00:27:41.283 | 70.00th=[10028], 80.00th=[10290], 90.00th=[10683], 95.00th=[10945], 00:27:41.283 | 99.00th=[11600], 99.50th=[11863], 99.90th=[14353], 99.95th=[15795], 00:27:41.283 | 99.99th=[16909] 00:27:41.283 bw ( KiB/s): min=23424, max=23816, per=99.87%, avg=23612.00, stdev=171.89, samples=4 00:27:41.283 iops : min= 5856, max= 5954, avg=5903.00, stdev=42.97, samples=4 00:27:41.283 lat (msec) : 4=0.04%, 10=35.12%, 20=64.84% 00:27:41.283 cpu : usr=60.99%, sys=37.57%, ctx=57, majf=0, minf=36 00:27:41.283 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:41.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:41.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:41.284 issued rwts: total=11870,11869,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:41.284 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:41.284 00:27:41.284 Run status group 0 (all jobs): 00:27:41.284 READ: bw=23.1MiB/s (24.2MB/s), 23.1MiB/s-23.1MiB/s (24.2MB/s-24.2MB/s), io=46.4MiB (48.6MB), run=2008-2008msec 00:27:41.284 WRITE: bw=23.1MiB/s (24.2MB/s), 23.1MiB/s-23.1MiB/s (24.2MB/s-24.2MB/s), io=46.4MiB (48.6MB), run=2008-2008msec 00:27:41.284 02:10:15 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:27:41.542 02:10:15 -- host/fio.sh@74 -- # sync 00:27:41.542 02:10:15 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:27:45.729 02:10:19 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:45.729 02:10:19 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:27:49.015 02:10:22 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:49.015 02:10:22 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:27:50.917 02:10:24 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:27:50.917 02:10:24 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:27:50.917 02:10:24 -- host/fio.sh@86 -- # nvmftestfini 00:27:50.917 02:10:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:50.917 02:10:24 -- nvmf/common.sh@116 -- # sync 00:27:50.917 02:10:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:50.917 02:10:24 -- nvmf/common.sh@119 -- # set +e 00:27:50.917 02:10:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:50.917 02:10:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:50.917 rmmod nvme_tcp 00:27:50.917 rmmod nvme_fabrics 00:27:50.917 rmmod nvme_keyring 00:27:50.917 02:10:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:50.917 02:10:24 -- nvmf/common.sh@123 -- # set -e 00:27:50.917 02:10:24 -- nvmf/common.sh@124 -- # return 0 00:27:50.917 02:10:24 -- nvmf/common.sh@477 -- # '[' -n 1306160 ']' 00:27:50.917 02:10:24 -- nvmf/common.sh@478 -- # killprocess 1306160 00:27:50.917 02:10:24 -- common/autotest_common.sh@936 -- # '[' -z 1306160 ']' 00:27:50.917 02:10:24 -- common/autotest_common.sh@940 -- # kill -0 1306160 00:27:50.917 02:10:24 -- common/autotest_common.sh@941 -- # uname 00:27:50.917 02:10:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:50.917 02:10:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1306160 00:27:50.917 02:10:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:50.917 02:10:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:50.917 02:10:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1306160' 00:27:50.917 killing process with pid 1306160 00:27:50.917 02:10:24 -- common/autotest_common.sh@955 -- # kill 1306160 00:27:50.917 02:10:24 -- common/autotest_common.sh@960 -- # wait 1306160 00:27:50.917 02:10:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:50.917 02:10:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:50.917 02:10:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:50.917 02:10:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:50.917 02:10:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:50.917 02:10:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:50.917 02:10:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:50.917 02:10:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:52.824 02:10:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:53.085 00:27:53.085 real 0m38.078s 00:27:53.085 user 2m26.567s 00:27:53.085 sys 0m6.799s 00:27:53.085 02:10:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:53.085 02:10:27 -- common/autotest_common.sh@10 -- # set +x 00:27:53.085 ************************************ 00:27:53.085 END TEST nvmf_fio_host 00:27:53.085 ************************************ 00:27:53.085 02:10:27 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:53.085 02:10:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:53.085 02:10:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:53.085 02:10:27 -- common/autotest_common.sh@10 -- # set +x 00:27:53.085 ************************************ 00:27:53.085 START TEST nvmf_failover 00:27:53.085 ************************************ 00:27:53.085 02:10:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:53.085 * Looking for test storage... 00:27:53.085 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:53.085 02:10:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:53.085 02:10:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:53.085 02:10:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:53.085 02:10:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:53.085 02:10:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:53.085 02:10:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:53.085 02:10:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:53.085 02:10:27 -- scripts/common.sh@335 -- # IFS=.-: 00:27:53.085 02:10:27 -- scripts/common.sh@335 -- # read -ra ver1 00:27:53.085 02:10:27 -- scripts/common.sh@336 -- # IFS=.-: 00:27:53.085 02:10:27 -- scripts/common.sh@336 -- # read -ra ver2 00:27:53.085 02:10:27 -- scripts/common.sh@337 -- # local 'op=<' 00:27:53.085 02:10:27 -- scripts/common.sh@339 -- # ver1_l=2 00:27:53.085 02:10:27 -- scripts/common.sh@340 -- # ver2_l=1 00:27:53.085 02:10:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:53.085 02:10:27 -- scripts/common.sh@343 -- # case "$op" in 00:27:53.085 02:10:27 -- scripts/common.sh@344 -- # : 1 00:27:53.085 02:10:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:53.085 02:10:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:53.085 02:10:27 -- scripts/common.sh@364 -- # decimal 1 00:27:53.085 02:10:27 -- scripts/common.sh@352 -- # local d=1 00:27:53.085 02:10:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:53.085 02:10:27 -- scripts/common.sh@354 -- # echo 1 00:27:53.085 02:10:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:53.085 02:10:27 -- scripts/common.sh@365 -- # decimal 2 00:27:53.085 02:10:27 -- scripts/common.sh@352 -- # local d=2 00:27:53.085 02:10:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:53.085 02:10:27 -- scripts/common.sh@354 -- # echo 2 00:27:53.085 02:10:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:53.085 02:10:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:53.085 02:10:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:53.085 02:10:27 -- scripts/common.sh@367 -- # return 0 00:27:53.085 02:10:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:53.085 02:10:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:53.085 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:53.085 --rc genhtml_branch_coverage=1 00:27:53.085 --rc genhtml_function_coverage=1 00:27:53.085 --rc genhtml_legend=1 00:27:53.085 --rc geninfo_all_blocks=1 00:27:53.085 --rc geninfo_unexecuted_blocks=1 00:27:53.085 00:27:53.085 ' 00:27:53.085 02:10:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:53.085 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:53.085 --rc genhtml_branch_coverage=1 00:27:53.085 --rc genhtml_function_coverage=1 00:27:53.085 --rc genhtml_legend=1 00:27:53.085 --rc geninfo_all_blocks=1 00:27:53.085 --rc geninfo_unexecuted_blocks=1 00:27:53.085 00:27:53.085 ' 00:27:53.085 02:10:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:53.085 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:53.085 --rc genhtml_branch_coverage=1 00:27:53.085 --rc genhtml_function_coverage=1 00:27:53.085 --rc genhtml_legend=1 00:27:53.085 --rc geninfo_all_blocks=1 00:27:53.085 --rc geninfo_unexecuted_blocks=1 00:27:53.085 00:27:53.085 ' 00:27:53.085 02:10:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:53.085 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:53.085 --rc genhtml_branch_coverage=1 00:27:53.085 --rc genhtml_function_coverage=1 00:27:53.085 --rc genhtml_legend=1 00:27:53.085 --rc geninfo_all_blocks=1 00:27:53.085 --rc geninfo_unexecuted_blocks=1 00:27:53.085 00:27:53.085 ' 00:27:53.085 02:10:27 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:53.085 02:10:27 -- nvmf/common.sh@7 -- # uname -s 00:27:53.085 02:10:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:53.085 02:10:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:53.085 02:10:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:53.085 02:10:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:53.086 02:10:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:53.086 02:10:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:53.086 02:10:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:53.086 02:10:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:53.086 02:10:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:53.086 02:10:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:53.086 02:10:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:53.086 02:10:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:53.086 02:10:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:53.086 02:10:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:53.086 02:10:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:53.086 02:10:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:53.086 02:10:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:53.086 02:10:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:53.086 02:10:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:53.086 02:10:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.086 02:10:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.086 02:10:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.086 02:10:27 -- paths/export.sh@5 -- # export PATH 00:27:53.086 02:10:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.086 02:10:27 -- nvmf/common.sh@46 -- # : 0 00:27:53.086 02:10:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:53.086 02:10:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:53.086 02:10:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:53.086 02:10:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:53.086 02:10:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:53.086 02:10:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:53.086 02:10:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:53.086 02:10:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:53.086 02:10:27 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:53.086 02:10:27 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:53.086 02:10:27 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:53.086 02:10:27 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:27:53.086 02:10:27 -- host/failover.sh@18 -- # nvmftestinit 00:27:53.086 02:10:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:53.086 02:10:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:53.086 02:10:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:53.086 02:10:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:53.086 02:10:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:53.086 02:10:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:53.086 02:10:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:53.086 02:10:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:53.086 02:10:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:53.086 02:10:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:53.086 02:10:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:53.086 02:10:27 -- common/autotest_common.sh@10 -- # set +x 00:27:54.988 02:10:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:54.988 02:10:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:54.988 02:10:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:54.988 02:10:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:54.988 02:10:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:54.988 02:10:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:54.988 02:10:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:54.988 02:10:29 -- nvmf/common.sh@294 -- # net_devs=() 00:27:54.988 02:10:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:54.988 02:10:29 -- nvmf/common.sh@295 -- # e810=() 00:27:54.988 02:10:29 -- nvmf/common.sh@295 -- # local -ga e810 00:27:54.988 02:10:29 -- nvmf/common.sh@296 -- # x722=() 00:27:54.988 02:10:29 -- nvmf/common.sh@296 -- # local -ga x722 00:27:54.988 02:10:29 -- nvmf/common.sh@297 -- # mlx=() 00:27:54.988 02:10:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:54.988 02:10:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:54.988 02:10:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:54.988 02:10:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:54.988 02:10:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:54.988 02:10:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:54.988 02:10:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:54.988 02:10:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:54.988 02:10:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:54.988 02:10:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:54.988 02:10:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:54.988 02:10:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:54.988 02:10:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:54.988 02:10:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:54.988 02:10:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:54.988 02:10:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:54.988 02:10:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:54.988 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:54.988 02:10:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:54.988 02:10:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:54.988 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:54.988 02:10:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:54.988 02:10:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:54.988 02:10:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:54.988 02:10:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:54.988 02:10:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:54.988 02:10:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:54.988 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:54.988 02:10:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:54.988 02:10:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:54.988 02:10:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:54.988 02:10:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:54.988 02:10:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:54.988 02:10:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:54.988 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:54.988 02:10:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:54.988 02:10:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:54.988 02:10:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:54.988 02:10:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:54.988 02:10:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:54.988 02:10:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:54.988 02:10:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:54.988 02:10:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:54.988 02:10:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:54.988 02:10:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:54.988 02:10:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:54.988 02:10:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:54.988 02:10:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:54.988 02:10:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:54.988 02:10:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:54.988 02:10:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:54.988 02:10:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:54.988 02:10:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:54.988 02:10:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:54.988 02:10:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:54.988 02:10:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:54.988 02:10:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:55.245 02:10:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:55.245 02:10:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:55.245 02:10:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:55.245 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:55.245 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.148 ms 00:27:55.245 00:27:55.245 --- 10.0.0.2 ping statistics --- 00:27:55.245 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:55.246 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:27:55.246 02:10:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:55.246 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:55.246 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:27:55.246 00:27:55.246 --- 10.0.0.1 ping statistics --- 00:27:55.246 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:55.246 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:27:55.246 02:10:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:55.246 02:10:29 -- nvmf/common.sh@410 -- # return 0 00:27:55.246 02:10:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:55.246 02:10:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:55.246 02:10:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:55.246 02:10:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:55.246 02:10:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:55.246 02:10:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:55.246 02:10:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:55.246 02:10:29 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:27:55.246 02:10:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:55.246 02:10:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:55.246 02:10:29 -- common/autotest_common.sh@10 -- # set +x 00:27:55.246 02:10:29 -- nvmf/common.sh@469 -- # nvmfpid=1312503 00:27:55.246 02:10:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:55.246 02:10:29 -- nvmf/common.sh@470 -- # waitforlisten 1312503 00:27:55.246 02:10:29 -- common/autotest_common.sh@829 -- # '[' -z 1312503 ']' 00:27:55.246 02:10:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:55.246 02:10:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:55.246 02:10:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:55.246 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:55.246 02:10:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:55.246 02:10:29 -- common/autotest_common.sh@10 -- # set +x 00:27:55.246 [2024-11-18 02:10:29.499542] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:55.246 [2024-11-18 02:10:29.499631] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:55.246 EAL: No free 2048 kB hugepages reported on node 1 00:27:55.246 [2024-11-18 02:10:29.568116] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:55.504 [2024-11-18 02:10:29.658399] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:55.504 [2024-11-18 02:10:29.658562] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:55.504 [2024-11-18 02:10:29.658583] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:55.504 [2024-11-18 02:10:29.658597] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:55.504 [2024-11-18 02:10:29.658718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:55.504 [2024-11-18 02:10:29.658768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:55.504 [2024-11-18 02:10:29.658770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:56.437 02:10:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:56.437 02:10:30 -- common/autotest_common.sh@862 -- # return 0 00:27:56.437 02:10:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:56.437 02:10:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:56.437 02:10:30 -- common/autotest_common.sh@10 -- # set +x 00:27:56.437 02:10:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:56.437 02:10:30 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:56.437 [2024-11-18 02:10:30.815442] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:56.437 02:10:30 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:27:57.003 Malloc0 00:27:57.003 02:10:31 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:57.261 02:10:31 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:57.519 02:10:31 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:57.777 [2024-11-18 02:10:31.926306] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:57.777 02:10:31 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:27:57.777 [2024-11-18 02:10:32.175064] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:27:58.035 02:10:32 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:27:58.035 [2024-11-18 02:10:32.431957] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:27:58.293 02:10:32 -- host/failover.sh@31 -- # bdevperf_pid=1312816 00:27:58.293 02:10:32 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:27:58.293 02:10:32 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:58.293 02:10:32 -- host/failover.sh@34 -- # waitforlisten 1312816 /var/tmp/bdevperf.sock 00:27:58.293 02:10:32 -- common/autotest_common.sh@829 -- # '[' -z 1312816 ']' 00:27:58.293 02:10:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:27:58.293 02:10:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:58.293 02:10:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:27:58.293 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:27:58.293 02:10:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:58.293 02:10:32 -- common/autotest_common.sh@10 -- # set +x 00:27:59.226 02:10:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:59.226 02:10:33 -- common/autotest_common.sh@862 -- # return 0 00:27:59.226 02:10:33 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:59.483 NVMe0n1 00:27:59.483 02:10:33 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:59.741 00:27:59.741 02:10:34 -- host/failover.sh@39 -- # run_test_pid=1313085 00:27:59.741 02:10:34 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:27:59.741 02:10:34 -- host/failover.sh@41 -- # sleep 1 00:28:01.114 02:10:35 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:01.114 [2024-11-18 02:10:35.371658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.371993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.372004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.372015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.372026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.372037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.372048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.372060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.114 [2024-11-18 02:10:35.372070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 [2024-11-18 02:10:35.372305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c96180 is same with the state(5) to be set 00:28:01.115 02:10:35 -- host/failover.sh@45 -- # sleep 3 00:28:04.395 02:10:38 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:04.652 00:28:04.653 02:10:38 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:04.911 [2024-11-18 02:10:39.117339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.911 [2024-11-18 02:10:39.117701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 [2024-11-18 02:10:39.117900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c97530 is same with the state(5) to be set 00:28:04.912 02:10:39 -- host/failover.sh@50 -- # sleep 3 00:28:08.190 02:10:42 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:08.190 [2024-11-18 02:10:42.414840] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:08.190 02:10:42 -- host/failover.sh@55 -- # sleep 1 00:28:09.123 02:10:43 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:09.381 [2024-11-18 02:10:43.719334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.381 [2024-11-18 02:10:43.719672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 [2024-11-18 02:10:43.719894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e4d5e0 is same with the state(5) to be set 00:28:09.382 02:10:43 -- host/failover.sh@59 -- # wait 1313085 00:28:16.011 0 00:28:16.011 02:10:49 -- host/failover.sh@61 -- # killprocess 1312816 00:28:16.011 02:10:49 -- common/autotest_common.sh@936 -- # '[' -z 1312816 ']' 00:28:16.011 02:10:49 -- common/autotest_common.sh@940 -- # kill -0 1312816 00:28:16.011 02:10:49 -- common/autotest_common.sh@941 -- # uname 00:28:16.011 02:10:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:16.011 02:10:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1312816 00:28:16.011 02:10:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:16.011 02:10:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:16.011 02:10:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1312816' 00:28:16.011 killing process with pid 1312816 00:28:16.011 02:10:49 -- common/autotest_common.sh@955 -- # kill 1312816 00:28:16.011 02:10:49 -- common/autotest_common.sh@960 -- # wait 1312816 00:28:16.011 02:10:49 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:16.011 [2024-11-18 02:10:32.495020] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:16.011 [2024-11-18 02:10:32.495119] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1312816 ] 00:28:16.011 EAL: No free 2048 kB hugepages reported on node 1 00:28:16.011 [2024-11-18 02:10:32.559482] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:16.011 [2024-11-18 02:10:32.643762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:16.011 Running I/O for 15 seconds... 00:28:16.011 [2024-11-18 02:10:35.372634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:117536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.372675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.372703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:117544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.372720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.372737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:117552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.372751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.372766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:117560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.372780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.372796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:117024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.372811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.372826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:117040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.372840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.372855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:117072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.372869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.372885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:117080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.372899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.372914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:117096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.372928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.372959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:117112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.372973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.372988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:117128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:117144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:117568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:117584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:117600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:117608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:117624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:117640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:117656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:117672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:117680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:117696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:117704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:117720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.011 [2024-11-18 02:10:35.373418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.011 [2024-11-18 02:10:35.373433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:117176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:117216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:117224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:117232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:117264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:117272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:117280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:117320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:117728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:117744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:117752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:117784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:117792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:117800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:117808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.373918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:117848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.373947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:117856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.373975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.373989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:117864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:117872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:117880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:117888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:117896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:117904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:117912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:117920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:117928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.374248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:117936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:117944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:117952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.374361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:117960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:117968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:117976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:117984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.012 [2024-11-18 02:10:35.374477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:117992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.374506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.012 [2024-11-18 02:10:35.374527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:118000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.012 [2024-11-18 02:10:35.374541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:118008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.374570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:118016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.013 [2024-11-18 02:10:35.374605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:118024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.374649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:118032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.013 [2024-11-18 02:10:35.374678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:117336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.374712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:117352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.374740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:117360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.374768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:117368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.374798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:117376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.374825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:117384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.374854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:117392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.374882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:117448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.374910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:118040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.013 [2024-11-18 02:10:35.374938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:118048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.374969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.374984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:118056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.374998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:118064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:118072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.013 [2024-11-18 02:10:35.375061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:118080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:118088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.013 [2024-11-18 02:10:35.375116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:118096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:118104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:118112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:118120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:118128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.013 [2024-11-18 02:10:35.375263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:118136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.013 [2024-11-18 02:10:35.375290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:118144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.013 [2024-11-18 02:10:35.375343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:118152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.013 [2024-11-18 02:10:35.375379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:118160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:117456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:117464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:117472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:117480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:117488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:117496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.013 [2024-11-18 02:10:35.375614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:117504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.013 [2024-11-18 02:10:35.375643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.375658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:117512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.375672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.375687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:118168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.014 [2024-11-18 02:10:35.375706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.375721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:118176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.375735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.375749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:118184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.014 [2024-11-18 02:10:35.375763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.375781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:118192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.014 [2024-11-18 02:10:35.375795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.375810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:118200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.014 [2024-11-18 02:10:35.375822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.375837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:118208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.375850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.375865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:118216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.014 [2024-11-18 02:10:35.375878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.375892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:118224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.375905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.375920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:118232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.375934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.375948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:118240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.014 [2024-11-18 02:10:35.375961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.375976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:118248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.014 [2024-11-18 02:10:35.375990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:118256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.014 [2024-11-18 02:10:35.376019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:118264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.014 [2024-11-18 02:10:35.376047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:118272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.014 [2024-11-18 02:10:35.376075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:118280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:118288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.014 [2024-11-18 02:10:35.376134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:117528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:117576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:117592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:117616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:117632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:117648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:117664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:117688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:117712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:117736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:117760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:117768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:117776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:117816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:117824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.014 [2024-11-18 02:10:35.376599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc7ac70 is same with the state(5) to be set 00:28:16.014 [2024-11-18 02:10:35.376630] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:16.014 [2024-11-18 02:10:35.376656] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:16.014 [2024-11-18 02:10:35.376669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117832 len:8 PRP1 0x0 PRP2 0x0 00:28:16.014 [2024-11-18 02:10:35.376682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.014 [2024-11-18 02:10:35.376739] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xc7ac70 was disconnected and freed. reset controller. 00:28:16.014 [2024-11-18 02:10:35.376765] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:16.014 [2024-11-18 02:10:35.376801] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.015 [2024-11-18 02:10:35.376834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:35.376849] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.015 [2024-11-18 02:10:35.376863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:35.376877] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.015 [2024-11-18 02:10:35.376890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:35.376904] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.015 [2024-11-18 02:10:35.376917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:35.376930] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:16.015 [2024-11-18 02:10:35.376981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc5b600 (9): Bad file descriptor 00:28:16.015 [2024-11-18 02:10:35.379350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:16.015 [2024-11-18 02:10:35.452940] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:16.015 [2024-11-18 02:10:39.118028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:5424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:5432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:5440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:5448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:5456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:5480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:5488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:5496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:5504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:5512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:5520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:5544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:5576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:5600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:5624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:5632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:5648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:5704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:5008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:5016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:5040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:5072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:5112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:5120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.118973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.118988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:5144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.119002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.015 [2024-11-18 02:10:39.119019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:5712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.015 [2024-11-18 02:10:39.119033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:5720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:5728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:5744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:5752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:5760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:5768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:5776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:5784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:5792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:5800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:5808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:5816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:5824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.016 [2024-11-18 02:10:39.119446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:5832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.016 [2024-11-18 02:10:39.119476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:5848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:5856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.016 [2024-11-18 02:10:39.119565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:5864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:5872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.016 [2024-11-18 02:10:39.119650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:5880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.016 [2024-11-18 02:10:39.119678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:5888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:5896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:5912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.016 [2024-11-18 02:10:39.119791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:5920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.016 [2024-11-18 02:10:39.119819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:5928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.016 [2024-11-18 02:10:39.119846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:5168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:5184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:5200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.016 [2024-11-18 02:10:39.119930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.016 [2024-11-18 02:10:39.119944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:5208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.119957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.119971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:5216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.119985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.119999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:5240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:5264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:5936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:5944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:5952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:5960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:5968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:5976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:5984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:5992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:6000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:6008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:6016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:6024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:6032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:6040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:6048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:6056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:6064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:6072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:6080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:6088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:6096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:6104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.017 [2024-11-18 02:10:39.120764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:5280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:5304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:5312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:5352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:5360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:5384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.120978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:5400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.120991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.121006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:5416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.017 [2024-11-18 02:10:39.121019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.017 [2024-11-18 02:10:39.121034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:5472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:5552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:5568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:5592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:5608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:5616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:6112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:6120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:6128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.018 [2024-11-18 02:10:39.121364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:6136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.018 [2024-11-18 02:10:39.121395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:6144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:6160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.018 [2024-11-18 02:10:39.121483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:6168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.018 [2024-11-18 02:10:39.121513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:6176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:6184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.018 [2024-11-18 02:10:39.121573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:6192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.018 [2024-11-18 02:10:39.121603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:6200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:6208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.018 [2024-11-18 02:10:39.121701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:6216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.018 [2024-11-18 02:10:39.121730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:6224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:6232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.018 [2024-11-18 02:10:39.121786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:6240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.018 [2024-11-18 02:10:39.121814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:5640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:5656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:5672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:5688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.121984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.121999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:5696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.018 [2024-11-18 02:10:39.122013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.122027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc67a90 is same with the state(5) to be set 00:28:16.018 [2024-11-18 02:10:39.122046] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:16.018 [2024-11-18 02:10:39.122059] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:16.018 [2024-11-18 02:10:39.122071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5736 len:8 PRP1 0x0 PRP2 0x0 00:28:16.018 [2024-11-18 02:10:39.122084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.122140] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xc67a90 was disconnected and freed. reset controller. 00:28:16.018 [2024-11-18 02:10:39.122157] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:16.018 [2024-11-18 02:10:39.122204] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.018 [2024-11-18 02:10:39.122223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.122239] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.018 [2024-11-18 02:10:39.122253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.018 [2024-11-18 02:10:39.122267] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.019 [2024-11-18 02:10:39.122280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:39.122294] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.019 [2024-11-18 02:10:39.122325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:39.122339] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:16.019 [2024-11-18 02:10:39.124383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:16.019 [2024-11-18 02:10:39.124424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc5b600 (9): Bad file descriptor 00:28:16.019 [2024-11-18 02:10:39.200289] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:16.019 [2024-11-18 02:10:43.720020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:97952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:97984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:97992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:98008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:98016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:98032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:98040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.019 [2024-11-18 02:10:43.720289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:98048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.019 [2024-11-18 02:10:43.720331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:98056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:98064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.019 [2024-11-18 02:10:43.720389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:98072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.019 [2024-11-18 02:10:43.720418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:98080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.019 [2024-11-18 02:10:43.720447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:98088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:98096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.019 [2024-11-18 02:10:43.720503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:98104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:98112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:98120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:97488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:97504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:97520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:97528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:97544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:97552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:97560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:97592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:97600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:97608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:97616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:97624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:97632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.720966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.720989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:97640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.721003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.721019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:97648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.721032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.019 [2024-11-18 02:10:43.721048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:97696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.019 [2024-11-18 02:10:43.721062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:98128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:98136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:98144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:98152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:98160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:98168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:98176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:98184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:98192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:98200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:98208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:98216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:98224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:98232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:98240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:98248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:98256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:98264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:98272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:98280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:98288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:98296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:98304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:98312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:98320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:98328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:98336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:98344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.721930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:98352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.721980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:98360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.721994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.722009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:98368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.722025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.722040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:98376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.722054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.722068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:98384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.722081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.722096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:98392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.020 [2024-11-18 02:10:43.722110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.722124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:98400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.020 [2024-11-18 02:10:43.722141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.020 [2024-11-18 02:10:43.722156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:98408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.021 [2024-11-18 02:10:43.722170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:98416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:98424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.021 [2024-11-18 02:10:43.722226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:98432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.021 [2024-11-18 02:10:43.722255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:98440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:98448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.021 [2024-11-18 02:10:43.722318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:98456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:98464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:97704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:97712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:97728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:97744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:97752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:97760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:97776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:97792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:97800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:97808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:97816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:97848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:97872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:97880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:97904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:97912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.722849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:98472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.021 [2024-11-18 02:10:43.722877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:98480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.021 [2024-11-18 02:10:43.722910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:98488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.021 [2024-11-18 02:10:43.722938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:98496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.021 [2024-11-18 02:10:43.722967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.722982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:98504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.021 [2024-11-18 02:10:43.722995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.723010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:98512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.723023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.723038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:98520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.021 [2024-11-18 02:10:43.723052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.021 [2024-11-18 02:10:43.723067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:98528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.021 [2024-11-18 02:10:43.723080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:98536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:98544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:98552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:98560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:98568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:98576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:98584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:98592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:98600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:98608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:98616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:98624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:98632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:98640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:98648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:98656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:98664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:98672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:98680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:98688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:16.022 [2024-11-18 02:10:43.723732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:97928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:97936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:97944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:97960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:97968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:97976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:98000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:16.022 [2024-11-18 02:10:43.723923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.723936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8a070 is same with the state(5) to be set 00:28:16.022 [2024-11-18 02:10:43.723968] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:16.022 [2024-11-18 02:10:43.723980] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:16.022 [2024-11-18 02:10:43.723992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:98024 len:8 PRP1 0x0 PRP2 0x0 00:28:16.022 [2024-11-18 02:10:43.724004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.724060] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xc8a070 was disconnected and freed. reset controller. 00:28:16.022 [2024-11-18 02:10:43.724077] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:16.022 [2024-11-18 02:10:43.724125] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.022 [2024-11-18 02:10:43.724148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.724165] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.022 [2024-11-18 02:10:43.724179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.724192] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.022 [2024-11-18 02:10:43.724205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.724219] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.022 [2024-11-18 02:10:43.724233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.022 [2024-11-18 02:10:43.724246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:16.022 [2024-11-18 02:10:43.726470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:16.022 [2024-11-18 02:10:43.726510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc5b600 (9): Bad file descriptor 00:28:16.022 [2024-11-18 02:10:43.851337] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:16.022 00:28:16.022 Latency(us) 00:28:16.022 [2024-11-18T01:10:50.425Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:16.023 [2024-11-18T01:10:50.425Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:16.023 Verification LBA range: start 0x0 length 0x4000 00:28:16.023 NVMe0n1 : 15.01 12606.54 49.24 991.75 0.00 9395.55 667.50 16311.18 00:28:16.023 [2024-11-18T01:10:50.425Z] =================================================================================================================== 00:28:16.023 [2024-11-18T01:10:50.425Z] Total : 12606.54 49.24 991.75 0.00 9395.55 667.50 16311.18 00:28:16.023 Received shutdown signal, test time was about 15.000000 seconds 00:28:16.023 00:28:16.023 Latency(us) 00:28:16.023 [2024-11-18T01:10:50.425Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:16.023 [2024-11-18T01:10:50.425Z] =================================================================================================================== 00:28:16.023 [2024-11-18T01:10:50.425Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:16.023 02:10:49 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:16.023 02:10:49 -- host/failover.sh@65 -- # count=3 00:28:16.023 02:10:49 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:16.023 02:10:49 -- host/failover.sh@73 -- # bdevperf_pid=1314982 00:28:16.023 02:10:49 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:16.023 02:10:49 -- host/failover.sh@75 -- # waitforlisten 1314982 /var/tmp/bdevperf.sock 00:28:16.023 02:10:49 -- common/autotest_common.sh@829 -- # '[' -z 1314982 ']' 00:28:16.023 02:10:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:16.023 02:10:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:16.023 02:10:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:16.023 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:16.023 02:10:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:16.023 02:10:49 -- common/autotest_common.sh@10 -- # set +x 00:28:16.281 02:10:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:16.281 02:10:50 -- common/autotest_common.sh@862 -- # return 0 00:28:16.281 02:10:50 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:16.540 [2024-11-18 02:10:50.827683] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:16.540 02:10:50 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:16.797 [2024-11-18 02:10:51.068422] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:16.798 02:10:51 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:17.056 NVMe0n1 00:28:17.056 02:10:51 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:17.624 00:28:17.624 02:10:51 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:17.882 00:28:17.882 02:10:52 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:17.882 02:10:52 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:18.140 02:10:52 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:18.399 02:10:52 -- host/failover.sh@87 -- # sleep 3 00:28:21.684 02:10:55 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:21.684 02:10:55 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:21.684 02:10:55 -- host/failover.sh@90 -- # run_test_pid=1315677 00:28:21.684 02:10:55 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:21.684 02:10:55 -- host/failover.sh@92 -- # wait 1315677 00:28:22.618 0 00:28:22.618 02:10:56 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:22.618 [2024-11-18 02:10:49.602881] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:22.618 [2024-11-18 02:10:49.602985] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1314982 ] 00:28:22.618 EAL: No free 2048 kB hugepages reported on node 1 00:28:22.618 [2024-11-18 02:10:49.663904] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:22.618 [2024-11-18 02:10:49.748910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:22.618 [2024-11-18 02:10:52.604820] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:22.618 [2024-11-18 02:10:52.604898] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:22.618 [2024-11-18 02:10:52.604936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:22.618 [2024-11-18 02:10:52.604953] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:22.618 [2024-11-18 02:10:52.604967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:22.618 [2024-11-18 02:10:52.604981] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:22.618 [2024-11-18 02:10:52.604997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:22.618 [2024-11-18 02:10:52.605011] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:22.618 [2024-11-18 02:10:52.605025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:22.618 [2024-11-18 02:10:52.605039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:22.618 [2024-11-18 02:10:52.605075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:22.618 [2024-11-18 02:10:52.605106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe99600 (9): Bad file descriptor 00:28:22.618 [2024-11-18 02:10:52.610561] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:22.618 Running I/O for 1 seconds... 00:28:22.618 00:28:22.618 Latency(us) 00:28:22.618 [2024-11-18T01:10:57.020Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:22.618 [2024-11-18T01:10:57.020Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:22.618 Verification LBA range: start 0x0 length 0x4000 00:28:22.618 NVMe0n1 : 1.01 12979.48 50.70 0.00 0.00 9816.34 1450.29 14563.56 00:28:22.618 [2024-11-18T01:10:57.020Z] =================================================================================================================== 00:28:22.618 [2024-11-18T01:10:57.020Z] Total : 12979.48 50.70 0.00 0.00 9816.34 1450.29 14563.56 00:28:22.618 02:10:56 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:22.618 02:10:56 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:22.876 02:10:57 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:23.442 02:10:57 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:23.442 02:10:57 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:23.442 02:10:57 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:23.700 02:10:58 -- host/failover.sh@101 -- # sleep 3 00:28:26.979 02:11:01 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:26.979 02:11:01 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:26.979 02:11:01 -- host/failover.sh@108 -- # killprocess 1314982 00:28:26.979 02:11:01 -- common/autotest_common.sh@936 -- # '[' -z 1314982 ']' 00:28:26.979 02:11:01 -- common/autotest_common.sh@940 -- # kill -0 1314982 00:28:26.979 02:11:01 -- common/autotest_common.sh@941 -- # uname 00:28:26.979 02:11:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:26.979 02:11:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1314982 00:28:26.979 02:11:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:26.979 02:11:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:26.979 02:11:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1314982' 00:28:26.979 killing process with pid 1314982 00:28:26.979 02:11:01 -- common/autotest_common.sh@955 -- # kill 1314982 00:28:26.979 02:11:01 -- common/autotest_common.sh@960 -- # wait 1314982 00:28:27.236 02:11:01 -- host/failover.sh@110 -- # sync 00:28:27.236 02:11:01 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:27.495 02:11:01 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:27.495 02:11:01 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:27.495 02:11:01 -- host/failover.sh@116 -- # nvmftestfini 00:28:27.495 02:11:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:27.495 02:11:01 -- nvmf/common.sh@116 -- # sync 00:28:27.495 02:11:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:27.495 02:11:01 -- nvmf/common.sh@119 -- # set +e 00:28:27.495 02:11:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:27.495 02:11:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:27.495 rmmod nvme_tcp 00:28:27.495 rmmod nvme_fabrics 00:28:27.495 rmmod nvme_keyring 00:28:27.495 02:11:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:27.495 02:11:01 -- nvmf/common.sh@123 -- # set -e 00:28:27.495 02:11:01 -- nvmf/common.sh@124 -- # return 0 00:28:27.495 02:11:01 -- nvmf/common.sh@477 -- # '[' -n 1312503 ']' 00:28:27.495 02:11:01 -- nvmf/common.sh@478 -- # killprocess 1312503 00:28:27.495 02:11:01 -- common/autotest_common.sh@936 -- # '[' -z 1312503 ']' 00:28:27.495 02:11:01 -- common/autotest_common.sh@940 -- # kill -0 1312503 00:28:27.495 02:11:01 -- common/autotest_common.sh@941 -- # uname 00:28:27.495 02:11:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:27.495 02:11:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1312503 00:28:27.495 02:11:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:27.495 02:11:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:27.495 02:11:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1312503' 00:28:27.495 killing process with pid 1312503 00:28:27.495 02:11:01 -- common/autotest_common.sh@955 -- # kill 1312503 00:28:27.495 02:11:01 -- common/autotest_common.sh@960 -- # wait 1312503 00:28:27.754 02:11:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:27.754 02:11:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:27.754 02:11:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:27.754 02:11:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:27.754 02:11:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:27.754 02:11:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:27.754 02:11:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:27.754 02:11:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:30.291 02:11:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:30.291 00:28:30.291 real 0m36.915s 00:28:30.291 user 2m10.770s 00:28:30.291 sys 0m6.032s 00:28:30.291 02:11:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:30.291 02:11:04 -- common/autotest_common.sh@10 -- # set +x 00:28:30.291 ************************************ 00:28:30.291 END TEST nvmf_failover 00:28:30.291 ************************************ 00:28:30.291 02:11:04 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:30.291 02:11:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:30.291 02:11:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:30.291 02:11:04 -- common/autotest_common.sh@10 -- # set +x 00:28:30.291 ************************************ 00:28:30.291 START TEST nvmf_discovery 00:28:30.291 ************************************ 00:28:30.291 02:11:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:30.291 * Looking for test storage... 00:28:30.291 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:30.291 02:11:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:30.291 02:11:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:30.291 02:11:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:30.291 02:11:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:30.291 02:11:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:30.291 02:11:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:30.291 02:11:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:30.291 02:11:04 -- scripts/common.sh@335 -- # IFS=.-: 00:28:30.291 02:11:04 -- scripts/common.sh@335 -- # read -ra ver1 00:28:30.291 02:11:04 -- scripts/common.sh@336 -- # IFS=.-: 00:28:30.291 02:11:04 -- scripts/common.sh@336 -- # read -ra ver2 00:28:30.291 02:11:04 -- scripts/common.sh@337 -- # local 'op=<' 00:28:30.291 02:11:04 -- scripts/common.sh@339 -- # ver1_l=2 00:28:30.291 02:11:04 -- scripts/common.sh@340 -- # ver2_l=1 00:28:30.291 02:11:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:30.291 02:11:04 -- scripts/common.sh@343 -- # case "$op" in 00:28:30.291 02:11:04 -- scripts/common.sh@344 -- # : 1 00:28:30.291 02:11:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:30.291 02:11:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:30.291 02:11:04 -- scripts/common.sh@364 -- # decimal 1 00:28:30.291 02:11:04 -- scripts/common.sh@352 -- # local d=1 00:28:30.291 02:11:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:30.291 02:11:04 -- scripts/common.sh@354 -- # echo 1 00:28:30.291 02:11:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:30.291 02:11:04 -- scripts/common.sh@365 -- # decimal 2 00:28:30.291 02:11:04 -- scripts/common.sh@352 -- # local d=2 00:28:30.291 02:11:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:30.291 02:11:04 -- scripts/common.sh@354 -- # echo 2 00:28:30.291 02:11:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:30.291 02:11:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:30.291 02:11:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:30.291 02:11:04 -- scripts/common.sh@367 -- # return 0 00:28:30.291 02:11:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:30.291 02:11:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:30.291 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:30.291 --rc genhtml_branch_coverage=1 00:28:30.291 --rc genhtml_function_coverage=1 00:28:30.291 --rc genhtml_legend=1 00:28:30.291 --rc geninfo_all_blocks=1 00:28:30.291 --rc geninfo_unexecuted_blocks=1 00:28:30.291 00:28:30.291 ' 00:28:30.291 02:11:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:30.291 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:30.291 --rc genhtml_branch_coverage=1 00:28:30.291 --rc genhtml_function_coverage=1 00:28:30.291 --rc genhtml_legend=1 00:28:30.291 --rc geninfo_all_blocks=1 00:28:30.291 --rc geninfo_unexecuted_blocks=1 00:28:30.291 00:28:30.291 ' 00:28:30.291 02:11:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:30.291 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:30.291 --rc genhtml_branch_coverage=1 00:28:30.291 --rc genhtml_function_coverage=1 00:28:30.291 --rc genhtml_legend=1 00:28:30.291 --rc geninfo_all_blocks=1 00:28:30.291 --rc geninfo_unexecuted_blocks=1 00:28:30.291 00:28:30.291 ' 00:28:30.291 02:11:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:30.291 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:30.291 --rc genhtml_branch_coverage=1 00:28:30.291 --rc genhtml_function_coverage=1 00:28:30.291 --rc genhtml_legend=1 00:28:30.291 --rc geninfo_all_blocks=1 00:28:30.291 --rc geninfo_unexecuted_blocks=1 00:28:30.291 00:28:30.291 ' 00:28:30.291 02:11:04 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:30.291 02:11:04 -- nvmf/common.sh@7 -- # uname -s 00:28:30.291 02:11:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:30.291 02:11:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:30.291 02:11:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:30.291 02:11:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:30.291 02:11:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:30.291 02:11:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:30.291 02:11:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:30.291 02:11:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:30.291 02:11:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:30.291 02:11:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:30.291 02:11:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:30.291 02:11:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:30.291 02:11:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:30.291 02:11:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:30.291 02:11:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:30.291 02:11:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:30.291 02:11:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:30.291 02:11:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:30.291 02:11:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:30.292 02:11:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.292 02:11:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.292 02:11:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.292 02:11:04 -- paths/export.sh@5 -- # export PATH 00:28:30.292 02:11:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.292 02:11:04 -- nvmf/common.sh@46 -- # : 0 00:28:30.292 02:11:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:30.292 02:11:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:30.292 02:11:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:30.292 02:11:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:30.292 02:11:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:30.292 02:11:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:30.292 02:11:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:30.292 02:11:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:30.292 02:11:04 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:30.292 02:11:04 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:30.292 02:11:04 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:30.292 02:11:04 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:30.292 02:11:04 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:30.292 02:11:04 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:30.292 02:11:04 -- host/discovery.sh@25 -- # nvmftestinit 00:28:30.292 02:11:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:30.292 02:11:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:30.292 02:11:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:30.292 02:11:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:30.292 02:11:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:30.292 02:11:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:30.292 02:11:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:30.292 02:11:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:30.292 02:11:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:30.292 02:11:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:30.292 02:11:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:30.292 02:11:04 -- common/autotest_common.sh@10 -- # set +x 00:28:32.194 02:11:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:32.194 02:11:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:32.194 02:11:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:32.194 02:11:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:32.194 02:11:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:32.194 02:11:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:32.194 02:11:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:32.194 02:11:06 -- nvmf/common.sh@294 -- # net_devs=() 00:28:32.194 02:11:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:32.194 02:11:06 -- nvmf/common.sh@295 -- # e810=() 00:28:32.194 02:11:06 -- nvmf/common.sh@295 -- # local -ga e810 00:28:32.194 02:11:06 -- nvmf/common.sh@296 -- # x722=() 00:28:32.194 02:11:06 -- nvmf/common.sh@296 -- # local -ga x722 00:28:32.194 02:11:06 -- nvmf/common.sh@297 -- # mlx=() 00:28:32.194 02:11:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:32.194 02:11:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:32.194 02:11:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:32.194 02:11:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:32.194 02:11:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:32.194 02:11:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:32.194 02:11:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:32.194 02:11:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:32.194 02:11:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:32.194 02:11:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:32.194 02:11:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:32.194 02:11:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:32.194 02:11:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:32.194 02:11:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:32.194 02:11:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:32.194 02:11:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:32.194 02:11:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:32.194 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:32.194 02:11:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:32.194 02:11:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:32.194 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:32.194 02:11:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:32.194 02:11:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:32.194 02:11:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:32.194 02:11:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:32.194 02:11:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:32.194 02:11:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:32.194 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:32.194 02:11:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:32.194 02:11:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:32.194 02:11:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:32.194 02:11:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:32.194 02:11:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:32.194 02:11:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:32.194 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:32.194 02:11:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:32.194 02:11:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:32.194 02:11:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:32.194 02:11:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:32.194 02:11:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:32.194 02:11:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:32.194 02:11:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:32.194 02:11:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:32.194 02:11:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:32.194 02:11:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:32.194 02:11:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:32.194 02:11:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:32.194 02:11:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:32.194 02:11:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:32.194 02:11:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:32.194 02:11:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:32.194 02:11:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:32.194 02:11:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:32.194 02:11:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:32.194 02:11:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:32.194 02:11:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:32.194 02:11:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:32.194 02:11:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:32.194 02:11:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:32.194 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:32.194 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:28:32.194 00:28:32.194 --- 10.0.0.2 ping statistics --- 00:28:32.194 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:32.194 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:28:32.194 02:11:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:32.194 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:32.194 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:28:32.194 00:28:32.194 --- 10.0.0.1 ping statistics --- 00:28:32.194 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:32.194 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:28:32.194 02:11:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:32.194 02:11:06 -- nvmf/common.sh@410 -- # return 0 00:28:32.194 02:11:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:32.194 02:11:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:32.194 02:11:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:32.194 02:11:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:32.194 02:11:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:32.194 02:11:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:32.194 02:11:06 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:32.194 02:11:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:32.194 02:11:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:32.194 02:11:06 -- common/autotest_common.sh@10 -- # set +x 00:28:32.194 02:11:06 -- nvmf/common.sh@469 -- # nvmfpid=1318439 00:28:32.194 02:11:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:32.194 02:11:06 -- nvmf/common.sh@470 -- # waitforlisten 1318439 00:28:32.194 02:11:06 -- common/autotest_common.sh@829 -- # '[' -z 1318439 ']' 00:28:32.194 02:11:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:32.194 02:11:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:32.194 02:11:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:32.194 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:32.194 02:11:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:32.194 02:11:06 -- common/autotest_common.sh@10 -- # set +x 00:28:32.194 [2024-11-18 02:11:06.572437] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:32.194 [2024-11-18 02:11:06.572512] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:32.453 EAL: No free 2048 kB hugepages reported on node 1 00:28:32.453 [2024-11-18 02:11:06.642149] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:32.453 [2024-11-18 02:11:06.731817] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:32.453 [2024-11-18 02:11:06.731981] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:32.453 [2024-11-18 02:11:06.731999] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:32.453 [2024-11-18 02:11:06.732011] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:32.453 [2024-11-18 02:11:06.732037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:33.386 02:11:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:33.386 02:11:07 -- common/autotest_common.sh@862 -- # return 0 00:28:33.386 02:11:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:33.386 02:11:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:33.386 02:11:07 -- common/autotest_common.sh@10 -- # set +x 00:28:33.386 02:11:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:33.386 02:11:07 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:33.386 02:11:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.386 02:11:07 -- common/autotest_common.sh@10 -- # set +x 00:28:33.386 [2024-11-18 02:11:07.601514] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:33.386 02:11:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.386 02:11:07 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:28:33.386 02:11:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.386 02:11:07 -- common/autotest_common.sh@10 -- # set +x 00:28:33.386 [2024-11-18 02:11:07.609693] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:33.386 02:11:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.386 02:11:07 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:28:33.386 02:11:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.386 02:11:07 -- common/autotest_common.sh@10 -- # set +x 00:28:33.386 null0 00:28:33.386 02:11:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.386 02:11:07 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:28:33.386 02:11:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.386 02:11:07 -- common/autotest_common.sh@10 -- # set +x 00:28:33.386 null1 00:28:33.386 02:11:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.386 02:11:07 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:28:33.386 02:11:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.386 02:11:07 -- common/autotest_common.sh@10 -- # set +x 00:28:33.386 02:11:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.386 02:11:07 -- host/discovery.sh@45 -- # hostpid=1318587 00:28:33.386 02:11:07 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:28:33.386 02:11:07 -- host/discovery.sh@46 -- # waitforlisten 1318587 /tmp/host.sock 00:28:33.386 02:11:07 -- common/autotest_common.sh@829 -- # '[' -z 1318587 ']' 00:28:33.386 02:11:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:33.386 02:11:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:33.386 02:11:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:33.386 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:33.386 02:11:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:33.386 02:11:07 -- common/autotest_common.sh@10 -- # set +x 00:28:33.386 [2024-11-18 02:11:07.678586] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:33.386 [2024-11-18 02:11:07.678673] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1318587 ] 00:28:33.386 EAL: No free 2048 kB hugepages reported on node 1 00:28:33.386 [2024-11-18 02:11:07.740472] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:33.644 [2024-11-18 02:11:07.833257] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:33.644 [2024-11-18 02:11:07.833447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:34.578 02:11:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:34.578 02:11:08 -- common/autotest_common.sh@862 -- # return 0 00:28:34.578 02:11:08 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:34.578 02:11:08 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:28:34.578 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.578 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.578 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.578 02:11:08 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:28:34.578 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.578 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.578 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.578 02:11:08 -- host/discovery.sh@72 -- # notify_id=0 00:28:34.578 02:11:08 -- host/discovery.sh@78 -- # get_subsystem_names 00:28:34.578 02:11:08 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:34.578 02:11:08 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:34.578 02:11:08 -- host/discovery.sh@59 -- # sort 00:28:34.578 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.578 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.578 02:11:08 -- host/discovery.sh@59 -- # xargs 00:28:34.578 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.578 02:11:08 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:28:34.578 02:11:08 -- host/discovery.sh@79 -- # get_bdev_list 00:28:34.578 02:11:08 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:34.578 02:11:08 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:34.578 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.578 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.578 02:11:08 -- host/discovery.sh@55 -- # sort 00:28:34.578 02:11:08 -- host/discovery.sh@55 -- # xargs 00:28:34.578 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.578 02:11:08 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:28:34.579 02:11:08 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:28:34.579 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.579 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.579 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.579 02:11:08 -- host/discovery.sh@82 -- # get_subsystem_names 00:28:34.579 02:11:08 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:34.579 02:11:08 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:34.579 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.579 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.579 02:11:08 -- host/discovery.sh@59 -- # sort 00:28:34.579 02:11:08 -- host/discovery.sh@59 -- # xargs 00:28:34.579 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.579 02:11:08 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:28:34.579 02:11:08 -- host/discovery.sh@83 -- # get_bdev_list 00:28:34.579 02:11:08 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:34.579 02:11:08 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:34.579 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.579 02:11:08 -- host/discovery.sh@55 -- # sort 00:28:34.579 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.579 02:11:08 -- host/discovery.sh@55 -- # xargs 00:28:34.579 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.579 02:11:08 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:28:34.579 02:11:08 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:28:34.579 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.579 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.579 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.579 02:11:08 -- host/discovery.sh@86 -- # get_subsystem_names 00:28:34.579 02:11:08 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:34.579 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.579 02:11:08 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:34.579 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.579 02:11:08 -- host/discovery.sh@59 -- # sort 00:28:34.579 02:11:08 -- host/discovery.sh@59 -- # xargs 00:28:34.579 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.579 02:11:08 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:28:34.579 02:11:08 -- host/discovery.sh@87 -- # get_bdev_list 00:28:34.579 02:11:08 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:34.579 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.579 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.579 02:11:08 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:34.579 02:11:08 -- host/discovery.sh@55 -- # sort 00:28:34.579 02:11:08 -- host/discovery.sh@55 -- # xargs 00:28:34.579 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.579 02:11:08 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:28:34.579 02:11:08 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:34.579 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.579 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.579 [2024-11-18 02:11:08.909331] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:34.579 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.579 02:11:08 -- host/discovery.sh@92 -- # get_subsystem_names 00:28:34.579 02:11:08 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:34.579 02:11:08 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:34.579 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.579 02:11:08 -- host/discovery.sh@59 -- # sort 00:28:34.579 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.579 02:11:08 -- host/discovery.sh@59 -- # xargs 00:28:34.579 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.579 02:11:08 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:28:34.579 02:11:08 -- host/discovery.sh@93 -- # get_bdev_list 00:28:34.579 02:11:08 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:34.579 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.579 02:11:08 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:34.579 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.579 02:11:08 -- host/discovery.sh@55 -- # sort 00:28:34.579 02:11:08 -- host/discovery.sh@55 -- # xargs 00:28:34.579 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.837 02:11:08 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:28:34.837 02:11:08 -- host/discovery.sh@94 -- # get_notification_count 00:28:34.837 02:11:08 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:34.837 02:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.837 02:11:08 -- common/autotest_common.sh@10 -- # set +x 00:28:34.837 02:11:08 -- host/discovery.sh@74 -- # jq '. | length' 00:28:34.837 02:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.837 02:11:09 -- host/discovery.sh@74 -- # notification_count=0 00:28:34.837 02:11:09 -- host/discovery.sh@75 -- # notify_id=0 00:28:34.837 02:11:09 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:28:34.837 02:11:09 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:28:34.837 02:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.837 02:11:09 -- common/autotest_common.sh@10 -- # set +x 00:28:34.837 02:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.837 02:11:09 -- host/discovery.sh@100 -- # sleep 1 00:28:35.402 [2024-11-18 02:11:09.710447] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:35.402 [2024-11-18 02:11:09.710476] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:35.402 [2024-11-18 02:11:09.710499] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:35.402 [2024-11-18 02:11:09.797794] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:35.660 [2024-11-18 02:11:09.902489] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:35.660 [2024-11-18 02:11:09.902510] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:35.660 02:11:10 -- host/discovery.sh@101 -- # get_subsystem_names 00:28:35.660 02:11:10 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:35.660 02:11:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.660 02:11:10 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:35.660 02:11:10 -- common/autotest_common.sh@10 -- # set +x 00:28:35.660 02:11:10 -- host/discovery.sh@59 -- # sort 00:28:35.660 02:11:10 -- host/discovery.sh@59 -- # xargs 00:28:35.660 02:11:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:35.918 02:11:10 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:35.918 02:11:10 -- host/discovery.sh@102 -- # get_bdev_list 00:28:35.918 02:11:10 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:35.918 02:11:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.918 02:11:10 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:35.918 02:11:10 -- common/autotest_common.sh@10 -- # set +x 00:28:35.918 02:11:10 -- host/discovery.sh@55 -- # sort 00:28:35.918 02:11:10 -- host/discovery.sh@55 -- # xargs 00:28:35.918 02:11:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:35.918 02:11:10 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:28:35.918 02:11:10 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:28:35.918 02:11:10 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:35.918 02:11:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.918 02:11:10 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:35.918 02:11:10 -- common/autotest_common.sh@10 -- # set +x 00:28:35.918 02:11:10 -- host/discovery.sh@63 -- # sort -n 00:28:35.918 02:11:10 -- host/discovery.sh@63 -- # xargs 00:28:35.918 02:11:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:35.918 02:11:10 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:28:35.918 02:11:10 -- host/discovery.sh@104 -- # get_notification_count 00:28:35.918 02:11:10 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:35.918 02:11:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.918 02:11:10 -- host/discovery.sh@74 -- # jq '. | length' 00:28:35.918 02:11:10 -- common/autotest_common.sh@10 -- # set +x 00:28:35.918 02:11:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:35.918 02:11:10 -- host/discovery.sh@74 -- # notification_count=1 00:28:35.918 02:11:10 -- host/discovery.sh@75 -- # notify_id=1 00:28:35.918 02:11:10 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:28:35.918 02:11:10 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:28:35.918 02:11:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.918 02:11:10 -- common/autotest_common.sh@10 -- # set +x 00:28:35.918 02:11:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:35.918 02:11:10 -- host/discovery.sh@109 -- # sleep 1 00:28:36.851 02:11:11 -- host/discovery.sh@110 -- # get_bdev_list 00:28:36.851 02:11:11 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:36.851 02:11:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.851 02:11:11 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:36.851 02:11:11 -- common/autotest_common.sh@10 -- # set +x 00:28:36.851 02:11:11 -- host/discovery.sh@55 -- # sort 00:28:36.851 02:11:11 -- host/discovery.sh@55 -- # xargs 00:28:36.851 02:11:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.851 02:11:11 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:36.851 02:11:11 -- host/discovery.sh@111 -- # get_notification_count 00:28:36.851 02:11:11 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:28:36.851 02:11:11 -- host/discovery.sh@74 -- # jq '. | length' 00:28:36.851 02:11:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.851 02:11:11 -- common/autotest_common.sh@10 -- # set +x 00:28:37.109 02:11:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.109 02:11:11 -- host/discovery.sh@74 -- # notification_count=1 00:28:37.109 02:11:11 -- host/discovery.sh@75 -- # notify_id=2 00:28:37.109 02:11:11 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:28:37.109 02:11:11 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:28:37.109 02:11:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.109 02:11:11 -- common/autotest_common.sh@10 -- # set +x 00:28:37.109 [2024-11-18 02:11:11.300554] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:37.109 [2024-11-18 02:11:11.301086] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:37.109 [2024-11-18 02:11:11.301128] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:37.109 02:11:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.109 02:11:11 -- host/discovery.sh@117 -- # sleep 1 00:28:37.109 [2024-11-18 02:11:11.429503] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:28:37.367 [2024-11-18 02:11:11.689782] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:37.367 [2024-11-18 02:11:11.689808] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:37.367 [2024-11-18 02:11:11.689818] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:37.933 02:11:12 -- host/discovery.sh@118 -- # get_subsystem_names 00:28:37.933 02:11:12 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:37.933 02:11:12 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:37.933 02:11:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.933 02:11:12 -- host/discovery.sh@59 -- # sort 00:28:37.933 02:11:12 -- common/autotest_common.sh@10 -- # set +x 00:28:37.933 02:11:12 -- host/discovery.sh@59 -- # xargs 00:28:37.933 02:11:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.191 02:11:12 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:38.192 02:11:12 -- host/discovery.sh@119 -- # get_bdev_list 00:28:38.192 02:11:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:38.192 02:11:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.192 02:11:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:38.192 02:11:12 -- common/autotest_common.sh@10 -- # set +x 00:28:38.192 02:11:12 -- host/discovery.sh@55 -- # sort 00:28:38.192 02:11:12 -- host/discovery.sh@55 -- # xargs 00:28:38.192 02:11:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.192 02:11:12 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:38.192 02:11:12 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:28:38.192 02:11:12 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:38.192 02:11:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.192 02:11:12 -- common/autotest_common.sh@10 -- # set +x 00:28:38.192 02:11:12 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:38.192 02:11:12 -- host/discovery.sh@63 -- # sort -n 00:28:38.192 02:11:12 -- host/discovery.sh@63 -- # xargs 00:28:38.192 02:11:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.192 02:11:12 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:28:38.192 02:11:12 -- host/discovery.sh@121 -- # get_notification_count 00:28:38.192 02:11:12 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:38.192 02:11:12 -- host/discovery.sh@74 -- # jq '. | length' 00:28:38.192 02:11:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.192 02:11:12 -- common/autotest_common.sh@10 -- # set +x 00:28:38.192 02:11:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.192 02:11:12 -- host/discovery.sh@74 -- # notification_count=0 00:28:38.192 02:11:12 -- host/discovery.sh@75 -- # notify_id=2 00:28:38.192 02:11:12 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:28:38.192 02:11:12 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:38.192 02:11:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.192 02:11:12 -- common/autotest_common.sh@10 -- # set +x 00:28:38.192 [2024-11-18 02:11:12.464748] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:38.192 [2024-11-18 02:11:12.464784] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:38.192 [2024-11-18 02:11:12.466086] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.192 [2024-11-18 02:11:12.466118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.192 [2024-11-18 02:11:12.466162] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.192 [2024-11-18 02:11:12.466176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.192 [2024-11-18 02:11:12.466189] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.192 [2024-11-18 02:11:12.466218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.192 [2024-11-18 02:11:12.466232] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.192 [2024-11-18 02:11:12.466245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.192 [2024-11-18 02:11:12.466259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a43b80 is same with the state(5) to be set 00:28:38.192 02:11:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.192 02:11:12 -- host/discovery.sh@127 -- # sleep 1 00:28:38.192 [2024-11-18 02:11:12.476092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a43b80 (9): Bad file descriptor 00:28:38.192 [2024-11-18 02:11:12.486139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:38.192 [2024-11-18 02:11:12.486345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.192 [2024-11-18 02:11:12.486477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.192 [2024-11-18 02:11:12.486504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a43b80 with addr=10.0.0.2, port=4420 00:28:38.192 [2024-11-18 02:11:12.486521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a43b80 is same with the state(5) to be set 00:28:38.192 [2024-11-18 02:11:12.486544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a43b80 (9): Bad file descriptor 00:28:38.192 [2024-11-18 02:11:12.486574] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:38.192 [2024-11-18 02:11:12.486589] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:38.192 [2024-11-18 02:11:12.486609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:38.192 [2024-11-18 02:11:12.486629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:38.192 [2024-11-18 02:11:12.496227] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:38.192 [2024-11-18 02:11:12.496463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.192 [2024-11-18 02:11:12.496590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.192 [2024-11-18 02:11:12.496616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a43b80 with addr=10.0.0.2, port=4420 00:28:38.192 [2024-11-18 02:11:12.496633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a43b80 is same with the state(5) to be set 00:28:38.192 [2024-11-18 02:11:12.496655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a43b80 (9): Bad file descriptor 00:28:38.192 [2024-11-18 02:11:12.496676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:38.192 [2024-11-18 02:11:12.496690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:38.192 [2024-11-18 02:11:12.496703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:38.192 [2024-11-18 02:11:12.496722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:38.192 [2024-11-18 02:11:12.506302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:38.192 [2024-11-18 02:11:12.506452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.192 [2024-11-18 02:11:12.506608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.192 [2024-11-18 02:11:12.506634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a43b80 with addr=10.0.0.2, port=4420 00:28:38.192 [2024-11-18 02:11:12.506650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a43b80 is same with the state(5) to be set 00:28:38.192 [2024-11-18 02:11:12.506672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a43b80 (9): Bad file descriptor 00:28:38.192 [2024-11-18 02:11:12.506693] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:38.192 [2024-11-18 02:11:12.506707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:38.192 [2024-11-18 02:11:12.506722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:38.192 [2024-11-18 02:11:12.506741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:38.192 [2024-11-18 02:11:12.516406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:38.192 [2024-11-18 02:11:12.516655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.192 [2024-11-18 02:11:12.516770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.192 [2024-11-18 02:11:12.516797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a43b80 with addr=10.0.0.2, port=4420 00:28:38.192 [2024-11-18 02:11:12.516814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a43b80 is same with the state(5) to be set 00:28:38.192 [2024-11-18 02:11:12.516836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a43b80 (9): Bad file descriptor 00:28:38.192 [2024-11-18 02:11:12.516856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:38.192 [2024-11-18 02:11:12.516876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:38.192 [2024-11-18 02:11:12.516891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:38.192 [2024-11-18 02:11:12.516910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:38.192 [2024-11-18 02:11:12.526477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:38.192 [2024-11-18 02:11:12.526661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.192 [2024-11-18 02:11:12.526763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.192 [2024-11-18 02:11:12.526793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a43b80 with addr=10.0.0.2, port=4420 00:28:38.192 [2024-11-18 02:11:12.526811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a43b80 is same with the state(5) to be set 00:28:38.192 [2024-11-18 02:11:12.526835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a43b80 (9): Bad file descriptor 00:28:38.192 [2024-11-18 02:11:12.526857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:38.193 [2024-11-18 02:11:12.526873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:38.193 [2024-11-18 02:11:12.526888] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:38.193 [2024-11-18 02:11:12.526909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:38.193 [2024-11-18 02:11:12.536545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:38.193 [2024-11-18 02:11:12.536709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.193 [2024-11-18 02:11:12.536818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.193 [2024-11-18 02:11:12.536846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a43b80 with addr=10.0.0.2, port=4420 00:28:38.193 [2024-11-18 02:11:12.536863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a43b80 is same with the state(5) to be set 00:28:38.193 [2024-11-18 02:11:12.536884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a43b80 (9): Bad file descriptor 00:28:38.193 [2024-11-18 02:11:12.536905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:38.193 [2024-11-18 02:11:12.536920] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:38.193 [2024-11-18 02:11:12.536950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:38.193 [2024-11-18 02:11:12.536973] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:38.193 [2024-11-18 02:11:12.546619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:38.193 [2024-11-18 02:11:12.546821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.193 [2024-11-18 02:11:12.546945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.193 [2024-11-18 02:11:12.546971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a43b80 with addr=10.0.0.2, port=4420 00:28:38.193 [2024-11-18 02:11:12.546987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a43b80 is same with the state(5) to be set 00:28:38.193 [2024-11-18 02:11:12.547009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a43b80 (9): Bad file descriptor 00:28:38.193 [2024-11-18 02:11:12.547029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:38.193 [2024-11-18 02:11:12.547059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:38.193 [2024-11-18 02:11:12.547081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:38.193 [2024-11-18 02:11:12.547117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:38.193 [2024-11-18 02:11:12.551073] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:28:38.193 [2024-11-18 02:11:12.551104] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:39.127 02:11:13 -- host/discovery.sh@128 -- # get_subsystem_names 00:28:39.127 02:11:13 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:39.127 02:11:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.127 02:11:13 -- common/autotest_common.sh@10 -- # set +x 00:28:39.127 02:11:13 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:39.127 02:11:13 -- host/discovery.sh@59 -- # sort 00:28:39.127 02:11:13 -- host/discovery.sh@59 -- # xargs 00:28:39.127 02:11:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.127 02:11:13 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:39.127 02:11:13 -- host/discovery.sh@129 -- # get_bdev_list 00:28:39.127 02:11:13 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:39.127 02:11:13 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:39.127 02:11:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.127 02:11:13 -- common/autotest_common.sh@10 -- # set +x 00:28:39.127 02:11:13 -- host/discovery.sh@55 -- # sort 00:28:39.127 02:11:13 -- host/discovery.sh@55 -- # xargs 00:28:39.385 02:11:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.385 02:11:13 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:39.385 02:11:13 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:28:39.385 02:11:13 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:39.385 02:11:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.385 02:11:13 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:39.385 02:11:13 -- common/autotest_common.sh@10 -- # set +x 00:28:39.385 02:11:13 -- host/discovery.sh@63 -- # sort -n 00:28:39.385 02:11:13 -- host/discovery.sh@63 -- # xargs 00:28:39.385 02:11:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.385 02:11:13 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:28:39.385 02:11:13 -- host/discovery.sh@131 -- # get_notification_count 00:28:39.385 02:11:13 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:39.385 02:11:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.385 02:11:13 -- host/discovery.sh@74 -- # jq '. | length' 00:28:39.385 02:11:13 -- common/autotest_common.sh@10 -- # set +x 00:28:39.385 02:11:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.385 02:11:13 -- host/discovery.sh@74 -- # notification_count=0 00:28:39.385 02:11:13 -- host/discovery.sh@75 -- # notify_id=2 00:28:39.385 02:11:13 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:28:39.385 02:11:13 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:28:39.385 02:11:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.385 02:11:13 -- common/autotest_common.sh@10 -- # set +x 00:28:39.385 02:11:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.385 02:11:13 -- host/discovery.sh@135 -- # sleep 1 00:28:40.319 02:11:14 -- host/discovery.sh@136 -- # get_subsystem_names 00:28:40.319 02:11:14 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:40.319 02:11:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.319 02:11:14 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:40.319 02:11:14 -- common/autotest_common.sh@10 -- # set +x 00:28:40.319 02:11:14 -- host/discovery.sh@59 -- # sort 00:28:40.319 02:11:14 -- host/discovery.sh@59 -- # xargs 00:28:40.319 02:11:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.319 02:11:14 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:28:40.319 02:11:14 -- host/discovery.sh@137 -- # get_bdev_list 00:28:40.319 02:11:14 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:40.319 02:11:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.319 02:11:14 -- common/autotest_common.sh@10 -- # set +x 00:28:40.319 02:11:14 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:40.319 02:11:14 -- host/discovery.sh@55 -- # sort 00:28:40.319 02:11:14 -- host/discovery.sh@55 -- # xargs 00:28:40.319 02:11:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.577 02:11:14 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:28:40.577 02:11:14 -- host/discovery.sh@138 -- # get_notification_count 00:28:40.578 02:11:14 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:40.578 02:11:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.578 02:11:14 -- host/discovery.sh@74 -- # jq '. | length' 00:28:40.578 02:11:14 -- common/autotest_common.sh@10 -- # set +x 00:28:40.578 02:11:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.578 02:11:14 -- host/discovery.sh@74 -- # notification_count=2 00:28:40.578 02:11:14 -- host/discovery.sh@75 -- # notify_id=4 00:28:40.578 02:11:14 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:28:40.578 02:11:14 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:40.578 02:11:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.578 02:11:14 -- common/autotest_common.sh@10 -- # set +x 00:28:41.511 [2024-11-18 02:11:15.826424] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:41.511 [2024-11-18 02:11:15.826447] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:41.511 [2024-11-18 02:11:15.826467] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:41.511 [2024-11-18 02:11:15.912772] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:28:41.770 [2024-11-18 02:11:16.013910] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:41.770 [2024-11-18 02:11:16.013950] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:41.770 02:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.770 02:11:16 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:41.770 02:11:16 -- common/autotest_common.sh@650 -- # local es=0 00:28:41.770 02:11:16 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:41.770 02:11:16 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:41.770 02:11:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:41.770 02:11:16 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:41.770 02:11:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:41.770 02:11:16 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:41.770 02:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.770 02:11:16 -- common/autotest_common.sh@10 -- # set +x 00:28:41.770 request: 00:28:41.770 { 00:28:41.770 "name": "nvme", 00:28:41.770 "trtype": "tcp", 00:28:41.770 "traddr": "10.0.0.2", 00:28:41.770 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:41.770 "adrfam": "ipv4", 00:28:41.770 "trsvcid": "8009", 00:28:41.770 "wait_for_attach": true, 00:28:41.770 "method": "bdev_nvme_start_discovery", 00:28:41.770 "req_id": 1 00:28:41.770 } 00:28:41.770 Got JSON-RPC error response 00:28:41.770 response: 00:28:41.770 { 00:28:41.770 "code": -17, 00:28:41.770 "message": "File exists" 00:28:41.770 } 00:28:41.770 02:11:16 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:41.770 02:11:16 -- common/autotest_common.sh@653 -- # es=1 00:28:41.770 02:11:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:41.770 02:11:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:41.770 02:11:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:41.770 02:11:16 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:28:41.770 02:11:16 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:41.770 02:11:16 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:41.770 02:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.770 02:11:16 -- common/autotest_common.sh@10 -- # set +x 00:28:41.770 02:11:16 -- host/discovery.sh@67 -- # sort 00:28:41.770 02:11:16 -- host/discovery.sh@67 -- # xargs 00:28:41.770 02:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.770 02:11:16 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:28:41.770 02:11:16 -- host/discovery.sh@147 -- # get_bdev_list 00:28:41.770 02:11:16 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:41.770 02:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.770 02:11:16 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:41.770 02:11:16 -- common/autotest_common.sh@10 -- # set +x 00:28:41.770 02:11:16 -- host/discovery.sh@55 -- # sort 00:28:41.770 02:11:16 -- host/discovery.sh@55 -- # xargs 00:28:41.770 02:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.770 02:11:16 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:41.770 02:11:16 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:41.770 02:11:16 -- common/autotest_common.sh@650 -- # local es=0 00:28:41.770 02:11:16 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:41.770 02:11:16 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:41.770 02:11:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:41.770 02:11:16 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:41.770 02:11:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:41.770 02:11:16 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:41.770 02:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.770 02:11:16 -- common/autotest_common.sh@10 -- # set +x 00:28:41.770 request: 00:28:41.770 { 00:28:41.770 "name": "nvme_second", 00:28:41.770 "trtype": "tcp", 00:28:41.770 "traddr": "10.0.0.2", 00:28:41.770 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:41.770 "adrfam": "ipv4", 00:28:41.770 "trsvcid": "8009", 00:28:41.770 "wait_for_attach": true, 00:28:41.770 "method": "bdev_nvme_start_discovery", 00:28:41.770 "req_id": 1 00:28:41.770 } 00:28:41.770 Got JSON-RPC error response 00:28:41.770 response: 00:28:41.770 { 00:28:41.770 "code": -17, 00:28:41.770 "message": "File exists" 00:28:41.770 } 00:28:41.770 02:11:16 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:41.770 02:11:16 -- common/autotest_common.sh@653 -- # es=1 00:28:41.770 02:11:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:41.770 02:11:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:41.770 02:11:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:41.770 02:11:16 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:28:41.770 02:11:16 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:41.770 02:11:16 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:41.770 02:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.770 02:11:16 -- common/autotest_common.sh@10 -- # set +x 00:28:41.770 02:11:16 -- host/discovery.sh@67 -- # sort 00:28:41.770 02:11:16 -- host/discovery.sh@67 -- # xargs 00:28:41.770 02:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.770 02:11:16 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:28:41.770 02:11:16 -- host/discovery.sh@153 -- # get_bdev_list 00:28:41.770 02:11:16 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:41.770 02:11:16 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:41.770 02:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.770 02:11:16 -- common/autotest_common.sh@10 -- # set +x 00:28:41.770 02:11:16 -- host/discovery.sh@55 -- # sort 00:28:41.770 02:11:16 -- host/discovery.sh@55 -- # xargs 00:28:42.028 02:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.028 02:11:16 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:42.028 02:11:16 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:42.028 02:11:16 -- common/autotest_common.sh@650 -- # local es=0 00:28:42.028 02:11:16 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:42.028 02:11:16 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:42.028 02:11:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:42.028 02:11:16 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:42.028 02:11:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:42.028 02:11:16 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:42.028 02:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.028 02:11:16 -- common/autotest_common.sh@10 -- # set +x 00:28:42.963 [2024-11-18 02:11:17.209410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.963 [2024-11-18 02:11:17.209579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.963 [2024-11-18 02:11:17.209608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a7b3c0 with addr=10.0.0.2, port=8010 00:28:42.963 [2024-11-18 02:11:17.209630] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:42.963 [2024-11-18 02:11:17.209660] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:42.963 [2024-11-18 02:11:17.209674] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:43.933 [2024-11-18 02:11:18.211913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.933 [2024-11-18 02:11:18.212073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.933 [2024-11-18 02:11:18.212101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a7b3c0 with addr=10.0.0.2, port=8010 00:28:43.933 [2024-11-18 02:11:18.212131] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:43.933 [2024-11-18 02:11:18.212146] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:43.933 [2024-11-18 02:11:18.212160] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:44.868 [2024-11-18 02:11:19.214118] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:28:44.868 request: 00:28:44.868 { 00:28:44.868 "name": "nvme_second", 00:28:44.868 "trtype": "tcp", 00:28:44.868 "traddr": "10.0.0.2", 00:28:44.868 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:44.868 "adrfam": "ipv4", 00:28:44.868 "trsvcid": "8010", 00:28:44.868 "attach_timeout_ms": 3000, 00:28:44.868 "method": "bdev_nvme_start_discovery", 00:28:44.868 "req_id": 1 00:28:44.868 } 00:28:44.868 Got JSON-RPC error response 00:28:44.868 response: 00:28:44.868 { 00:28:44.868 "code": -110, 00:28:44.868 "message": "Connection timed out" 00:28:44.868 } 00:28:44.868 02:11:19 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:44.868 02:11:19 -- common/autotest_common.sh@653 -- # es=1 00:28:44.868 02:11:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:44.868 02:11:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:44.868 02:11:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:44.868 02:11:19 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:28:44.868 02:11:19 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:44.868 02:11:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.868 02:11:19 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:44.868 02:11:19 -- common/autotest_common.sh@10 -- # set +x 00:28:44.868 02:11:19 -- host/discovery.sh@67 -- # sort 00:28:44.868 02:11:19 -- host/discovery.sh@67 -- # xargs 00:28:44.868 02:11:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.868 02:11:19 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:28:44.868 02:11:19 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:28:44.868 02:11:19 -- host/discovery.sh@162 -- # kill 1318587 00:28:44.868 02:11:19 -- host/discovery.sh@163 -- # nvmftestfini 00:28:44.868 02:11:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:44.868 02:11:19 -- nvmf/common.sh@116 -- # sync 00:28:44.868 02:11:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:44.868 02:11:19 -- nvmf/common.sh@119 -- # set +e 00:28:44.868 02:11:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:44.868 02:11:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:44.868 rmmod nvme_tcp 00:28:45.126 rmmod nvme_fabrics 00:28:45.126 rmmod nvme_keyring 00:28:45.126 02:11:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:45.126 02:11:19 -- nvmf/common.sh@123 -- # set -e 00:28:45.126 02:11:19 -- nvmf/common.sh@124 -- # return 0 00:28:45.126 02:11:19 -- nvmf/common.sh@477 -- # '[' -n 1318439 ']' 00:28:45.126 02:11:19 -- nvmf/common.sh@478 -- # killprocess 1318439 00:28:45.126 02:11:19 -- common/autotest_common.sh@936 -- # '[' -z 1318439 ']' 00:28:45.126 02:11:19 -- common/autotest_common.sh@940 -- # kill -0 1318439 00:28:45.126 02:11:19 -- common/autotest_common.sh@941 -- # uname 00:28:45.126 02:11:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:45.126 02:11:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1318439 00:28:45.126 02:11:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:45.126 02:11:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:45.126 02:11:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1318439' 00:28:45.126 killing process with pid 1318439 00:28:45.126 02:11:19 -- common/autotest_common.sh@955 -- # kill 1318439 00:28:45.126 02:11:19 -- common/autotest_common.sh@960 -- # wait 1318439 00:28:45.383 02:11:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:45.383 02:11:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:45.383 02:11:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:45.383 02:11:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:45.383 02:11:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:45.383 02:11:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:45.383 02:11:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:45.383 02:11:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:47.293 02:11:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:47.293 00:28:47.293 real 0m17.460s 00:28:47.293 user 0m26.994s 00:28:47.293 sys 0m2.881s 00:28:47.293 02:11:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:47.293 02:11:21 -- common/autotest_common.sh@10 -- # set +x 00:28:47.293 ************************************ 00:28:47.293 END TEST nvmf_discovery 00:28:47.293 ************************************ 00:28:47.293 02:11:21 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:47.293 02:11:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:47.293 02:11:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:47.293 02:11:21 -- common/autotest_common.sh@10 -- # set +x 00:28:47.293 ************************************ 00:28:47.293 START TEST nvmf_discovery_remove_ifc 00:28:47.293 ************************************ 00:28:47.293 02:11:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:47.552 * Looking for test storage... 00:28:47.552 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:47.552 02:11:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:47.552 02:11:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:47.552 02:11:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:47.552 02:11:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:47.552 02:11:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:47.552 02:11:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:47.552 02:11:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:47.552 02:11:21 -- scripts/common.sh@335 -- # IFS=.-: 00:28:47.552 02:11:21 -- scripts/common.sh@335 -- # read -ra ver1 00:28:47.552 02:11:21 -- scripts/common.sh@336 -- # IFS=.-: 00:28:47.552 02:11:21 -- scripts/common.sh@336 -- # read -ra ver2 00:28:47.552 02:11:21 -- scripts/common.sh@337 -- # local 'op=<' 00:28:47.552 02:11:21 -- scripts/common.sh@339 -- # ver1_l=2 00:28:47.552 02:11:21 -- scripts/common.sh@340 -- # ver2_l=1 00:28:47.552 02:11:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:47.552 02:11:21 -- scripts/common.sh@343 -- # case "$op" in 00:28:47.552 02:11:21 -- scripts/common.sh@344 -- # : 1 00:28:47.552 02:11:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:47.552 02:11:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:47.552 02:11:21 -- scripts/common.sh@364 -- # decimal 1 00:28:47.552 02:11:21 -- scripts/common.sh@352 -- # local d=1 00:28:47.552 02:11:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:47.552 02:11:21 -- scripts/common.sh@354 -- # echo 1 00:28:47.552 02:11:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:47.552 02:11:21 -- scripts/common.sh@365 -- # decimal 2 00:28:47.552 02:11:21 -- scripts/common.sh@352 -- # local d=2 00:28:47.552 02:11:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:47.552 02:11:21 -- scripts/common.sh@354 -- # echo 2 00:28:47.552 02:11:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:47.553 02:11:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:47.553 02:11:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:47.553 02:11:21 -- scripts/common.sh@367 -- # return 0 00:28:47.553 02:11:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:47.553 02:11:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:47.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:47.553 --rc genhtml_branch_coverage=1 00:28:47.553 --rc genhtml_function_coverage=1 00:28:47.553 --rc genhtml_legend=1 00:28:47.553 --rc geninfo_all_blocks=1 00:28:47.553 --rc geninfo_unexecuted_blocks=1 00:28:47.553 00:28:47.553 ' 00:28:47.553 02:11:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:47.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:47.553 --rc genhtml_branch_coverage=1 00:28:47.553 --rc genhtml_function_coverage=1 00:28:47.553 --rc genhtml_legend=1 00:28:47.553 --rc geninfo_all_blocks=1 00:28:47.553 --rc geninfo_unexecuted_blocks=1 00:28:47.553 00:28:47.553 ' 00:28:47.553 02:11:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:47.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:47.553 --rc genhtml_branch_coverage=1 00:28:47.553 --rc genhtml_function_coverage=1 00:28:47.553 --rc genhtml_legend=1 00:28:47.553 --rc geninfo_all_blocks=1 00:28:47.553 --rc geninfo_unexecuted_blocks=1 00:28:47.553 00:28:47.553 ' 00:28:47.553 02:11:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:47.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:47.553 --rc genhtml_branch_coverage=1 00:28:47.553 --rc genhtml_function_coverage=1 00:28:47.553 --rc genhtml_legend=1 00:28:47.553 --rc geninfo_all_blocks=1 00:28:47.553 --rc geninfo_unexecuted_blocks=1 00:28:47.553 00:28:47.553 ' 00:28:47.553 02:11:21 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:47.553 02:11:21 -- nvmf/common.sh@7 -- # uname -s 00:28:47.553 02:11:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:47.553 02:11:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:47.553 02:11:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:47.553 02:11:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:47.553 02:11:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:47.553 02:11:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:47.553 02:11:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:47.553 02:11:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:47.553 02:11:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:47.553 02:11:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:47.553 02:11:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:47.553 02:11:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:47.553 02:11:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:47.553 02:11:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:47.553 02:11:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:47.553 02:11:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:47.553 02:11:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:47.553 02:11:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:47.553 02:11:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:47.553 02:11:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:47.553 02:11:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:47.553 02:11:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:47.553 02:11:21 -- paths/export.sh@5 -- # export PATH 00:28:47.553 02:11:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:47.553 02:11:21 -- nvmf/common.sh@46 -- # : 0 00:28:47.553 02:11:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:47.553 02:11:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:47.553 02:11:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:47.553 02:11:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:47.553 02:11:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:47.553 02:11:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:47.553 02:11:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:47.553 02:11:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:47.553 02:11:21 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:28:47.553 02:11:21 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:28:47.553 02:11:21 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:28:47.553 02:11:21 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:28:47.553 02:11:21 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:28:47.553 02:11:21 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:28:47.553 02:11:21 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:28:47.553 02:11:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:47.553 02:11:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:47.553 02:11:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:47.553 02:11:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:47.553 02:11:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:47.553 02:11:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:47.553 02:11:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:47.553 02:11:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:47.553 02:11:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:47.553 02:11:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:47.553 02:11:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:47.553 02:11:21 -- common/autotest_common.sh@10 -- # set +x 00:28:50.089 02:11:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:50.089 02:11:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:50.089 02:11:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:50.089 02:11:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:50.089 02:11:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:50.089 02:11:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:50.089 02:11:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:50.089 02:11:23 -- nvmf/common.sh@294 -- # net_devs=() 00:28:50.089 02:11:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:50.089 02:11:23 -- nvmf/common.sh@295 -- # e810=() 00:28:50.089 02:11:23 -- nvmf/common.sh@295 -- # local -ga e810 00:28:50.089 02:11:23 -- nvmf/common.sh@296 -- # x722=() 00:28:50.089 02:11:23 -- nvmf/common.sh@296 -- # local -ga x722 00:28:50.089 02:11:23 -- nvmf/common.sh@297 -- # mlx=() 00:28:50.089 02:11:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:50.089 02:11:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:50.089 02:11:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:50.089 02:11:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:50.089 02:11:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:50.089 02:11:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:50.089 02:11:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:50.089 02:11:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:50.089 02:11:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:50.089 02:11:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:50.089 02:11:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:50.089 02:11:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:50.089 02:11:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:50.089 02:11:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:50.089 02:11:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:50.089 02:11:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:50.089 02:11:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:50.089 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:50.089 02:11:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:50.089 02:11:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:50.089 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:50.089 02:11:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:50.089 02:11:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:50.089 02:11:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:50.089 02:11:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:50.089 02:11:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:50.089 02:11:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:50.089 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:50.089 02:11:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:50.089 02:11:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:50.089 02:11:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:50.089 02:11:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:50.089 02:11:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:50.089 02:11:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:50.089 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:50.089 02:11:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:50.089 02:11:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:50.089 02:11:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:50.089 02:11:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:50.089 02:11:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:50.089 02:11:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:50.089 02:11:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:50.089 02:11:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:50.089 02:11:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:50.089 02:11:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:50.089 02:11:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:50.089 02:11:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:50.089 02:11:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:50.089 02:11:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:50.089 02:11:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:50.089 02:11:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:50.089 02:11:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:50.089 02:11:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:50.089 02:11:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:50.089 02:11:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:50.089 02:11:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:50.089 02:11:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:50.089 02:11:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:50.089 02:11:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:50.089 02:11:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:50.090 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:50.090 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:28:50.090 00:28:50.090 --- 10.0.0.2 ping statistics --- 00:28:50.090 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:50.090 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:28:50.090 02:11:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:50.090 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:50.090 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:28:50.090 00:28:50.090 --- 10.0.0.1 ping statistics --- 00:28:50.090 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:50.090 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:28:50.090 02:11:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:50.090 02:11:23 -- nvmf/common.sh@410 -- # return 0 00:28:50.090 02:11:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:50.090 02:11:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:50.090 02:11:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:50.090 02:11:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:50.090 02:11:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:50.090 02:11:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:50.090 02:11:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:50.090 02:11:24 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:28:50.090 02:11:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:50.090 02:11:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:50.090 02:11:24 -- common/autotest_common.sh@10 -- # set +x 00:28:50.090 02:11:24 -- nvmf/common.sh@469 -- # nvmfpid=1322077 00:28:50.090 02:11:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:50.090 02:11:24 -- nvmf/common.sh@470 -- # waitforlisten 1322077 00:28:50.090 02:11:24 -- common/autotest_common.sh@829 -- # '[' -z 1322077 ']' 00:28:50.090 02:11:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:50.090 02:11:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:50.090 02:11:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:50.090 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:50.090 02:11:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:50.090 02:11:24 -- common/autotest_common.sh@10 -- # set +x 00:28:50.090 [2024-11-18 02:11:24.063796] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:50.090 [2024-11-18 02:11:24.063882] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:50.090 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.090 [2024-11-18 02:11:24.125965] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:50.090 [2024-11-18 02:11:24.208009] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:50.090 [2024-11-18 02:11:24.208170] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:50.090 [2024-11-18 02:11:24.208188] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:50.090 [2024-11-18 02:11:24.208200] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:50.090 [2024-11-18 02:11:24.208229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:50.657 02:11:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:50.657 02:11:25 -- common/autotest_common.sh@862 -- # return 0 00:28:50.657 02:11:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:50.657 02:11:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:50.657 02:11:25 -- common/autotest_common.sh@10 -- # set +x 00:28:50.916 02:11:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:50.916 02:11:25 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:28:50.916 02:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.916 02:11:25 -- common/autotest_common.sh@10 -- # set +x 00:28:50.916 [2024-11-18 02:11:25.081203] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:50.916 [2024-11-18 02:11:25.089401] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:50.916 null0 00:28:50.916 [2024-11-18 02:11:25.121374] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:50.916 02:11:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.916 02:11:25 -- host/discovery_remove_ifc.sh@59 -- # hostpid=1322232 00:28:50.916 02:11:25 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:28:50.916 02:11:25 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 1322232 /tmp/host.sock 00:28:50.916 02:11:25 -- common/autotest_common.sh@829 -- # '[' -z 1322232 ']' 00:28:50.916 02:11:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:50.916 02:11:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:50.916 02:11:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:50.916 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:50.916 02:11:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:50.916 02:11:25 -- common/autotest_common.sh@10 -- # set +x 00:28:50.916 [2024-11-18 02:11:25.186748] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:50.916 [2024-11-18 02:11:25.186825] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1322232 ] 00:28:50.916 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.916 [2024-11-18 02:11:25.254711] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:51.174 [2024-11-18 02:11:25.344159] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:51.174 [2024-11-18 02:11:25.344333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:51.174 02:11:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:51.174 02:11:25 -- common/autotest_common.sh@862 -- # return 0 00:28:51.174 02:11:25 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:51.174 02:11:25 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:28:51.174 02:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.174 02:11:25 -- common/autotest_common.sh@10 -- # set +x 00:28:51.174 02:11:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.174 02:11:25 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:28:51.174 02:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.174 02:11:25 -- common/autotest_common.sh@10 -- # set +x 00:28:51.174 02:11:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.174 02:11:25 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:28:51.174 02:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.174 02:11:25 -- common/autotest_common.sh@10 -- # set +x 00:28:52.546 [2024-11-18 02:11:26.608957] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:52.546 [2024-11-18 02:11:26.608992] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:52.546 [2024-11-18 02:11:26.609017] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:52.546 [2024-11-18 02:11:26.737469] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:52.546 [2024-11-18 02:11:26.840278] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:28:52.546 [2024-11-18 02:11:26.840358] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:28:52.546 [2024-11-18 02:11:26.840400] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:28:52.546 [2024-11-18 02:11:26.840427] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:52.546 [2024-11-18 02:11:26.840451] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:52.546 02:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:52.546 02:11:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.546 02:11:26 -- common/autotest_common.sh@10 -- # set +x 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:52.546 02:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:28:52.546 [2024-11-18 02:11:26.888008] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xb5e4b0 was disconnected and freed. delete nvme_qpair. 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:52.546 02:11:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:52.546 02:11:26 -- common/autotest_common.sh@10 -- # set +x 00:28:52.546 02:11:26 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:52.804 02:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.804 02:11:26 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:52.804 02:11:26 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:53.737 02:11:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:53.737 02:11:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:53.737 02:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:53.737 02:11:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:53.737 02:11:27 -- common/autotest_common.sh@10 -- # set +x 00:28:53.737 02:11:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:53.737 02:11:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:53.737 02:11:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:53.737 02:11:28 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:53.737 02:11:28 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:54.670 02:11:29 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:54.670 02:11:29 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:54.670 02:11:29 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:54.670 02:11:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.670 02:11:29 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:54.670 02:11:29 -- common/autotest_common.sh@10 -- # set +x 00:28:54.670 02:11:29 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:54.670 02:11:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.670 02:11:29 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:54.670 02:11:29 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:56.050 02:11:30 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:56.050 02:11:30 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:56.050 02:11:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.050 02:11:30 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:56.050 02:11:30 -- common/autotest_common.sh@10 -- # set +x 00:28:56.050 02:11:30 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:56.050 02:11:30 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:56.050 02:11:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.050 02:11:30 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:56.050 02:11:30 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:56.983 02:11:31 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:56.983 02:11:31 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:56.983 02:11:31 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:56.983 02:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.983 02:11:31 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:56.983 02:11:31 -- common/autotest_common.sh@10 -- # set +x 00:28:56.983 02:11:31 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:56.983 02:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.983 02:11:31 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:56.983 02:11:31 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:57.918 02:11:32 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:57.918 02:11:32 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.918 02:11:32 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:57.918 02:11:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.918 02:11:32 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:57.918 02:11:32 -- common/autotest_common.sh@10 -- # set +x 00:28:57.918 02:11:32 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:57.918 02:11:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.918 02:11:32 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:57.918 02:11:32 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:57.918 [2024-11-18 02:11:32.281251] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:28:57.918 [2024-11-18 02:11:32.281321] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:57.918 [2024-11-18 02:11:32.281346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:57.918 [2024-11-18 02:11:32.281389] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:57.918 [2024-11-18 02:11:32.281402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:57.918 [2024-11-18 02:11:32.281414] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:57.918 [2024-11-18 02:11:32.281433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:57.919 [2024-11-18 02:11:32.281446] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:57.919 [2024-11-18 02:11:32.281458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:57.919 [2024-11-18 02:11:32.281471] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:57.919 [2024-11-18 02:11:32.281483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:57.919 [2024-11-18 02:11:32.281495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb25790 is same with the state(5) to be set 00:28:57.919 [2024-11-18 02:11:32.291268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb25790 (9): Bad file descriptor 00:28:57.919 [2024-11-18 02:11:32.301327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:58.852 02:11:33 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:58.852 02:11:33 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:58.852 02:11:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.852 02:11:33 -- common/autotest_common.sh@10 -- # set +x 00:28:58.852 02:11:33 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:58.852 02:11:33 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:58.852 02:11:33 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:59.110 [2024-11-18 02:11:33.325338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:00.043 [2024-11-18 02:11:34.349349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:00.043 [2024-11-18 02:11:34.349399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb25790 with addr=10.0.0.2, port=4420 00:29:00.043 [2024-11-18 02:11:34.349433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb25790 is same with the state(5) to be set 00:29:00.043 [2024-11-18 02:11:34.349465] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:00.043 [2024-11-18 02:11:34.349482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:00.043 [2024-11-18 02:11:34.349496] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:00.043 [2024-11-18 02:11:34.349513] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:00.043 [2024-11-18 02:11:34.349906] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb25790 (9): Bad file descriptor 00:29:00.043 [2024-11-18 02:11:34.349946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:00.043 [2024-11-18 02:11:34.349986] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:00.043 [2024-11-18 02:11:34.350022] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:00.043 [2024-11-18 02:11:34.350044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:00.043 [2024-11-18 02:11:34.350062] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:00.043 [2024-11-18 02:11:34.350076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:00.043 [2024-11-18 02:11:34.350092] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:00.043 [2024-11-18 02:11:34.350106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:00.043 [2024-11-18 02:11:34.350122] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:00.043 [2024-11-18 02:11:34.350136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:00.043 [2024-11-18 02:11:34.350151] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:00.043 [2024-11-18 02:11:34.350165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:00.043 [2024-11-18 02:11:34.350180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:00.043 [2024-11-18 02:11:34.350467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb24c40 (9): Bad file descriptor 00:29:00.043 [2024-11-18 02:11:34.351482] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:00.043 [2024-11-18 02:11:34.351503] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:00.043 02:11:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.043 02:11:34 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:00.043 02:11:34 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:00.976 02:11:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:00.977 02:11:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:00.977 02:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.977 02:11:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:00.977 02:11:35 -- common/autotest_common.sh@10 -- # set +x 00:29:00.977 02:11:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:00.977 02:11:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:00.977 02:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.235 02:11:35 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:01.235 02:11:35 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:01.235 02:11:35 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:01.235 02:11:35 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:01.235 02:11:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:01.235 02:11:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:01.235 02:11:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:01.235 02:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.235 02:11:35 -- common/autotest_common.sh@10 -- # set +x 00:29:01.235 02:11:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:01.235 02:11:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:01.235 02:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.235 02:11:35 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:01.235 02:11:35 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:02.169 [2024-11-18 02:11:36.405445] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:02.169 [2024-11-18 02:11:36.405467] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:02.169 [2024-11-18 02:11:36.405488] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:02.169 02:11:36 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:02.169 02:11:36 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.169 02:11:36 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:02.169 02:11:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.169 02:11:36 -- common/autotest_common.sh@10 -- # set +x 00:29:02.169 02:11:36 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:02.169 02:11:36 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:02.169 02:11:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.169 [2024-11-18 02:11:36.492780] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:02.169 02:11:36 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:02.169 02:11:36 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:02.427 [2024-11-18 02:11:36.716169] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:02.427 [2024-11-18 02:11:36.716220] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:02.427 [2024-11-18 02:11:36.716256] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:02.427 [2024-11-18 02:11:36.716281] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:02.427 [2024-11-18 02:11:36.716295] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:02.427 [2024-11-18 02:11:36.723821] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xb69180 was disconnected and freed. delete nvme_qpair. 00:29:03.360 02:11:37 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:03.360 02:11:37 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:03.360 02:11:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.360 02:11:37 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:03.360 02:11:37 -- common/autotest_common.sh@10 -- # set +x 00:29:03.360 02:11:37 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:03.360 02:11:37 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:03.360 02:11:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.360 02:11:37 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:03.361 02:11:37 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:03.361 02:11:37 -- host/discovery_remove_ifc.sh@90 -- # killprocess 1322232 00:29:03.361 02:11:37 -- common/autotest_common.sh@936 -- # '[' -z 1322232 ']' 00:29:03.361 02:11:37 -- common/autotest_common.sh@940 -- # kill -0 1322232 00:29:03.361 02:11:37 -- common/autotest_common.sh@941 -- # uname 00:29:03.361 02:11:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:03.361 02:11:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1322232 00:29:03.361 02:11:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:03.361 02:11:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:03.361 02:11:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1322232' 00:29:03.361 killing process with pid 1322232 00:29:03.361 02:11:37 -- common/autotest_common.sh@955 -- # kill 1322232 00:29:03.361 02:11:37 -- common/autotest_common.sh@960 -- # wait 1322232 00:29:03.619 02:11:37 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:03.619 02:11:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:03.619 02:11:37 -- nvmf/common.sh@116 -- # sync 00:29:03.619 02:11:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:03.619 02:11:37 -- nvmf/common.sh@119 -- # set +e 00:29:03.619 02:11:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:03.619 02:11:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:03.619 rmmod nvme_tcp 00:29:03.619 rmmod nvme_fabrics 00:29:03.619 rmmod nvme_keyring 00:29:03.619 02:11:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:03.619 02:11:37 -- nvmf/common.sh@123 -- # set -e 00:29:03.619 02:11:37 -- nvmf/common.sh@124 -- # return 0 00:29:03.619 02:11:37 -- nvmf/common.sh@477 -- # '[' -n 1322077 ']' 00:29:03.619 02:11:37 -- nvmf/common.sh@478 -- # killprocess 1322077 00:29:03.619 02:11:37 -- common/autotest_common.sh@936 -- # '[' -z 1322077 ']' 00:29:03.619 02:11:37 -- common/autotest_common.sh@940 -- # kill -0 1322077 00:29:03.619 02:11:37 -- common/autotest_common.sh@941 -- # uname 00:29:03.619 02:11:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:03.619 02:11:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1322077 00:29:03.619 02:11:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:03.619 02:11:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:03.619 02:11:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1322077' 00:29:03.619 killing process with pid 1322077 00:29:03.619 02:11:37 -- common/autotest_common.sh@955 -- # kill 1322077 00:29:03.619 02:11:37 -- common/autotest_common.sh@960 -- # wait 1322077 00:29:03.878 02:11:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:03.878 02:11:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:03.878 02:11:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:03.878 02:11:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:03.878 02:11:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:03.878 02:11:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:03.878 02:11:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:03.878 02:11:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:06.413 02:11:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:06.413 00:29:06.413 real 0m18.510s 00:29:06.413 user 0m25.705s 00:29:06.413 sys 0m2.980s 00:29:06.413 02:11:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:06.413 02:11:40 -- common/autotest_common.sh@10 -- # set +x 00:29:06.413 ************************************ 00:29:06.413 END TEST nvmf_discovery_remove_ifc 00:29:06.413 ************************************ 00:29:06.413 02:11:40 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:06.413 02:11:40 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:06.413 02:11:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:06.413 02:11:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:06.413 02:11:40 -- common/autotest_common.sh@10 -- # set +x 00:29:06.413 ************************************ 00:29:06.413 START TEST nvmf_digest 00:29:06.413 ************************************ 00:29:06.413 02:11:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:06.413 * Looking for test storage... 00:29:06.413 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:06.413 02:11:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:06.413 02:11:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:06.413 02:11:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:06.413 02:11:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:06.413 02:11:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:06.413 02:11:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:06.413 02:11:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:06.413 02:11:40 -- scripts/common.sh@335 -- # IFS=.-: 00:29:06.413 02:11:40 -- scripts/common.sh@335 -- # read -ra ver1 00:29:06.413 02:11:40 -- scripts/common.sh@336 -- # IFS=.-: 00:29:06.413 02:11:40 -- scripts/common.sh@336 -- # read -ra ver2 00:29:06.413 02:11:40 -- scripts/common.sh@337 -- # local 'op=<' 00:29:06.413 02:11:40 -- scripts/common.sh@339 -- # ver1_l=2 00:29:06.413 02:11:40 -- scripts/common.sh@340 -- # ver2_l=1 00:29:06.413 02:11:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:06.413 02:11:40 -- scripts/common.sh@343 -- # case "$op" in 00:29:06.413 02:11:40 -- scripts/common.sh@344 -- # : 1 00:29:06.413 02:11:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:06.413 02:11:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:06.413 02:11:40 -- scripts/common.sh@364 -- # decimal 1 00:29:06.413 02:11:40 -- scripts/common.sh@352 -- # local d=1 00:29:06.413 02:11:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:06.413 02:11:40 -- scripts/common.sh@354 -- # echo 1 00:29:06.413 02:11:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:06.413 02:11:40 -- scripts/common.sh@365 -- # decimal 2 00:29:06.413 02:11:40 -- scripts/common.sh@352 -- # local d=2 00:29:06.413 02:11:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:06.413 02:11:40 -- scripts/common.sh@354 -- # echo 2 00:29:06.413 02:11:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:06.413 02:11:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:06.413 02:11:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:06.413 02:11:40 -- scripts/common.sh@367 -- # return 0 00:29:06.413 02:11:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:06.413 02:11:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:06.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:06.413 --rc genhtml_branch_coverage=1 00:29:06.413 --rc genhtml_function_coverage=1 00:29:06.413 --rc genhtml_legend=1 00:29:06.413 --rc geninfo_all_blocks=1 00:29:06.413 --rc geninfo_unexecuted_blocks=1 00:29:06.413 00:29:06.413 ' 00:29:06.413 02:11:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:06.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:06.413 --rc genhtml_branch_coverage=1 00:29:06.413 --rc genhtml_function_coverage=1 00:29:06.413 --rc genhtml_legend=1 00:29:06.413 --rc geninfo_all_blocks=1 00:29:06.413 --rc geninfo_unexecuted_blocks=1 00:29:06.413 00:29:06.413 ' 00:29:06.413 02:11:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:06.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:06.413 --rc genhtml_branch_coverage=1 00:29:06.413 --rc genhtml_function_coverage=1 00:29:06.413 --rc genhtml_legend=1 00:29:06.413 --rc geninfo_all_blocks=1 00:29:06.413 --rc geninfo_unexecuted_blocks=1 00:29:06.413 00:29:06.413 ' 00:29:06.413 02:11:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:06.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:06.413 --rc genhtml_branch_coverage=1 00:29:06.413 --rc genhtml_function_coverage=1 00:29:06.413 --rc genhtml_legend=1 00:29:06.413 --rc geninfo_all_blocks=1 00:29:06.413 --rc geninfo_unexecuted_blocks=1 00:29:06.413 00:29:06.413 ' 00:29:06.413 02:11:40 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:06.413 02:11:40 -- nvmf/common.sh@7 -- # uname -s 00:29:06.413 02:11:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:06.413 02:11:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:06.413 02:11:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:06.413 02:11:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:06.413 02:11:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:06.413 02:11:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:06.413 02:11:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:06.413 02:11:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:06.413 02:11:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:06.413 02:11:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:06.413 02:11:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:06.413 02:11:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:06.413 02:11:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:06.413 02:11:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:06.413 02:11:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:06.413 02:11:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:06.413 02:11:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:06.413 02:11:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:06.413 02:11:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:06.413 02:11:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:06.413 02:11:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:06.413 02:11:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:06.413 02:11:40 -- paths/export.sh@5 -- # export PATH 00:29:06.413 02:11:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:06.413 02:11:40 -- nvmf/common.sh@46 -- # : 0 00:29:06.413 02:11:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:06.413 02:11:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:06.414 02:11:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:06.414 02:11:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:06.414 02:11:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:06.414 02:11:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:06.414 02:11:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:06.414 02:11:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:06.414 02:11:40 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:06.414 02:11:40 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:06.414 02:11:40 -- host/digest.sh@16 -- # runtime=2 00:29:06.414 02:11:40 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:06.414 02:11:40 -- host/digest.sh@132 -- # nvmftestinit 00:29:06.414 02:11:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:06.414 02:11:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:06.414 02:11:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:06.414 02:11:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:06.414 02:11:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:06.414 02:11:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:06.414 02:11:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:06.414 02:11:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:06.414 02:11:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:06.414 02:11:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:06.414 02:11:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:06.414 02:11:40 -- common/autotest_common.sh@10 -- # set +x 00:29:08.314 02:11:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:08.314 02:11:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:08.314 02:11:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:08.314 02:11:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:08.314 02:11:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:08.314 02:11:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:08.314 02:11:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:08.314 02:11:42 -- nvmf/common.sh@294 -- # net_devs=() 00:29:08.314 02:11:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:08.314 02:11:42 -- nvmf/common.sh@295 -- # e810=() 00:29:08.314 02:11:42 -- nvmf/common.sh@295 -- # local -ga e810 00:29:08.314 02:11:42 -- nvmf/common.sh@296 -- # x722=() 00:29:08.314 02:11:42 -- nvmf/common.sh@296 -- # local -ga x722 00:29:08.314 02:11:42 -- nvmf/common.sh@297 -- # mlx=() 00:29:08.314 02:11:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:08.314 02:11:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:08.314 02:11:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:08.314 02:11:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:08.314 02:11:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:08.314 02:11:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:08.314 02:11:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:08.314 02:11:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:08.314 02:11:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:08.314 02:11:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:08.314 02:11:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:08.314 02:11:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:08.315 02:11:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:08.315 02:11:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:08.315 02:11:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:08.315 02:11:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:08.315 02:11:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:08.315 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:08.315 02:11:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:08.315 02:11:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:08.315 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:08.315 02:11:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:08.315 02:11:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:08.315 02:11:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:08.315 02:11:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:08.315 02:11:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:08.315 02:11:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:08.315 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:08.315 02:11:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:08.315 02:11:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:08.315 02:11:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:08.315 02:11:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:08.315 02:11:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:08.315 02:11:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:08.315 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:08.315 02:11:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:08.315 02:11:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:08.315 02:11:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:08.315 02:11:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:08.315 02:11:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:08.315 02:11:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:08.315 02:11:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:08.315 02:11:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:08.315 02:11:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:08.315 02:11:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:08.315 02:11:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:08.315 02:11:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:08.315 02:11:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:08.315 02:11:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:08.315 02:11:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:08.315 02:11:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:08.315 02:11:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:08.315 02:11:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:08.315 02:11:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:08.315 02:11:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:08.315 02:11:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:08.315 02:11:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:08.315 02:11:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:08.315 02:11:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:08.315 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:08.315 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.286 ms 00:29:08.315 00:29:08.315 --- 10.0.0.2 ping statistics --- 00:29:08.315 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:08.315 rtt min/avg/max/mdev = 0.286/0.286/0.286/0.000 ms 00:29:08.315 02:11:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:08.315 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:08.315 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:29:08.315 00:29:08.315 --- 10.0.0.1 ping statistics --- 00:29:08.315 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:08.315 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:29:08.315 02:11:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:08.315 02:11:42 -- nvmf/common.sh@410 -- # return 0 00:29:08.315 02:11:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:08.315 02:11:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:08.315 02:11:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:08.315 02:11:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:08.315 02:11:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:08.315 02:11:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:08.315 02:11:42 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:08.315 02:11:42 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:08.315 02:11:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:08.315 02:11:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:08.315 02:11:42 -- common/autotest_common.sh@10 -- # set +x 00:29:08.315 ************************************ 00:29:08.315 START TEST nvmf_digest_clean 00:29:08.315 ************************************ 00:29:08.315 02:11:42 -- common/autotest_common.sh@1114 -- # run_digest 00:29:08.315 02:11:42 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:08.315 02:11:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:08.315 02:11:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:08.315 02:11:42 -- common/autotest_common.sh@10 -- # set +x 00:29:08.315 02:11:42 -- nvmf/common.sh@469 -- # nvmfpid=1325751 00:29:08.315 02:11:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:08.315 02:11:42 -- nvmf/common.sh@470 -- # waitforlisten 1325751 00:29:08.315 02:11:42 -- common/autotest_common.sh@829 -- # '[' -z 1325751 ']' 00:29:08.315 02:11:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:08.315 02:11:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:08.315 02:11:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:08.315 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:08.315 02:11:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:08.315 02:11:42 -- common/autotest_common.sh@10 -- # set +x 00:29:08.315 [2024-11-18 02:11:42.614938] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:08.315 [2024-11-18 02:11:42.615031] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:08.315 EAL: No free 2048 kB hugepages reported on node 1 00:29:08.315 [2024-11-18 02:11:42.676762] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:08.574 [2024-11-18 02:11:42.759949] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:08.574 [2024-11-18 02:11:42.760111] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:08.574 [2024-11-18 02:11:42.760128] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:08.574 [2024-11-18 02:11:42.760141] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:08.574 [2024-11-18 02:11:42.760176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:08.574 02:11:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:08.574 02:11:42 -- common/autotest_common.sh@862 -- # return 0 00:29:08.574 02:11:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:08.574 02:11:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:08.574 02:11:42 -- common/autotest_common.sh@10 -- # set +x 00:29:08.574 02:11:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:08.574 02:11:42 -- host/digest.sh@120 -- # common_target_config 00:29:08.574 02:11:42 -- host/digest.sh@43 -- # rpc_cmd 00:29:08.574 02:11:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.574 02:11:42 -- common/autotest_common.sh@10 -- # set +x 00:29:08.574 null0 00:29:08.574 [2024-11-18 02:11:42.959170] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:08.832 [2024-11-18 02:11:42.983423] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:08.832 02:11:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.832 02:11:42 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:08.832 02:11:42 -- host/digest.sh@77 -- # local rw bs qd 00:29:08.832 02:11:42 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:08.833 02:11:42 -- host/digest.sh@80 -- # rw=randread 00:29:08.833 02:11:42 -- host/digest.sh@80 -- # bs=4096 00:29:08.833 02:11:42 -- host/digest.sh@80 -- # qd=128 00:29:08.833 02:11:42 -- host/digest.sh@82 -- # bperfpid=1325873 00:29:08.833 02:11:42 -- host/digest.sh@83 -- # waitforlisten 1325873 /var/tmp/bperf.sock 00:29:08.833 02:11:42 -- common/autotest_common.sh@829 -- # '[' -z 1325873 ']' 00:29:08.833 02:11:42 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:08.833 02:11:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:08.833 02:11:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:08.833 02:11:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:08.833 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:08.833 02:11:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:08.833 02:11:42 -- common/autotest_common.sh@10 -- # set +x 00:29:08.833 [2024-11-18 02:11:43.033708] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:08.833 [2024-11-18 02:11:43.033796] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1325873 ] 00:29:08.833 EAL: No free 2048 kB hugepages reported on node 1 00:29:08.833 [2024-11-18 02:11:43.092959] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:08.833 [2024-11-18 02:11:43.177191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:09.090 02:11:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:09.090 02:11:43 -- common/autotest_common.sh@862 -- # return 0 00:29:09.090 02:11:43 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:09.090 02:11:43 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:09.090 02:11:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:09.349 02:11:43 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:09.349 02:11:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:09.607 nvme0n1 00:29:09.607 02:11:43 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:09.607 02:11:43 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:09.865 Running I/O for 2 seconds... 00:29:11.765 00:29:11.765 Latency(us) 00:29:11.765 [2024-11-18T01:11:46.167Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:11.765 [2024-11-18T01:11:46.167Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:11.765 nvme0n1 : 2.00 15951.81 62.31 0.00 0.00 8015.79 3446.71 18544.26 00:29:11.765 [2024-11-18T01:11:46.167Z] =================================================================================================================== 00:29:11.765 [2024-11-18T01:11:46.167Z] Total : 15951.81 62.31 0.00 0.00 8015.79 3446.71 18544.26 00:29:11.765 0 00:29:11.765 02:11:46 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:11.765 02:11:46 -- host/digest.sh@92 -- # get_accel_stats 00:29:11.765 02:11:46 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:11.765 02:11:46 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:11.765 | select(.opcode=="crc32c") 00:29:11.765 | "\(.module_name) \(.executed)"' 00:29:11.765 02:11:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:12.024 02:11:46 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:12.024 02:11:46 -- host/digest.sh@93 -- # exp_module=software 00:29:12.024 02:11:46 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:12.024 02:11:46 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:12.024 02:11:46 -- host/digest.sh@97 -- # killprocess 1325873 00:29:12.024 02:11:46 -- common/autotest_common.sh@936 -- # '[' -z 1325873 ']' 00:29:12.024 02:11:46 -- common/autotest_common.sh@940 -- # kill -0 1325873 00:29:12.024 02:11:46 -- common/autotest_common.sh@941 -- # uname 00:29:12.024 02:11:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:12.024 02:11:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1325873 00:29:12.283 02:11:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:12.283 02:11:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:12.283 02:11:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1325873' 00:29:12.283 killing process with pid 1325873 00:29:12.283 02:11:46 -- common/autotest_common.sh@955 -- # kill 1325873 00:29:12.283 Received shutdown signal, test time was about 2.000000 seconds 00:29:12.283 00:29:12.283 Latency(us) 00:29:12.283 [2024-11-18T01:11:46.685Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:12.283 [2024-11-18T01:11:46.685Z] =================================================================================================================== 00:29:12.283 [2024-11-18T01:11:46.685Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:12.283 02:11:46 -- common/autotest_common.sh@960 -- # wait 1325873 00:29:12.283 02:11:46 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:12.283 02:11:46 -- host/digest.sh@77 -- # local rw bs qd 00:29:12.283 02:11:46 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:12.283 02:11:46 -- host/digest.sh@80 -- # rw=randread 00:29:12.283 02:11:46 -- host/digest.sh@80 -- # bs=131072 00:29:12.283 02:11:46 -- host/digest.sh@80 -- # qd=16 00:29:12.283 02:11:46 -- host/digest.sh@82 -- # bperfpid=1326317 00:29:12.283 02:11:46 -- host/digest.sh@83 -- # waitforlisten 1326317 /var/tmp/bperf.sock 00:29:12.283 02:11:46 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:12.283 02:11:46 -- common/autotest_common.sh@829 -- # '[' -z 1326317 ']' 00:29:12.283 02:11:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:12.283 02:11:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:12.283 02:11:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:12.283 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:12.283 02:11:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:12.283 02:11:46 -- common/autotest_common.sh@10 -- # set +x 00:29:12.283 [2024-11-18 02:11:46.684546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:12.283 [2024-11-18 02:11:46.684651] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1326317 ] 00:29:12.283 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:12.283 Zero copy mechanism will not be used. 00:29:12.550 EAL: No free 2048 kB hugepages reported on node 1 00:29:12.550 [2024-11-18 02:11:46.744284] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:12.551 [2024-11-18 02:11:46.829398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:12.551 02:11:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:12.551 02:11:46 -- common/autotest_common.sh@862 -- # return 0 00:29:12.551 02:11:46 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:12.551 02:11:46 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:12.551 02:11:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:12.874 02:11:47 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:12.874 02:11:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:13.441 nvme0n1 00:29:13.441 02:11:47 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:13.441 02:11:47 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:13.441 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:13.441 Zero copy mechanism will not be used. 00:29:13.441 Running I/O for 2 seconds... 00:29:15.975 00:29:15.975 Latency(us) 00:29:15.975 [2024-11-18T01:11:50.377Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:15.975 [2024-11-18T01:11:50.377Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:15.975 nvme0n1 : 2.00 5632.83 704.10 0.00 0.00 2836.43 976.97 7233.23 00:29:15.975 [2024-11-18T01:11:50.377Z] =================================================================================================================== 00:29:15.975 [2024-11-18T01:11:50.377Z] Total : 5632.83 704.10 0.00 0.00 2836.43 976.97 7233.23 00:29:15.975 0 00:29:15.975 02:11:49 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:15.975 02:11:49 -- host/digest.sh@92 -- # get_accel_stats 00:29:15.975 02:11:49 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:15.975 02:11:49 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:15.975 | select(.opcode=="crc32c") 00:29:15.975 | "\(.module_name) \(.executed)"' 00:29:15.975 02:11:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:15.975 02:11:50 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:15.975 02:11:50 -- host/digest.sh@93 -- # exp_module=software 00:29:15.975 02:11:50 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:15.975 02:11:50 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:15.975 02:11:50 -- host/digest.sh@97 -- # killprocess 1326317 00:29:15.975 02:11:50 -- common/autotest_common.sh@936 -- # '[' -z 1326317 ']' 00:29:15.975 02:11:50 -- common/autotest_common.sh@940 -- # kill -0 1326317 00:29:15.975 02:11:50 -- common/autotest_common.sh@941 -- # uname 00:29:15.975 02:11:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:15.975 02:11:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1326317 00:29:15.975 02:11:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:15.975 02:11:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:15.975 02:11:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1326317' 00:29:15.975 killing process with pid 1326317 00:29:15.975 02:11:50 -- common/autotest_common.sh@955 -- # kill 1326317 00:29:15.975 Received shutdown signal, test time was about 2.000000 seconds 00:29:15.975 00:29:15.975 Latency(us) 00:29:15.975 [2024-11-18T01:11:50.377Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:15.975 [2024-11-18T01:11:50.377Z] =================================================================================================================== 00:29:15.975 [2024-11-18T01:11:50.377Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:15.975 02:11:50 -- common/autotest_common.sh@960 -- # wait 1326317 00:29:15.975 02:11:50 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:15.975 02:11:50 -- host/digest.sh@77 -- # local rw bs qd 00:29:15.976 02:11:50 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:15.976 02:11:50 -- host/digest.sh@80 -- # rw=randwrite 00:29:15.976 02:11:50 -- host/digest.sh@80 -- # bs=4096 00:29:15.976 02:11:50 -- host/digest.sh@80 -- # qd=128 00:29:15.976 02:11:50 -- host/digest.sh@82 -- # bperfpid=1326749 00:29:15.976 02:11:50 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:15.976 02:11:50 -- host/digest.sh@83 -- # waitforlisten 1326749 /var/tmp/bperf.sock 00:29:15.976 02:11:50 -- common/autotest_common.sh@829 -- # '[' -z 1326749 ']' 00:29:15.976 02:11:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:15.976 02:11:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:15.976 02:11:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:15.976 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:15.976 02:11:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:15.976 02:11:50 -- common/autotest_common.sh@10 -- # set +x 00:29:16.234 [2024-11-18 02:11:50.382082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:16.234 [2024-11-18 02:11:50.382173] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1326749 ] 00:29:16.234 EAL: No free 2048 kB hugepages reported on node 1 00:29:16.234 [2024-11-18 02:11:50.442091] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:16.234 [2024-11-18 02:11:50.527171] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:16.234 02:11:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:16.234 02:11:50 -- common/autotest_common.sh@862 -- # return 0 00:29:16.234 02:11:50 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:16.234 02:11:50 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:16.234 02:11:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:16.801 02:11:50 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:16.801 02:11:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:17.061 nvme0n1 00:29:17.061 02:11:51 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:17.061 02:11:51 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:17.061 Running I/O for 2 seconds... 00:29:19.598 00:29:19.598 Latency(us) 00:29:19.598 [2024-11-18T01:11:54.000Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:19.598 [2024-11-18T01:11:54.000Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:19.598 nvme0n1 : 2.01 18566.62 72.53 0.00 0.00 6878.80 2936.98 10048.85 00:29:19.598 [2024-11-18T01:11:54.000Z] =================================================================================================================== 00:29:19.598 [2024-11-18T01:11:54.000Z] Total : 18566.62 72.53 0.00 0.00 6878.80 2936.98 10048.85 00:29:19.598 0 00:29:19.598 02:11:53 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:19.598 02:11:53 -- host/digest.sh@92 -- # get_accel_stats 00:29:19.598 02:11:53 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:19.598 02:11:53 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:19.598 | select(.opcode=="crc32c") 00:29:19.598 | "\(.module_name) \(.executed)"' 00:29:19.598 02:11:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:19.598 02:11:53 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:19.598 02:11:53 -- host/digest.sh@93 -- # exp_module=software 00:29:19.598 02:11:53 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:19.598 02:11:53 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:19.598 02:11:53 -- host/digest.sh@97 -- # killprocess 1326749 00:29:19.598 02:11:53 -- common/autotest_common.sh@936 -- # '[' -z 1326749 ']' 00:29:19.598 02:11:53 -- common/autotest_common.sh@940 -- # kill -0 1326749 00:29:19.598 02:11:53 -- common/autotest_common.sh@941 -- # uname 00:29:19.598 02:11:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:19.598 02:11:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1326749 00:29:19.598 02:11:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:19.598 02:11:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:19.598 02:11:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1326749' 00:29:19.598 killing process with pid 1326749 00:29:19.598 02:11:53 -- common/autotest_common.sh@955 -- # kill 1326749 00:29:19.598 Received shutdown signal, test time was about 2.000000 seconds 00:29:19.598 00:29:19.598 Latency(us) 00:29:19.598 [2024-11-18T01:11:54.000Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:19.598 [2024-11-18T01:11:54.000Z] =================================================================================================================== 00:29:19.598 [2024-11-18T01:11:54.000Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:19.598 02:11:53 -- common/autotest_common.sh@960 -- # wait 1326749 00:29:19.598 02:11:53 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:19.598 02:11:53 -- host/digest.sh@77 -- # local rw bs qd 00:29:19.598 02:11:53 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:19.598 02:11:53 -- host/digest.sh@80 -- # rw=randwrite 00:29:19.598 02:11:53 -- host/digest.sh@80 -- # bs=131072 00:29:19.598 02:11:53 -- host/digest.sh@80 -- # qd=16 00:29:19.598 02:11:53 -- host/digest.sh@82 -- # bperfpid=1327161 00:29:19.598 02:11:53 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:19.598 02:11:53 -- host/digest.sh@83 -- # waitforlisten 1327161 /var/tmp/bperf.sock 00:29:19.598 02:11:53 -- common/autotest_common.sh@829 -- # '[' -z 1327161 ']' 00:29:19.598 02:11:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:19.598 02:11:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:19.598 02:11:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:19.598 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:19.598 02:11:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:19.598 02:11:53 -- common/autotest_common.sh@10 -- # set +x 00:29:19.598 [2024-11-18 02:11:53.997788] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:19.598 [2024-11-18 02:11:53.997880] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1327161 ] 00:29:19.598 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:19.598 Zero copy mechanism will not be used. 00:29:19.857 EAL: No free 2048 kB hugepages reported on node 1 00:29:19.857 [2024-11-18 02:11:54.059837] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:19.857 [2024-11-18 02:11:54.147638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:19.857 02:11:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:19.857 02:11:54 -- common/autotest_common.sh@862 -- # return 0 00:29:19.857 02:11:54 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:19.857 02:11:54 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:19.857 02:11:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:20.426 02:11:54 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:20.426 02:11:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:20.685 nvme0n1 00:29:20.685 02:11:54 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:20.685 02:11:54 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:20.685 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:20.685 Zero copy mechanism will not be used. 00:29:20.685 Running I/O for 2 seconds... 00:29:23.222 00:29:23.222 Latency(us) 00:29:23.222 [2024-11-18T01:11:57.624Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:23.222 [2024-11-18T01:11:57.624Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:23.222 nvme0n1 : 2.00 6083.09 760.39 0.00 0.00 2619.61 1808.31 5339.97 00:29:23.222 [2024-11-18T01:11:57.624Z] =================================================================================================================== 00:29:23.222 [2024-11-18T01:11:57.624Z] Total : 6083.09 760.39 0.00 0.00 2619.61 1808.31 5339.97 00:29:23.222 0 00:29:23.222 02:11:57 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:23.222 02:11:57 -- host/digest.sh@92 -- # get_accel_stats 00:29:23.222 02:11:57 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:23.222 02:11:57 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:23.222 | select(.opcode=="crc32c") 00:29:23.222 | "\(.module_name) \(.executed)"' 00:29:23.222 02:11:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:23.222 02:11:57 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:23.222 02:11:57 -- host/digest.sh@93 -- # exp_module=software 00:29:23.222 02:11:57 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:23.222 02:11:57 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:23.222 02:11:57 -- host/digest.sh@97 -- # killprocess 1327161 00:29:23.222 02:11:57 -- common/autotest_common.sh@936 -- # '[' -z 1327161 ']' 00:29:23.222 02:11:57 -- common/autotest_common.sh@940 -- # kill -0 1327161 00:29:23.222 02:11:57 -- common/autotest_common.sh@941 -- # uname 00:29:23.222 02:11:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:23.222 02:11:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1327161 00:29:23.222 02:11:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:23.222 02:11:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:23.222 02:11:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1327161' 00:29:23.222 killing process with pid 1327161 00:29:23.222 02:11:57 -- common/autotest_common.sh@955 -- # kill 1327161 00:29:23.222 Received shutdown signal, test time was about 2.000000 seconds 00:29:23.222 00:29:23.222 Latency(us) 00:29:23.222 [2024-11-18T01:11:57.624Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:23.222 [2024-11-18T01:11:57.624Z] =================================================================================================================== 00:29:23.222 [2024-11-18T01:11:57.624Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:23.222 02:11:57 -- common/autotest_common.sh@960 -- # wait 1327161 00:29:23.482 02:11:57 -- host/digest.sh@126 -- # killprocess 1325751 00:29:23.482 02:11:57 -- common/autotest_common.sh@936 -- # '[' -z 1325751 ']' 00:29:23.482 02:11:57 -- common/autotest_common.sh@940 -- # kill -0 1325751 00:29:23.482 02:11:57 -- common/autotest_common.sh@941 -- # uname 00:29:23.482 02:11:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:23.482 02:11:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1325751 00:29:23.482 02:11:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:23.482 02:11:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:23.482 02:11:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1325751' 00:29:23.482 killing process with pid 1325751 00:29:23.482 02:11:57 -- common/autotest_common.sh@955 -- # kill 1325751 00:29:23.482 02:11:57 -- common/autotest_common.sh@960 -- # wait 1325751 00:29:23.739 00:29:23.739 real 0m15.327s 00:29:23.739 user 0m29.464s 00:29:23.739 sys 0m4.629s 00:29:23.739 02:11:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:23.739 02:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:23.739 ************************************ 00:29:23.739 END TEST nvmf_digest_clean 00:29:23.739 ************************************ 00:29:23.739 02:11:57 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:23.739 02:11:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:23.739 02:11:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:23.739 02:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:23.739 ************************************ 00:29:23.739 START TEST nvmf_digest_error 00:29:23.739 ************************************ 00:29:23.740 02:11:57 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:23.740 02:11:57 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:23.740 02:11:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:23.740 02:11:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:23.740 02:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:23.740 02:11:57 -- nvmf/common.sh@469 -- # nvmfpid=1327728 00:29:23.740 02:11:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:23.740 02:11:57 -- nvmf/common.sh@470 -- # waitforlisten 1327728 00:29:23.740 02:11:57 -- common/autotest_common.sh@829 -- # '[' -z 1327728 ']' 00:29:23.740 02:11:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:23.740 02:11:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:23.740 02:11:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:23.740 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:23.740 02:11:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:23.740 02:11:57 -- common/autotest_common.sh@10 -- # set +x 00:29:23.740 [2024-11-18 02:11:57.970976] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:23.740 [2024-11-18 02:11:57.971052] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:23.740 EAL: No free 2048 kB hugepages reported on node 1 00:29:23.740 [2024-11-18 02:11:58.034197] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:23.740 [2024-11-18 02:11:58.117967] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:23.740 [2024-11-18 02:11:58.118103] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:23.740 [2024-11-18 02:11:58.118119] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:23.740 [2024-11-18 02:11:58.118130] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:23.740 [2024-11-18 02:11:58.118164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:23.998 02:11:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:23.998 02:11:58 -- common/autotest_common.sh@862 -- # return 0 00:29:23.998 02:11:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:23.998 02:11:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:23.998 02:11:58 -- common/autotest_common.sh@10 -- # set +x 00:29:23.998 02:11:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:23.998 02:11:58 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:23.998 02:11:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.998 02:11:58 -- common/autotest_common.sh@10 -- # set +x 00:29:23.998 [2024-11-18 02:11:58.210830] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:23.998 02:11:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.998 02:11:58 -- host/digest.sh@104 -- # common_target_config 00:29:23.998 02:11:58 -- host/digest.sh@43 -- # rpc_cmd 00:29:23.998 02:11:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.998 02:11:58 -- common/autotest_common.sh@10 -- # set +x 00:29:23.998 null0 00:29:23.998 [2024-11-18 02:11:58.322711] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:23.998 [2024-11-18 02:11:58.346923] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:23.998 02:11:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.998 02:11:58 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:23.998 02:11:58 -- host/digest.sh@54 -- # local rw bs qd 00:29:23.998 02:11:58 -- host/digest.sh@56 -- # rw=randread 00:29:23.998 02:11:58 -- host/digest.sh@56 -- # bs=4096 00:29:23.998 02:11:58 -- host/digest.sh@56 -- # qd=128 00:29:23.998 02:11:58 -- host/digest.sh@58 -- # bperfpid=1327761 00:29:23.998 02:11:58 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:23.998 02:11:58 -- host/digest.sh@60 -- # waitforlisten 1327761 /var/tmp/bperf.sock 00:29:23.998 02:11:58 -- common/autotest_common.sh@829 -- # '[' -z 1327761 ']' 00:29:23.998 02:11:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:23.998 02:11:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:23.998 02:11:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:23.998 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:23.998 02:11:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:23.998 02:11:58 -- common/autotest_common.sh@10 -- # set +x 00:29:23.998 [2024-11-18 02:11:58.391379] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:23.998 [2024-11-18 02:11:58.391441] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1327761 ] 00:29:24.256 EAL: No free 2048 kB hugepages reported on node 1 00:29:24.256 [2024-11-18 02:11:58.452738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:24.256 [2024-11-18 02:11:58.541247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:25.195 02:11:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:25.195 02:11:59 -- common/autotest_common.sh@862 -- # return 0 00:29:25.195 02:11:59 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:25.195 02:11:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:25.195 02:11:59 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:25.195 02:11:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.195 02:11:59 -- common/autotest_common.sh@10 -- # set +x 00:29:25.453 02:11:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.453 02:11:59 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:25.453 02:11:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:25.711 nvme0n1 00:29:25.711 02:12:00 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:25.711 02:12:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.711 02:12:00 -- common/autotest_common.sh@10 -- # set +x 00:29:25.711 02:12:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.711 02:12:00 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:25.711 02:12:00 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:25.970 Running I/O for 2 seconds... 00:29:25.970 [2024-11-18 02:12:00.223805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:25.970 [2024-11-18 02:12:00.223855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11139 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.970 [2024-11-18 02:12:00.223894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.970 [2024-11-18 02:12:00.241278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:25.970 [2024-11-18 02:12:00.241336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:4993 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.970 [2024-11-18 02:12:00.241376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.970 [2024-11-18 02:12:00.255550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:25.970 [2024-11-18 02:12:00.255582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:20853 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.970 [2024-11-18 02:12:00.255600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.970 [2024-11-18 02:12:00.266939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:25.970 [2024-11-18 02:12:00.266974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:16698 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.970 [2024-11-18 02:12:00.266995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.970 [2024-11-18 02:12:00.280760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:25.970 [2024-11-18 02:12:00.280796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:18335 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.970 [2024-11-18 02:12:00.280816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.970 [2024-11-18 02:12:00.297100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:25.970 [2024-11-18 02:12:00.297144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:19499 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.970 [2024-11-18 02:12:00.297164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.970 [2024-11-18 02:12:00.309113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:25.970 [2024-11-18 02:12:00.309149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:11777 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.970 [2024-11-18 02:12:00.309168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.970 [2024-11-18 02:12:00.326479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:25.970 [2024-11-18 02:12:00.326508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:7105 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.970 [2024-11-18 02:12:00.326524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.970 [2024-11-18 02:12:00.344422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:25.970 [2024-11-18 02:12:00.344451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:2369 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.970 [2024-11-18 02:12:00.344468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.970 [2024-11-18 02:12:00.361202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:25.970 [2024-11-18 02:12:00.361243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:23816 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.970 [2024-11-18 02:12:00.361263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.378411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.378457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21088 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.378474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.394523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.394554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:6111 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.394571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.405481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.405509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18784 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.405525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.422383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.422413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:15135 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.422430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.439327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.439375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:17152 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.439392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.456556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.456585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:16336 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.456601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.473560] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.473601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:23905 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.473616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.490646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.490694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:11101 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.490724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.508425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.508456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:1983 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.508474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.525614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.525658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:9405 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.525685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.542554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.542583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:10521 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.542599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.553947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.553981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:16551 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.554001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.570109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.230 [2024-11-18 02:12:00.570144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2538 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.230 [2024-11-18 02:12:00.570163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.230 [2024-11-18 02:12:00.592735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.231 [2024-11-18 02:12:00.592769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:15551 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.231 [2024-11-18 02:12:00.592790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.231 [2024-11-18 02:12:00.604704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.231 [2024-11-18 02:12:00.604738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:2255 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.231 [2024-11-18 02:12:00.604758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.231 [2024-11-18 02:12:00.622489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.231 [2024-11-18 02:12:00.622519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:9676 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.231 [2024-11-18 02:12:00.622538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.638556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.638588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:19007 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.638627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.654185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.654216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:16608 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.654233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.669677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.669714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14135 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.669734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.688248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.688283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:2958 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.688302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.699624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.699659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:14060 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.699678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.715856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.715891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:22296 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.715910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.733204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.733239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20343 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.733257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.750159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.750196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:8863 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.750216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.767322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.767378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:10636 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.767395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.784383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.784415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19538 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.784433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.801629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.801673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20260 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.801693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.818957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.818993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20896 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.819012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.835901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.835936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:9519 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.835956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.852940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.852975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12904 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.852994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.870323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.870373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:19525 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.870390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.490 [2024-11-18 02:12:00.887523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.490 [2024-11-18 02:12:00.887552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:15140 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.490 [2024-11-18 02:12:00.887569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.749 [2024-11-18 02:12:00.904425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.749 [2024-11-18 02:12:00.904456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:7251 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.749 [2024-11-18 02:12:00.904473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.749 [2024-11-18 02:12:00.921584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.749 [2024-11-18 02:12:00.921614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:15905 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.749 [2024-11-18 02:12:00.921654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.749 [2024-11-18 02:12:00.938049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.749 [2024-11-18 02:12:00.938085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17229 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:00.938104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:00.949890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:00.949925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:18346 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:00.949946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:00.962985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:00.963019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:10979 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:00.963038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:00.980148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:00.980183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:7481 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:00.980202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:00.997264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:00.997299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:18725 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:00.997329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:01.014023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:01.014059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:9126 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:01.014079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:01.030876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:01.030912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:61 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:01.030931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:01.043762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:01.043796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:21593 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:01.043815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:01.055472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:01.055507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23839 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:01.055525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:01.071298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:01.071363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:3448 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:01.071379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:01.088413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:01.088444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:20785 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:01.088461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:01.106097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:01.106133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:9497 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:01.106152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:01.123193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:01.123229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:17154 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:01.123248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.750 [2024-11-18 02:12:01.140033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:26.750 [2024-11-18 02:12:01.140068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:24434 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.750 [2024-11-18 02:12:01.140087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.008 [2024-11-18 02:12:01.157529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.008 [2024-11-18 02:12:01.157564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:23033 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.008 [2024-11-18 02:12:01.157582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.008 [2024-11-18 02:12:01.174838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.008 [2024-11-18 02:12:01.174875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:8197 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.008 [2024-11-18 02:12:01.174895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.008 [2024-11-18 02:12:01.192236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.008 [2024-11-18 02:12:01.192272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:23812 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.008 [2024-11-18 02:12:01.192292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.008 [2024-11-18 02:12:01.209471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.008 [2024-11-18 02:12:01.209504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:8661 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.008 [2024-11-18 02:12:01.209523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.008 [2024-11-18 02:12:01.226638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.008 [2024-11-18 02:12:01.226680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:10309 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.008 [2024-11-18 02:12:01.226696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.008 [2024-11-18 02:12:01.243570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.008 [2024-11-18 02:12:01.243601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:8852 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.008 [2024-11-18 02:12:01.243632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.008 [2024-11-18 02:12:01.260565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.008 [2024-11-18 02:12:01.260621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:9674 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.008 [2024-11-18 02:12:01.260641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.009 [2024-11-18 02:12:01.277668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.009 [2024-11-18 02:12:01.277704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:14547 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.009 [2024-11-18 02:12:01.277723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.009 [2024-11-18 02:12:01.294860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.009 [2024-11-18 02:12:01.294896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:1331 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.009 [2024-11-18 02:12:01.294915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.009 [2024-11-18 02:12:01.311963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.009 [2024-11-18 02:12:01.311998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24882 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.009 [2024-11-18 02:12:01.312017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.009 [2024-11-18 02:12:01.329091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.009 [2024-11-18 02:12:01.329126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:1641 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.009 [2024-11-18 02:12:01.329146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.009 [2024-11-18 02:12:01.346201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.009 [2024-11-18 02:12:01.346236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:7821 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.009 [2024-11-18 02:12:01.346260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.009 [2024-11-18 02:12:01.363233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.009 [2024-11-18 02:12:01.363268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:16205 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.009 [2024-11-18 02:12:01.363288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.009 [2024-11-18 02:12:01.380198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.009 [2024-11-18 02:12:01.380234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:21813 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.009 [2024-11-18 02:12:01.380254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.009 [2024-11-18 02:12:01.397324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.009 [2024-11-18 02:12:01.397373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:1127 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.009 [2024-11-18 02:12:01.397389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.267 [2024-11-18 02:12:01.414185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.267 [2024-11-18 02:12:01.414224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:20758 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.267 [2024-11-18 02:12:01.414246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.267 [2024-11-18 02:12:01.431105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.267 [2024-11-18 02:12:01.431140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:11413 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.267 [2024-11-18 02:12:01.431159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.267 [2024-11-18 02:12:01.448074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.267 [2024-11-18 02:12:01.448110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:3818 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.267 [2024-11-18 02:12:01.448130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.267 [2024-11-18 02:12:01.465005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.267 [2024-11-18 02:12:01.465040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:21434 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.267 [2024-11-18 02:12:01.465059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.268 [2024-11-18 02:12:01.482175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.268 [2024-11-18 02:12:01.482211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:5229 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.268 [2024-11-18 02:12:01.482230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.268 [2024-11-18 02:12:01.499336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.268 [2024-11-18 02:12:01.499386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:9332 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.268 [2024-11-18 02:12:01.499403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.268 [2024-11-18 02:12:01.516477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.268 [2024-11-18 02:12:01.516506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:3977 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.268 [2024-11-18 02:12:01.516522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.268 [2024-11-18 02:12:01.533799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.268 [2024-11-18 02:12:01.533835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16583 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.268 [2024-11-18 02:12:01.533855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.268 [2024-11-18 02:12:01.548672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.268 [2024-11-18 02:12:01.548707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:9349 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.268 [2024-11-18 02:12:01.548726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.268 [2024-11-18 02:12:01.565946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.268 [2024-11-18 02:12:01.565981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:6604 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.268 [2024-11-18 02:12:01.566001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.268 [2024-11-18 02:12:01.582877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.268 [2024-11-18 02:12:01.582911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:25404 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.268 [2024-11-18 02:12:01.582930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.268 [2024-11-18 02:12:01.599899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.268 [2024-11-18 02:12:01.599934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:14947 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.268 [2024-11-18 02:12:01.599953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.268 [2024-11-18 02:12:01.616565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.268 [2024-11-18 02:12:01.616593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:23361 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.268 [2024-11-18 02:12:01.616609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.268 [2024-11-18 02:12:01.633852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.268 [2024-11-18 02:12:01.633887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13543 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.268 [2024-11-18 02:12:01.633913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.268 [2024-11-18 02:12:01.651092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.268 [2024-11-18 02:12:01.651127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:3867 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.268 [2024-11-18 02:12:01.651146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.268 [2024-11-18 02:12:01.668283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.268 [2024-11-18 02:12:01.668331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:3028 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.268 [2024-11-18 02:12:01.668379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.526 [2024-11-18 02:12:01.685420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.685450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:25200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.685466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.702433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.702462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:2435 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.702478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.719423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.719453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:5937 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.719472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.736717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.736753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:4816 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.736772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.753828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.753863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:1491 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.753893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.770975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.771009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:207 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.771038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.788090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.788131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:1144 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.788150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.805295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.805339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:10620 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.805373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.822396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.822424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:15646 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.822440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.839611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.839646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:17256 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.839672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.856647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.856681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:22232 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.856702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.873543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.873574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:18541 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.873605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.890513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.890541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:19954 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.890564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.907590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.907642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:14170 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.907658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.527 [2024-11-18 02:12:01.924562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.527 [2024-11-18 02:12:01.924606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:19242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.527 [2024-11-18 02:12:01.924625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:01.941838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:01.941874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:5289 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:01.941898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:01.958889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:01.958924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:24031 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:01.958942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:01.976229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:01.976264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23078 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:01.976283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:01.993341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:01.993385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:17722 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:01.993402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:02.010249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:02.010284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:17829 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:02.010303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:02.027373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:02.027401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:22631 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:02.027422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:02.045054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:02.045089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:12981 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:02.045110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:02.056346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:02.056392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:8640 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:02.056408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:02.079419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:02.079448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:15176 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:02.079474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:02.096329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:02.096375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:18684 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:02.096391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:02.113025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:02.113060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:5992 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:02.113079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:02.124460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:02.124491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:2148 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:02.124509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:02.140469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:02.140498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25574 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:02.140514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:02.157326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:02.157360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23808 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:02.157392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.786 [2024-11-18 02:12:02.174430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:27.786 [2024-11-18 02:12:02.174458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:4107 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.786 [2024-11-18 02:12:02.174474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:28.045 [2024-11-18 02:12:02.191783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f3b400) 00:29:28.045 [2024-11-18 02:12:02.191820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:451 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:28.045 [2024-11-18 02:12:02.191840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:28.045 00:29:28.045 Latency(us) 00:29:28.045 [2024-11-18T01:12:02.447Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:28.045 [2024-11-18T01:12:02.447Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:28.045 nvme0n1 : 2.04 15067.72 58.86 0.00 0.00 8321.53 3592.34 47574.28 00:29:28.045 [2024-11-18T01:12:02.447Z] =================================================================================================================== 00:29:28.045 [2024-11-18T01:12:02.447Z] Total : 15067.72 58.86 0.00 0.00 8321.53 3592.34 47574.28 00:29:28.045 0 00:29:28.045 02:12:02 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:28.045 02:12:02 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:28.045 02:12:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:28.045 02:12:02 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:28.045 | .driver_specific 00:29:28.045 | .nvme_error 00:29:28.045 | .status_code 00:29:28.045 | .command_transient_transport_error' 00:29:28.305 02:12:02 -- host/digest.sh@71 -- # (( 120 > 0 )) 00:29:28.305 02:12:02 -- host/digest.sh@73 -- # killprocess 1327761 00:29:28.305 02:12:02 -- common/autotest_common.sh@936 -- # '[' -z 1327761 ']' 00:29:28.305 02:12:02 -- common/autotest_common.sh@940 -- # kill -0 1327761 00:29:28.305 02:12:02 -- common/autotest_common.sh@941 -- # uname 00:29:28.305 02:12:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:28.305 02:12:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1327761 00:29:28.305 02:12:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:28.305 02:12:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:28.305 02:12:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1327761' 00:29:28.305 killing process with pid 1327761 00:29:28.305 02:12:02 -- common/autotest_common.sh@955 -- # kill 1327761 00:29:28.305 Received shutdown signal, test time was about 2.000000 seconds 00:29:28.305 00:29:28.305 Latency(us) 00:29:28.305 [2024-11-18T01:12:02.707Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:28.305 [2024-11-18T01:12:02.707Z] =================================================================================================================== 00:29:28.305 [2024-11-18T01:12:02.707Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:28.305 02:12:02 -- common/autotest_common.sh@960 -- # wait 1327761 00:29:28.563 02:12:02 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:28.563 02:12:02 -- host/digest.sh@54 -- # local rw bs qd 00:29:28.563 02:12:02 -- host/digest.sh@56 -- # rw=randread 00:29:28.563 02:12:02 -- host/digest.sh@56 -- # bs=131072 00:29:28.563 02:12:02 -- host/digest.sh@56 -- # qd=16 00:29:28.563 02:12:02 -- host/digest.sh@58 -- # bperfpid=1328421 00:29:28.563 02:12:02 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:28.563 02:12:02 -- host/digest.sh@60 -- # waitforlisten 1328421 /var/tmp/bperf.sock 00:29:28.563 02:12:02 -- common/autotest_common.sh@829 -- # '[' -z 1328421 ']' 00:29:28.564 02:12:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:28.564 02:12:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:28.564 02:12:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:28.564 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:28.564 02:12:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:28.564 02:12:02 -- common/autotest_common.sh@10 -- # set +x 00:29:28.564 [2024-11-18 02:12:02.829442] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:28.564 [2024-11-18 02:12:02.829520] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1328421 ] 00:29:28.564 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:28.564 Zero copy mechanism will not be used. 00:29:28.564 EAL: No free 2048 kB hugepages reported on node 1 00:29:28.564 [2024-11-18 02:12:02.891367] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:28.822 [2024-11-18 02:12:02.981004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:29.759 02:12:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:29.759 02:12:03 -- common/autotest_common.sh@862 -- # return 0 00:29:29.759 02:12:03 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:29.759 02:12:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:29.759 02:12:04 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:29.759 02:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.759 02:12:04 -- common/autotest_common.sh@10 -- # set +x 00:29:29.759 02:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.759 02:12:04 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:29.759 02:12:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:30.331 nvme0n1 00:29:30.331 02:12:04 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:30.331 02:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.331 02:12:04 -- common/autotest_common.sh@10 -- # set +x 00:29:30.331 02:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.331 02:12:04 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:30.331 02:12:04 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:30.331 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:30.331 Zero copy mechanism will not be used. 00:29:30.331 Running I/O for 2 seconds... 00:29:30.331 [2024-11-18 02:12:04.567645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.567710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.567733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.573707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.573746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.573768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.579496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.579531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.579550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.585089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.585127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.585148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.590717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.590754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.590788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.596545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.596579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.596630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.602056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.602093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.602113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.607542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.607575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.607608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.612924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.612962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.612983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.618343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.618394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.618412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.623715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.623752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.623773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.629152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.629189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.629209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.634667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.634704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.634725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.640012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.640049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.640071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.645411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.645450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.645468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.650765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.650802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.650823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.656216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.656253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.656275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.661635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.661673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.661693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.666835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.666872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.666893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.672201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.672238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.331 [2024-11-18 02:12:04.672258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.331 [2024-11-18 02:12:04.677579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.331 [2024-11-18 02:12:04.677611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.332 [2024-11-18 02:12:04.677629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.332 [2024-11-18 02:12:04.682901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.332 [2024-11-18 02:12:04.682938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.332 [2024-11-18 02:12:04.682959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.332 [2024-11-18 02:12:04.688158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.332 [2024-11-18 02:12:04.688195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.332 [2024-11-18 02:12:04.688216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.332 [2024-11-18 02:12:04.693367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.332 [2024-11-18 02:12:04.693415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.332 [2024-11-18 02:12:04.693433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.332 [2024-11-18 02:12:04.698571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.332 [2024-11-18 02:12:04.698603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.332 [2024-11-18 02:12:04.698639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.332 [2024-11-18 02:12:04.703880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.332 [2024-11-18 02:12:04.703918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.332 [2024-11-18 02:12:04.703939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.332 [2024-11-18 02:12:04.708858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.332 [2024-11-18 02:12:04.708897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.332 [2024-11-18 02:12:04.708918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.332 [2024-11-18 02:12:04.714766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.332 [2024-11-18 02:12:04.714813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.332 [2024-11-18 02:12:04.714847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.332 [2024-11-18 02:12:04.719458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.332 [2024-11-18 02:12:04.719491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.332 [2024-11-18 02:12:04.719508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.332 [2024-11-18 02:12:04.724610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.332 [2024-11-18 02:12:04.724660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.332 [2024-11-18 02:12:04.724681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.332 [2024-11-18 02:12:04.730115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.332 [2024-11-18 02:12:04.730152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.332 [2024-11-18 02:12:04.730172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.735517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.735565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.735590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.741002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.741039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.741060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.746483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.746515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.746533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.751901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.751938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.751959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.757416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.757448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.757466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.762555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.762586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.762604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.767686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.767724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.767744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.772967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.773004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.773024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.778439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.778471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.778488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.783651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.783688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.783709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.789037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.789074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.789095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.794491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.794523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.794541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.799822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.799860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.799880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.805437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.805469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.805487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.810551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.594 [2024-11-18 02:12:04.810583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.594 [2024-11-18 02:12:04.810600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.594 [2024-11-18 02:12:04.815870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.815908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.815929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.821117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.821154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.821175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.826601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.826633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.826684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.831806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.831844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.831865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.837123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.837161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.837182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.842466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.842498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.842515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.847658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.847696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.847717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.853808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.853856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.853888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.858511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.858544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.858562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.863690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.863727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.863747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.869033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.869071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.869092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.874532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.874572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.874605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.879980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.880017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.880038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.886350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.886407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.886432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.890972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.891009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.891030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.896422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.896454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.896472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.902520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.902561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.902588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.907206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.907243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.907263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.912660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.912697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.912718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.918011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.918047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.918068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.923195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.923232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.923253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.928432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.928463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.928481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.933618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.933651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.933668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.595 [2024-11-18 02:12:04.938880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.595 [2024-11-18 02:12:04.938918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.595 [2024-11-18 02:12:04.938939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.596 [2024-11-18 02:12:04.944269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.596 [2024-11-18 02:12:04.944306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.596 [2024-11-18 02:12:04.944336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.596 [2024-11-18 02:12:04.949568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.596 [2024-11-18 02:12:04.949600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.596 [2024-11-18 02:12:04.949634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.596 [2024-11-18 02:12:04.954908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.596 [2024-11-18 02:12:04.954944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.596 [2024-11-18 02:12:04.954965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.596 [2024-11-18 02:12:04.960252] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.596 [2024-11-18 02:12:04.960289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.596 [2024-11-18 02:12:04.960322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.596 [2024-11-18 02:12:04.965598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.596 [2024-11-18 02:12:04.965649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.596 [2024-11-18 02:12:04.965676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.596 [2024-11-18 02:12:04.971033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.596 [2024-11-18 02:12:04.971070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.596 [2024-11-18 02:12:04.971091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.596 [2024-11-18 02:12:04.976490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.596 [2024-11-18 02:12:04.976521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.596 [2024-11-18 02:12:04.976539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.596 [2024-11-18 02:12:04.981873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.596 [2024-11-18 02:12:04.981911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.596 [2024-11-18 02:12:04.981931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.596 [2024-11-18 02:12:04.987190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.596 [2024-11-18 02:12:04.987228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.596 [2024-11-18 02:12:04.987250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.596 [2024-11-18 02:12:04.992373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.596 [2024-11-18 02:12:04.992407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.596 [2024-11-18 02:12:04.992440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.856 [2024-11-18 02:12:04.997775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.856 [2024-11-18 02:12:04.997813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.856 [2024-11-18 02:12:04.997835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.856 [2024-11-18 02:12:05.003401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.856 [2024-11-18 02:12:05.003433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.856 [2024-11-18 02:12:05.003451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.856 [2024-11-18 02:12:05.008673] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.856 [2024-11-18 02:12:05.008711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.856 [2024-11-18 02:12:05.008732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.856 [2024-11-18 02:12:05.014287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.856 [2024-11-18 02:12:05.014333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.856 [2024-11-18 02:12:05.014367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.856 [2024-11-18 02:12:05.019417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.856 [2024-11-18 02:12:05.019449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.856 [2024-11-18 02:12:05.019467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.856 [2024-11-18 02:12:05.024559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.856 [2024-11-18 02:12:05.024591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.024609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.029919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.029956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.029977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.035388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.035420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.035438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.040744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.040781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.040803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.046180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.046217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.046237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.051608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.051654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.051671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.057011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.057048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.057075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.062499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.062531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.062549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.067745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.067783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.067804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.072981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.073018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.073039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.078506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.078539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.078558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.083985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.084021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.084042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.089553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.089593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.089631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.094181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.094219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.094240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.099289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.099336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.099359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.103537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.103574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.103593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.108501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.108534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.108551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.113707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.113753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.113774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.119188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.119225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.119245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.124527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.124559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.124577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.129802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.129839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.129860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.134905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.134954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.134972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.140265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.140303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.140335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.145576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.145608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.145640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.150971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.151008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.151029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.156504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.156536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.156554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.162062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.857 [2024-11-18 02:12:05.162100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.857 [2024-11-18 02:12:05.162121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.857 [2024-11-18 02:12:05.167731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.167769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.167790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.173022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.173060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.173080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.178415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.178446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.178464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.183804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.183841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.183861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.188982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.189020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.189040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.193465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.193497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.193524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.199091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.199129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.199151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.204516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.204549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.204567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.209791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.209829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.209850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.214973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.215009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.215030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.220280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.220328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.220352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.226419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.226476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.226505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.231008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.231040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.231058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.236435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.236469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.236488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.241876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.241913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.241933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.247399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.247446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.247465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.858 [2024-11-18 02:12:05.253003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:30.858 [2024-11-18 02:12:05.253039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.858 [2024-11-18 02:12:05.253061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.258541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.258575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.258594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.264026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.264064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.264085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.269529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.269561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.269578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.274851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.274888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.274909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.280360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.280407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.280424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.285461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.285493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.285517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.290666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.290712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.290734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.296103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.296153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.296175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.301507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.301538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.301556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.306734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.306770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.306791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.312111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.312148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.312169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.317379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.317417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.317437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.322697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.322734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.322754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.328014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.328051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.328072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.333475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.333514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.333533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.338761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.338798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.118 [2024-11-18 02:12:05.338817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.118 [2024-11-18 02:12:05.344802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.118 [2024-11-18 02:12:05.344840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.344866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.351729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.351766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.351786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.359308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.359382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.359401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.365759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.365797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.365818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.373361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.373410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.373429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.380791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.380828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.380852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.388277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.388324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.388363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.395690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.395727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.395748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.404107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.404149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.404174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.412962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.413002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.413034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.418018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.418057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.418077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.424302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.424350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.424385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.431704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.431742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.431765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.439379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.439410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.439430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.446940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.446977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.447000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.454516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.454561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.454587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.461943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.461981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.462002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.469410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.469443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.469462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.476814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.476850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.476884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.482695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.482734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.482753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.488925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.488963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.488984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.495454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.495486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.495519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.501994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.502032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.502053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.508442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.508474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.508494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.119 [2024-11-18 02:12:05.514895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.119 [2024-11-18 02:12:05.514933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.119 [2024-11-18 02:12:05.514953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.379 [2024-11-18 02:12:05.520059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.379 [2024-11-18 02:12:05.520098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.379 [2024-11-18 02:12:05.520121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.379 [2024-11-18 02:12:05.525814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.379 [2024-11-18 02:12:05.525860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.525882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.532177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.532215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.532235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.537635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.537672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.537693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.543751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.543789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.543810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.549226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.549263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.549284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.554210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.554247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.554268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.559616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.559665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.559702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.565009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.565047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.565070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.570532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.570565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.570582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.575964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.576002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.576023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.581578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.581635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.581653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.586937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.586974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.586995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.592419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.592453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.592471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.597816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.597853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.597874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.603413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.603448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.603467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.608703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.608748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.608769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.614138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.614175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.614196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.619544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.619578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.619619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.625084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.625122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.625147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.630481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.630515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.630533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.636133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.636167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.636191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.643100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.643137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.643158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.650687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.650726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.650750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.658288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.658344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.658382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.665427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.665469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.665500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.671876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.671924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.671958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.678303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.380 [2024-11-18 02:12:05.678371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.380 [2024-11-18 02:12:05.678401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.380 [2024-11-18 02:12:05.684411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.684445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.684463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.690561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.690611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.690630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.697879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.697927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.697948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.705489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.705524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.705542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.713368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.713402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.713420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.720810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.720847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.720878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.728342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.728391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.728409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.735916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.735953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.735973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.743512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.743544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.743563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.750893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.750930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.750954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.757054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.757092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.757112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.762519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.762550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.762571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.768288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.768329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.768350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.774092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.774129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.774149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.381 [2024-11-18 02:12:05.779890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.381 [2024-11-18 02:12:05.779934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.381 [2024-11-18 02:12:05.779959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.785695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.785746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.785767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.790617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.790678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.790705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.795456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.795493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.795512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.800455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.800497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.800531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.805286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.805343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.805390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.810255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.810321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.810348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.815119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.815166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.815195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.820212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.820257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.820281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.825075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.825123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.825158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.830199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.830235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.830260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.835755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.835792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.835816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.841626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.841664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.841685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.847380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.847412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.847435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.853172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.853209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.853237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.858906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.858937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.858956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.864574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.641 [2024-11-18 02:12:05.864605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.641 [2024-11-18 02:12:05.864639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.641 [2024-11-18 02:12:05.870236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.870273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.870300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.876027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.876065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.876084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.881830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.881868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.881888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.887562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.887596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.887629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.893174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.893212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.893233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.898473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.898515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.898544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.903465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.903504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.903534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.908381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.908423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.908455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.913072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.913119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.913145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.918037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.918074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.918095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.923589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.923629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.923648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.929183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.929220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.929240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.934442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.934475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.934495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.938140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.938178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.938199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.943647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.943691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.943713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.949367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.949399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.949418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.954636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.954673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.954698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.960114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.960151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.960185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.965590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.965638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.965658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.970921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.970957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.970977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.976334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.976385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.976403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.981700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.981737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.981758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.642 [2024-11-18 02:12:05.986994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.642 [2024-11-18 02:12:05.987031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.642 [2024-11-18 02:12:05.987052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.643 [2024-11-18 02:12:05.992176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.643 [2024-11-18 02:12:05.992213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.643 [2024-11-18 02:12:05.992233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.643 [2024-11-18 02:12:05.997649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.643 [2024-11-18 02:12:05.997686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.643 [2024-11-18 02:12:05.997707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.643 [2024-11-18 02:12:06.003177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.643 [2024-11-18 02:12:06.003213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.643 [2024-11-18 02:12:06.003243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.643 [2024-11-18 02:12:06.008568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.643 [2024-11-18 02:12:06.008604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.643 [2024-11-18 02:12:06.008640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.643 [2024-11-18 02:12:06.013761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.643 [2024-11-18 02:12:06.013798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.643 [2024-11-18 02:12:06.013819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.643 [2024-11-18 02:12:06.019072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.643 [2024-11-18 02:12:06.019110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.643 [2024-11-18 02:12:06.019131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.643 [2024-11-18 02:12:06.024512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.643 [2024-11-18 02:12:06.024542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.643 [2024-11-18 02:12:06.024562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.643 [2024-11-18 02:12:06.029966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.643 [2024-11-18 02:12:06.030003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.643 [2024-11-18 02:12:06.030024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.643 [2024-11-18 02:12:06.035354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.643 [2024-11-18 02:12:06.035401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.643 [2024-11-18 02:12:06.035418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.643 [2024-11-18 02:12:06.040613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.643 [2024-11-18 02:12:06.040644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.643 [2024-11-18 02:12:06.040662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.905 [2024-11-18 02:12:06.046091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.905 [2024-11-18 02:12:06.046129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.905 [2024-11-18 02:12:06.046160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.905 [2024-11-18 02:12:06.051497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.905 [2024-11-18 02:12:06.051529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.905 [2024-11-18 02:12:06.051554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.905 [2024-11-18 02:12:06.056869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.905 [2024-11-18 02:12:06.056906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.905 [2024-11-18 02:12:06.056926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.905 [2024-11-18 02:12:06.062305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.905 [2024-11-18 02:12:06.062352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.905 [2024-11-18 02:12:06.062387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.905 [2024-11-18 02:12:06.067667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.905 [2024-11-18 02:12:06.067705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.905 [2024-11-18 02:12:06.067725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.905 [2024-11-18 02:12:06.072997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.905 [2024-11-18 02:12:06.073033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.905 [2024-11-18 02:12:06.073053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.905 [2024-11-18 02:12:06.078401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.905 [2024-11-18 02:12:06.078433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.905 [2024-11-18 02:12:06.078464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.905 [2024-11-18 02:12:06.083892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.905 [2024-11-18 02:12:06.083929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.905 [2024-11-18 02:12:06.083949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.905 [2024-11-18 02:12:06.088946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.905 [2024-11-18 02:12:06.088983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.905 [2024-11-18 02:12:06.089003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.905 [2024-11-18 02:12:06.094489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.905 [2024-11-18 02:12:06.094522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.905 [2024-11-18 02:12:06.094542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.905 [2024-11-18 02:12:06.099765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.905 [2024-11-18 02:12:06.099802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.099833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.104974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.105011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.105032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.110499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.110530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.110547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.116130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.116178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.116212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.120803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.120841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.120861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.125632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.125669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.125690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.131050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.131087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.131108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.136577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.136608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.136644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.141950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.141987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.142016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.147331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.147386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.147406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.152702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.152740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.152760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.158018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.158054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.158075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.163551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.163583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.163603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.169278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.169323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.169360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.175136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.175173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.175193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.180568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.180600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.180635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.186048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.186085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.186110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.191459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.191491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.191509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.196879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.196916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.196944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.202381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.202418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.202438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.207513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.207545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.207563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.213028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.213074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.213095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.218540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.218571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.218588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.224269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.224307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.224337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.229976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.230015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.230035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.235666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.235704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.235725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.241139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.906 [2024-11-18 02:12:06.241177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.906 [2024-11-18 02:12:06.241205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.906 [2024-11-18 02:12:06.246568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.907 [2024-11-18 02:12:06.246629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.907 [2024-11-18 02:12:06.246647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.907 [2024-11-18 02:12:06.252188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.907 [2024-11-18 02:12:06.252220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.907 [2024-11-18 02:12:06.252237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.907 [2024-11-18 02:12:06.257625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.907 [2024-11-18 02:12:06.257658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.907 [2024-11-18 02:12:06.257699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.907 [2024-11-18 02:12:06.263140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.907 [2024-11-18 02:12:06.263178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.907 [2024-11-18 02:12:06.263199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.907 [2024-11-18 02:12:06.268579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.907 [2024-11-18 02:12:06.268629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.907 [2024-11-18 02:12:06.268646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.907 [2024-11-18 02:12:06.274192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.907 [2024-11-18 02:12:06.274230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.907 [2024-11-18 02:12:06.274250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.907 [2024-11-18 02:12:06.279674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.907 [2024-11-18 02:12:06.279712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.907 [2024-11-18 02:12:06.279732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:31.907 [2024-11-18 02:12:06.285340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.907 [2024-11-18 02:12:06.285399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.907 [2024-11-18 02:12:06.285416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.907 [2024-11-18 02:12:06.290907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.907 [2024-11-18 02:12:06.290945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.907 [2024-11-18 02:12:06.290966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.907 [2024-11-18 02:12:06.296334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.907 [2024-11-18 02:12:06.296386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.907 [2024-11-18 02:12:06.296405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:31.907 [2024-11-18 02:12:06.301584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:31.907 [2024-11-18 02:12:06.301617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.907 [2024-11-18 02:12:06.301653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.168 [2024-11-18 02:12:06.306763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.168 [2024-11-18 02:12:06.306803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.168 [2024-11-18 02:12:06.306824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.168 [2024-11-18 02:12:06.312207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.168 [2024-11-18 02:12:06.312245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.168 [2024-11-18 02:12:06.312265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.168 [2024-11-18 02:12:06.317226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.168 [2024-11-18 02:12:06.317264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.168 [2024-11-18 02:12:06.317284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:32.168 [2024-11-18 02:12:06.322452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.168 [2024-11-18 02:12:06.322485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.168 [2024-11-18 02:12:06.322502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.168 [2024-11-18 02:12:06.327699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.168 [2024-11-18 02:12:06.327737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.168 [2024-11-18 02:12:06.327758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.168 [2024-11-18 02:12:06.333127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.168 [2024-11-18 02:12:06.333164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.168 [2024-11-18 02:12:06.333190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.168 [2024-11-18 02:12:06.338602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.168 [2024-11-18 02:12:06.338651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.168 [2024-11-18 02:12:06.338673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.344096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.344133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.344154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.349543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.349576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.349612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.355018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.355056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.355077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.360263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.360301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.360335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.365665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.365703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.365723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.370985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.371022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.371043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.376024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.376061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.376083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.381473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.381527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.381546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.386917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.386955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.386976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.392454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.392485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.392517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.397870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.397908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.397929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.403428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.403473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.403490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.409176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.409213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.409233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.414613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.414663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.414685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.419913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.419950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.419970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.425334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.425383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.425401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.430706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.430744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.430764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.436098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.436135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.436156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.441505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.441537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.441555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.446887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.446925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.446945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.452428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.452460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.452478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.457638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.457669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.457702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.462801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.462841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.462862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.467640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.467690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.467710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.473210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.473248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.473275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.169 [2024-11-18 02:12:06.478589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.169 [2024-11-18 02:12:06.478621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.169 [2024-11-18 02:12:06.478638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.484122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.484154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.484171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.489524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.489567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.489599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.494958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.494995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.495016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.500409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.500456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.500474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.505844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.505882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.505902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.511366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.511398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.511416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.516697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.516734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.516756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.522135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.522178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.522199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.527601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.527652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.527674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.533205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.533253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.533288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.537791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.537839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.537862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.542535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.542568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.542601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.547929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.547966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.547987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.553328] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.553378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.553397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.558747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.558784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.558804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.170 [2024-11-18 02:12:06.564049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cd02f0) 00:29:32.170 [2024-11-18 02:12:06.564086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.170 [2024-11-18 02:12:06.564107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.170 00:29:32.170 Latency(us) 00:29:32.170 [2024-11-18T01:12:06.572Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:32.170 [2024-11-18T01:12:06.572Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:32.170 nvme0n1 : 2.00 5569.21 696.15 0.00 0.00 2868.69 849.54 9272.13 00:29:32.170 [2024-11-18T01:12:06.572Z] =================================================================================================================== 00:29:32.170 [2024-11-18T01:12:06.572Z] Total : 5569.21 696.15 0.00 0.00 2868.69 849.54 9272.13 00:29:32.429 0 00:29:32.429 02:12:06 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:32.429 02:12:06 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:32.429 02:12:06 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:32.429 | .driver_specific 00:29:32.429 | .nvme_error 00:29:32.429 | .status_code 00:29:32.429 | .command_transient_transport_error' 00:29:32.429 02:12:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:32.689 02:12:06 -- host/digest.sh@71 -- # (( 359 > 0 )) 00:29:32.689 02:12:06 -- host/digest.sh@73 -- # killprocess 1328421 00:29:32.689 02:12:06 -- common/autotest_common.sh@936 -- # '[' -z 1328421 ']' 00:29:32.689 02:12:06 -- common/autotest_common.sh@940 -- # kill -0 1328421 00:29:32.689 02:12:06 -- common/autotest_common.sh@941 -- # uname 00:29:32.689 02:12:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:32.689 02:12:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1328421 00:29:32.689 02:12:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:32.689 02:12:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:32.689 02:12:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1328421' 00:29:32.689 killing process with pid 1328421 00:29:32.689 02:12:06 -- common/autotest_common.sh@955 -- # kill 1328421 00:29:32.689 Received shutdown signal, test time was about 2.000000 seconds 00:29:32.689 00:29:32.689 Latency(us) 00:29:32.689 [2024-11-18T01:12:07.091Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:32.689 [2024-11-18T01:12:07.091Z] =================================================================================================================== 00:29:32.689 [2024-11-18T01:12:07.091Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:32.689 02:12:06 -- common/autotest_common.sh@960 -- # wait 1328421 00:29:32.949 02:12:07 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:32.949 02:12:07 -- host/digest.sh@54 -- # local rw bs qd 00:29:32.949 02:12:07 -- host/digest.sh@56 -- # rw=randwrite 00:29:32.949 02:12:07 -- host/digest.sh@56 -- # bs=4096 00:29:32.949 02:12:07 -- host/digest.sh@56 -- # qd=128 00:29:32.949 02:12:07 -- host/digest.sh@58 -- # bperfpid=1328970 00:29:32.949 02:12:07 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:32.949 02:12:07 -- host/digest.sh@60 -- # waitforlisten 1328970 /var/tmp/bperf.sock 00:29:32.949 02:12:07 -- common/autotest_common.sh@829 -- # '[' -z 1328970 ']' 00:29:32.949 02:12:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:32.949 02:12:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:32.949 02:12:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:32.949 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:32.949 02:12:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:32.949 02:12:07 -- common/autotest_common.sh@10 -- # set +x 00:29:32.949 [2024-11-18 02:12:07.163771] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:32.949 [2024-11-18 02:12:07.163863] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1328970 ] 00:29:32.949 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.949 [2024-11-18 02:12:07.228465] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:32.949 [2024-11-18 02:12:07.317065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:33.885 02:12:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:33.885 02:12:08 -- common/autotest_common.sh@862 -- # return 0 00:29:33.885 02:12:08 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:33.885 02:12:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:34.143 02:12:08 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:34.143 02:12:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.143 02:12:08 -- common/autotest_common.sh@10 -- # set +x 00:29:34.143 02:12:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.143 02:12:08 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:34.143 02:12:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:34.712 nvme0n1 00:29:34.712 02:12:08 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:34.712 02:12:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.712 02:12:08 -- common/autotest_common.sh@10 -- # set +x 00:29:34.712 02:12:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.712 02:12:08 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:34.712 02:12:08 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:34.712 Running I/O for 2 seconds... 00:29:34.712 [2024-11-18 02:12:09.073687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190eea00 00:29:34.712 [2024-11-18 02:12:09.074021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:12827 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.712 [2024-11-18 02:12:09.074062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:29:34.712 [2024-11-18 02:12:09.086459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190eb328 00:29:34.712 [2024-11-18 02:12:09.086779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:3072 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.712 [2024-11-18 02:12:09.086809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.712 [2024-11-18 02:12:09.099366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190e9e10 00:29:34.712 [2024-11-18 02:12:09.099612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:18192 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.712 [2024-11-18 02:12:09.099659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:29:34.712 [2024-11-18 02:12:09.112505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190e5a90 00:29:34.712 [2024-11-18 02:12:09.112972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:20904 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.712 [2024-11-18 02:12:09.113029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:29:34.969 [2024-11-18 02:12:09.125371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190ed0b0 00:29:34.969 [2024-11-18 02:12:09.125772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:20175 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.969 [2024-11-18 02:12:09.125817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:34.969 [2024-11-18 02:12:09.138106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190e88f8 00:29:34.969 [2024-11-18 02:12:09.138523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:810 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.969 [2024-11-18 02:12:09.138554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:34.969 [2024-11-18 02:12:09.150822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190e3060 00:29:34.969 [2024-11-18 02:12:09.151151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:21279 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.969 [2024-11-18 02:12:09.151185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:34.969 [2024-11-18 02:12:09.163951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190ed0b0 00:29:34.969 [2024-11-18 02:12:09.164762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:12942 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.969 [2024-11-18 02:12:09.164797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.969 [2024-11-18 02:12:09.178126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190eb328 00:29:34.969 [2024-11-18 02:12:09.180194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:5481 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.969 [2024-11-18 02:12:09.180245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:29:34.969 [2024-11-18 02:12:09.191242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190e23b8 00:29:34.969 [2024-11-18 02:12:09.192732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:929 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.969 [2024-11-18 02:12:09.192776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:34.969 [2024-11-18 02:12:09.202165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190e0ea0 00:29:34.969 [2024-11-18 02:12:09.203351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:19893 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.203381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:29:34.970 [2024-11-18 02:12:09.213759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190e01f8 00:29:34.970 [2024-11-18 02:12:09.215203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:11872 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.215249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:34.970 [2024-11-18 02:12:09.226024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190e12d8 00:29:34.970 [2024-11-18 02:12:09.226666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:2200 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.226696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0032 p:0 m:0 dnr:0 00:29:34.970 [2024-11-18 02:12:09.239266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:34.970 [2024-11-18 02:12:09.239596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:21616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.239637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.970 [2024-11-18 02:12:09.252485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:34.970 [2024-11-18 02:12:09.252796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:21532 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.252830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.970 [2024-11-18 02:12:09.265816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:34.970 [2024-11-18 02:12:09.266221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:10627 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.266265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.970 [2024-11-18 02:12:09.279130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:34.970 [2024-11-18 02:12:09.279533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:955 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.279568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.970 [2024-11-18 02:12:09.292584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:34.970 [2024-11-18 02:12:09.292984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:6866 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.293015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.970 [2024-11-18 02:12:09.306010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:34.970 [2024-11-18 02:12:09.306396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:13128 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.306436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.970 [2024-11-18 02:12:09.319465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:34.970 [2024-11-18 02:12:09.319860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:9609 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.319889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.970 [2024-11-18 02:12:09.332676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:34.970 [2024-11-18 02:12:09.332998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:10466 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.333053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.970 [2024-11-18 02:12:09.345785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:34.970 [2024-11-18 02:12:09.346108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:1077 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.346138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.970 [2024-11-18 02:12:09.359011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:34.970 [2024-11-18 02:12:09.359384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:3553 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:34.970 [2024-11-18 02:12:09.359423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.372532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.372896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:12087 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.372927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.385797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.386159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:6861 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.386190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.399018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.399349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:14386 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.399380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.412264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.412623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:19009 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.412664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.425443] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.425756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:24703 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.425796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.438626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.438945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:3818 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.438993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.451839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.452161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:19094 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.452192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.465015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.465367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:1133 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.465401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.478261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.478604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:21125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.478651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.491369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.491651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:25435 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.491682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.504633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.504976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:24923 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.505020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.517829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.518247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:14365 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.518285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.531264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.531557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:25501 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.531587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.544579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.545001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:14573 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.545045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.557986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.558301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:18095 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.558338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.571289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.571615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:12986 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.571645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.584561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.584904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:21834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.584957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.597441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.597729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:20768 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.597767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.610495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.610871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:10987 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.610901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.230 [2024-11-18 02:12:09.623915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.230 [2024-11-18 02:12:09.624237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:9561 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.230 [2024-11-18 02:12:09.624276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.637225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.637537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:11839 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.637568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.650693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.651103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:7206 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.651156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.664029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.664454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:24219 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.664485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.677431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.677775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:10947 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.677819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.690611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.690970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:10338 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.691009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.703770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.704092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:14043 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.704121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.716993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.717350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:4220 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.717395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.730076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.730397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:367 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.730427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.743423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.743746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:7875 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.743784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.756523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.756853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:4304 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.756893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.769819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.770129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:1911 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.770159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.782942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.783289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:5510 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.783335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.795995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.796347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:25512 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.796391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.809228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.809527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:3653 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.809557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.822365] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.822702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:170 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.822732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.835551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.835858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:25309 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.835888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.848507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.848902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:18051 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.848948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.491 [2024-11-18 02:12:09.861965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.491 [2024-11-18 02:12:09.862304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:1577 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.491 [2024-11-18 02:12:09.862341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.492 [2024-11-18 02:12:09.875226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.492 [2024-11-18 02:12:09.875524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:12639 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.492 [2024-11-18 02:12:09.875555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.492 [2024-11-18 02:12:09.888498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.492 [2024-11-18 02:12:09.888905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:16126 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.492 [2024-11-18 02:12:09.888935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:09.902006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:09.902414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:11770 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:09.902455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:09.915349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:09.915654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:16412 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:09.915684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:09.928715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:09.929036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:12562 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:09.929070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:09.942064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:09.942361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:11039 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:09.942392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:09.955259] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:09.955618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:9693 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:09.955660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:09.968506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:09.968820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:23149 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:09.968850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:09.981880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:09.982205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:22383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:09.982235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:09.995223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:09.995567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:1575 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:09.995597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:10.008494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:10.008928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:13617 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:10.008964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:10.022127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:10.022442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:21531 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:10.022477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:10.035296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:10.035607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23120 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:10.035640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:10.048339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:10.048608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:2735 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:10.048649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:10.061540] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:10.061886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:2091 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:10.061927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:10.075113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:10.075448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:4823 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:10.075479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:10.088835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:10.089184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:15298 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:10.089222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:10.102145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:10.102476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:9469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:10.102507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:10.115632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.751 [2024-11-18 02:12:10.116036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:3628 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.751 [2024-11-18 02:12:10.116081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.751 [2024-11-18 02:12:10.129276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.752 [2024-11-18 02:12:10.129647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:10494 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.752 [2024-11-18 02:12:10.129681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.752 [2024-11-18 02:12:10.142848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:35.752 [2024-11-18 02:12:10.143186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:5120 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:35.752 [2024-11-18 02:12:10.143217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.156331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.156632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:19722 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.156662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.169816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.170156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:7113 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.170191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.183361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.183706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:10146 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.183736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.196994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.197353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:13173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.197394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.210594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.210916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:16509 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.210947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.223812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.224096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:21701 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.224127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.237085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.237455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:11393 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.237485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.250527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.250870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:18621 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.250909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.264142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.264491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:5293 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.264535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.278366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.278706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:14868 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.278752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.292573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.292930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:3084 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.292967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.306951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.307284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:2723 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.307337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.321181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.321526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:162 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.321571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.335247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.335571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:18393 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.335602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.349438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.349775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:15201 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.349829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.363415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.363721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:22052 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.363757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.377560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.377899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:3859 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.377943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.391837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.392177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:15207 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.392220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.012 [2024-11-18 02:12:10.405975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.012 [2024-11-18 02:12:10.406308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:16976 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.012 [2024-11-18 02:12:10.406372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.420102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.420468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:21610 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.420498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.434269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.434646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:6248 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.434680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.448414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.448838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:6467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.448871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.462661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.463027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:5464 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.463061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.476859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.477181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:18641 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.477225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.490983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.491359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:184 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.491388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.505145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.505481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:24351 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.505512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.519272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.519707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:14250 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.519740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.533501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.533858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:14052 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.533891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.547793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.548161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:20939 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.548194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.561921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.562270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:6625 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.562304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.575990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.576339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:7460 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.576383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.590094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.590429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:7263 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.590459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.604342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.604683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:4376 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.604720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.618417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.618738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:5017 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.618771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.632665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.633032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:2134 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.273 [2024-11-18 02:12:10.633064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.273 [2024-11-18 02:12:10.646855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.273 [2024-11-18 02:12:10.647188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:9005 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.274 [2024-11-18 02:12:10.647237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.274 [2024-11-18 02:12:10.660957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.274 [2024-11-18 02:12:10.661288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:8648 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.274 [2024-11-18 02:12:10.661357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.274 [2024-11-18 02:12:10.675041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.534 [2024-11-18 02:12:10.675404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:20877 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.534 [2024-11-18 02:12:10.675435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.534 [2024-11-18 02:12:10.689035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.534 [2024-11-18 02:12:10.689417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:19584 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.534 [2024-11-18 02:12:10.689461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.534 [2024-11-18 02:12:10.703167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.534 [2024-11-18 02:12:10.703503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:13163 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.534 [2024-11-18 02:12:10.703544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.534 [2024-11-18 02:12:10.717200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.534 [2024-11-18 02:12:10.717618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:22191 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.534 [2024-11-18 02:12:10.717650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.534 [2024-11-18 02:12:10.731177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.731504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:7727 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.731546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.745191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.745586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:6033 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.745643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.759190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.759578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:17762 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.759640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.773251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.773700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:6233 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.773741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.787368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.787735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:18212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.787767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.801281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.801711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:7208 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.801744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.815332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.815719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:19345 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.815751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.829366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.829750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:6906 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.829783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.843422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.843796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:15166 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.843839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.857492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.857828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:20373 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.857861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.871483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.871872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:9375 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.871905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.885614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.885952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:23676 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.885985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.899682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.900027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:22656 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.900070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.913591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.913926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:11225 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.913968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.535 [2024-11-18 02:12:10.927649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.535 [2024-11-18 02:12:10.927992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:7532 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.535 [2024-11-18 02:12:10.928035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.795 [2024-11-18 02:12:10.941658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.795 [2024-11-18 02:12:10.942018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:5748 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.795 [2024-11-18 02:12:10.942064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.795 [2024-11-18 02:12:10.955662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.795 [2024-11-18 02:12:10.956006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:16928 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.795 [2024-11-18 02:12:10.956050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.795 [2024-11-18 02:12:10.969624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.795 [2024-11-18 02:12:10.969993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:13729 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.795 [2024-11-18 02:12:10.970026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.795 [2024-11-18 02:12:10.983574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.795 [2024-11-18 02:12:10.983954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:21248 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.795 [2024-11-18 02:12:10.983987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.795 [2024-11-18 02:12:10.997669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.795 [2024-11-18 02:12:10.998008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:11308 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.795 [2024-11-18 02:12:10.998041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.795 [2024-11-18 02:12:11.011681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.795 [2024-11-18 02:12:11.012041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:6784 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.795 [2024-11-18 02:12:11.012074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.795 [2024-11-18 02:12:11.025640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.795 [2024-11-18 02:12:11.025982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:1613 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.795 [2024-11-18 02:12:11.026027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.795 [2024-11-18 02:12:11.039868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.795 [2024-11-18 02:12:11.040187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:1177 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.795 [2024-11-18 02:12:11.040220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.795 [2024-11-18 02:12:11.053899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.795 [2024-11-18 02:12:11.054233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:16538 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.795 [2024-11-18 02:12:11.054276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.795 [2024-11-18 02:12:11.067947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92920) with pdu=0x2000190efae0 00:29:36.795 [2024-11-18 02:12:11.068240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:2357 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.795 [2024-11-18 02:12:11.068273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.795 00:29:36.795 Latency(us) 00:29:36.795 [2024-11-18T01:12:11.197Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:36.795 [2024-11-18T01:12:11.197Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:36.795 nvme0n1 : 2.01 18831.19 73.56 0.00 0.00 6780.92 2827.76 14951.92 00:29:36.795 [2024-11-18T01:12:11.197Z] =================================================================================================================== 00:29:36.795 [2024-11-18T01:12:11.197Z] Total : 18831.19 73.56 0.00 0.00 6780.92 2827.76 14951.92 00:29:36.795 0 00:29:36.796 02:12:11 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:36.796 02:12:11 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:36.796 02:12:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:36.796 02:12:11 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:36.796 | .driver_specific 00:29:36.796 | .nvme_error 00:29:36.796 | .status_code 00:29:36.796 | .command_transient_transport_error' 00:29:37.056 02:12:11 -- host/digest.sh@71 -- # (( 148 > 0 )) 00:29:37.056 02:12:11 -- host/digest.sh@73 -- # killprocess 1328970 00:29:37.056 02:12:11 -- common/autotest_common.sh@936 -- # '[' -z 1328970 ']' 00:29:37.056 02:12:11 -- common/autotest_common.sh@940 -- # kill -0 1328970 00:29:37.056 02:12:11 -- common/autotest_common.sh@941 -- # uname 00:29:37.056 02:12:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:37.056 02:12:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1328970 00:29:37.056 02:12:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:37.056 02:12:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:37.056 02:12:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1328970' 00:29:37.056 killing process with pid 1328970 00:29:37.056 02:12:11 -- common/autotest_common.sh@955 -- # kill 1328970 00:29:37.056 Received shutdown signal, test time was about 2.000000 seconds 00:29:37.056 00:29:37.056 Latency(us) 00:29:37.056 [2024-11-18T01:12:11.458Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:37.056 [2024-11-18T01:12:11.458Z] =================================================================================================================== 00:29:37.056 [2024-11-18T01:12:11.458Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:37.056 02:12:11 -- common/autotest_common.sh@960 -- # wait 1328970 00:29:37.315 02:12:11 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:29:37.315 02:12:11 -- host/digest.sh@54 -- # local rw bs qd 00:29:37.315 02:12:11 -- host/digest.sh@56 -- # rw=randwrite 00:29:37.315 02:12:11 -- host/digest.sh@56 -- # bs=131072 00:29:37.315 02:12:11 -- host/digest.sh@56 -- # qd=16 00:29:37.315 02:12:11 -- host/digest.sh@58 -- # bperfpid=1330034 00:29:37.315 02:12:11 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:29:37.315 02:12:11 -- host/digest.sh@60 -- # waitforlisten 1330034 /var/tmp/bperf.sock 00:29:37.315 02:12:11 -- common/autotest_common.sh@829 -- # '[' -z 1330034 ']' 00:29:37.315 02:12:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:37.315 02:12:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:37.315 02:12:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:37.315 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:37.315 02:12:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:37.315 02:12:11 -- common/autotest_common.sh@10 -- # set +x 00:29:37.315 [2024-11-18 02:12:11.661142] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:37.315 [2024-11-18 02:12:11.661222] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1330034 ] 00:29:37.315 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:37.315 Zero copy mechanism will not be used. 00:29:37.315 EAL: No free 2048 kB hugepages reported on node 1 00:29:37.575 [2024-11-18 02:12:11.718888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:37.575 [2024-11-18 02:12:11.802519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:38.530 02:12:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:38.530 02:12:12 -- common/autotest_common.sh@862 -- # return 0 00:29:38.530 02:12:12 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:38.530 02:12:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:38.530 02:12:12 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:38.530 02:12:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.530 02:12:12 -- common/autotest_common.sh@10 -- # set +x 00:29:38.789 02:12:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.789 02:12:12 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:38.789 02:12:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:39.046 nvme0n1 00:29:39.046 02:12:13 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:39.046 02:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.046 02:12:13 -- common/autotest_common.sh@10 -- # set +x 00:29:39.046 02:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.046 02:12:13 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:39.046 02:12:13 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:39.046 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:39.046 Zero copy mechanism will not be used. 00:29:39.046 Running I/O for 2 seconds... 00:29:39.046 [2024-11-18 02:12:13.432951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.046 [2024-11-18 02:12:13.433281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.046 [2024-11-18 02:12:13.433366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.046 [2024-11-18 02:12:13.439544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.046 [2024-11-18 02:12:13.439756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.046 [2024-11-18 02:12:13.439792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.046 [2024-11-18 02:12:13.445861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.046 [2024-11-18 02:12:13.446099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.046 [2024-11-18 02:12:13.446133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.452248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.452487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.452519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.458574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.458718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.458753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.465028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.465187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.465221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.471175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.471409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.471440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.477685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.478002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.478037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.484117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.484360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.484395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.490342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.490574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.490610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.496861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.497056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.497089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.503339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.503543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.503573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.509655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.509907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.509945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.515909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.516150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.516183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.522213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.522452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.522483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.529332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.529565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.529599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.536885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.537014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.537053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.544102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.544281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.544328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.551435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.551554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.551592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.558526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.558724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.558756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.565732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.565949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.565981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.572536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.572762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.572794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.579892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.580064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.580098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.587160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.587287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.587328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.594816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.594993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.595026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.601888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.602075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.602108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.609163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.609408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.305 [2024-11-18 02:12:13.609443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.305 [2024-11-18 02:12:13.616213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.305 [2024-11-18 02:12:13.616399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.616432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.306 [2024-11-18 02:12:13.623445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.306 [2024-11-18 02:12:13.623711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.623747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.306 [2024-11-18 02:12:13.630758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.306 [2024-11-18 02:12:13.630965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.631002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.306 [2024-11-18 02:12:13.638241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.306 [2024-11-18 02:12:13.638532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.638562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.306 [2024-11-18 02:12:13.645391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.306 [2024-11-18 02:12:13.645608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.645636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.306 [2024-11-18 02:12:13.652583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.306 [2024-11-18 02:12:13.652788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.652820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.306 [2024-11-18 02:12:13.659598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.306 [2024-11-18 02:12:13.659804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.659837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.306 [2024-11-18 02:12:13.666703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.306 [2024-11-18 02:12:13.666785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.666815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.306 [2024-11-18 02:12:13.673926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.306 [2024-11-18 02:12:13.674182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.674215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.306 [2024-11-18 02:12:13.680740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.306 [2024-11-18 02:12:13.680917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.680950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.306 [2024-11-18 02:12:13.687798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.306 [2024-11-18 02:12:13.687936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.687967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.306 [2024-11-18 02:12:13.694583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.306 [2024-11-18 02:12:13.694847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.694879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.306 [2024-11-18 02:12:13.701305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.306 [2024-11-18 02:12:13.701587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.306 [2024-11-18 02:12:13.701621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.708379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.708590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.708624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.715492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.715743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.715775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.722339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.722471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.722501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.729159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.729453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.729482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.735934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.736196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.736229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.743058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.743290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.743330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.750278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.750547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.750577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.757299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.757548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.757577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.764249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.764406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.764435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.771420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.771608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.771658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.778358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.778438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.778478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.785402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.785572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.785604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.792270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.792477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.792512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.799355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.799430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.799462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.806541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.806779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.806810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.813324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.813541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.813569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.820503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.820725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.820763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.827047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.827267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.827299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.834291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.834563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.834591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.841397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.841479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.841508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.848515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.848635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.848666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.855592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.855753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.855785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.862528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.862693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.862725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.869793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.870016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.870051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.876771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.877003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.877035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.883797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.884017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.884048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.566 [2024-11-18 02:12:13.890963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.566 [2024-11-18 02:12:13.891175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.566 [2024-11-18 02:12:13.891207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.567 [2024-11-18 02:12:13.898023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.567 [2024-11-18 02:12:13.898227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.567 [2024-11-18 02:12:13.898259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.567 [2024-11-18 02:12:13.905058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.567 [2024-11-18 02:12:13.905244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.567 [2024-11-18 02:12:13.905276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.567 [2024-11-18 02:12:13.911968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.567 [2024-11-18 02:12:13.912175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.567 [2024-11-18 02:12:13.912207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.567 [2024-11-18 02:12:13.919007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.567 [2024-11-18 02:12:13.919134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.567 [2024-11-18 02:12:13.919170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.567 [2024-11-18 02:12:13.926238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.567 [2024-11-18 02:12:13.926578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.567 [2024-11-18 02:12:13.926625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.567 [2024-11-18 02:12:13.933188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.567 [2024-11-18 02:12:13.933376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.567 [2024-11-18 02:12:13.933412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.567 [2024-11-18 02:12:13.940281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.567 [2024-11-18 02:12:13.940531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.567 [2024-11-18 02:12:13.940560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.567 [2024-11-18 02:12:13.947067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.567 [2024-11-18 02:12:13.947292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.567 [2024-11-18 02:12:13.947336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.567 [2024-11-18 02:12:13.954157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.567 [2024-11-18 02:12:13.954276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.567 [2024-11-18 02:12:13.954308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.567 [2024-11-18 02:12:13.961024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.567 [2024-11-18 02:12:13.961203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.567 [2024-11-18 02:12:13.961234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.828 [2024-11-18 02:12:13.967820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.828 [2024-11-18 02:12:13.968049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.828 [2024-11-18 02:12:13.968083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.828 [2024-11-18 02:12:13.974788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.828 [2024-11-18 02:12:13.974902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.828 [2024-11-18 02:12:13.974939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.828 [2024-11-18 02:12:13.981801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.828 [2024-11-18 02:12:13.981980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.828 [2024-11-18 02:12:13.982011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.828 [2024-11-18 02:12:13.988676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.828 [2024-11-18 02:12:13.988927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.828 [2024-11-18 02:12:13.988960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.828 [2024-11-18 02:12:13.995811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.828 [2024-11-18 02:12:13.996054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.828 [2024-11-18 02:12:13.996086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.828 [2024-11-18 02:12:14.002926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.828 [2024-11-18 02:12:14.003149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.828 [2024-11-18 02:12:14.003181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.828 [2024-11-18 02:12:14.009569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.828 [2024-11-18 02:12:14.009764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.828 [2024-11-18 02:12:14.009796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.828 [2024-11-18 02:12:14.016675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.828 [2024-11-18 02:12:14.016853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.828 [2024-11-18 02:12:14.016886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.023562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.023719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.023751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.030710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.030935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.030967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.037944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.038192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.038224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.044820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.045012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.045045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.051847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.052067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.052099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.058853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.059031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.059063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.065674] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.065756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.065785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.072783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.072898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.072933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.080046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.080230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.080264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.087050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.087168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.087200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.094199] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.094458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.094489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.101083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.101274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.101307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.107677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.107762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.107791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.114957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.115221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.115253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.121960] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.122131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.122164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.128992] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.129116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.129148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.136093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.136406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.136436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.143299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.143436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.143464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.150129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.150265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.150302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.157086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.157305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.157352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.164113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.164326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.164374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.171385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.171599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.171647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.178042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.178255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.178288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.185136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.185336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.185380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.192285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.192404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.192432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.199569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.199888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.829 [2024-11-18 02:12:14.199922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.829 [2024-11-18 02:12:14.206711] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.829 [2024-11-18 02:12:14.206939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.830 [2024-11-18 02:12:14.206972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.830 [2024-11-18 02:12:14.213753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.830 [2024-11-18 02:12:14.213931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.830 [2024-11-18 02:12:14.213963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.830 [2024-11-18 02:12:14.220768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.830 [2024-11-18 02:12:14.220901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.830 [2024-11-18 02:12:14.220933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.830 [2024-11-18 02:12:14.227716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:39.830 [2024-11-18 02:12:14.227846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.830 [2024-11-18 02:12:14.227882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.091 [2024-11-18 02:12:14.234749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.091 [2024-11-18 02:12:14.235010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.091 [2024-11-18 02:12:14.235044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.091 [2024-11-18 02:12:14.241595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.091 [2024-11-18 02:12:14.241758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.091 [2024-11-18 02:12:14.241791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.091 [2024-11-18 02:12:14.247965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.091 [2024-11-18 02:12:14.248084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.091 [2024-11-18 02:12:14.248117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.091 [2024-11-18 02:12:14.254508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.091 [2024-11-18 02:12:14.254707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.091 [2024-11-18 02:12:14.254739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.091 [2024-11-18 02:12:14.260802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.091 [2024-11-18 02:12:14.261009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.091 [2024-11-18 02:12:14.261042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.091 [2024-11-18 02:12:14.267168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.091 [2024-11-18 02:12:14.267284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.267323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.274118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.274444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.274474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.280143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.280333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.280378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.286430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.286708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.286741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.292672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.292793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.292826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.299346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.299640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.299673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.305617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.305914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.305954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.312034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.312232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.312265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.318243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.318429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.318459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.324430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.324585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.324614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.330755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.330949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.330981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.337040] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.337153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.337185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.343292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.343551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.343611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.349680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.349855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.349891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.355894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.356134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.356167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.362045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.362373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.362403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.368269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.368491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.368520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.375191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.375415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.375453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.382480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.382608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.382656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.389257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.389470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.389506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.396479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.396703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.396736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.403583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.403794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.403826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.410863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.411156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.411194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.418013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.418216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.418249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.424768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.425047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.425080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.431324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.431504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.431534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.438344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.438525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.092 [2024-11-18 02:12:14.438552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.092 [2024-11-18 02:12:14.445268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.092 [2024-11-18 02:12:14.445429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.093 [2024-11-18 02:12:14.445457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.093 [2024-11-18 02:12:14.451864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.093 [2024-11-18 02:12:14.452033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.093 [2024-11-18 02:12:14.452065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.093 [2024-11-18 02:12:14.458786] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.093 [2024-11-18 02:12:14.458882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.093 [2024-11-18 02:12:14.458914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.093 [2024-11-18 02:12:14.465741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.093 [2024-11-18 02:12:14.465921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.093 [2024-11-18 02:12:14.465953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.093 [2024-11-18 02:12:14.472898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.093 [2024-11-18 02:12:14.473128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.093 [2024-11-18 02:12:14.473161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.093 [2024-11-18 02:12:14.479671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.093 [2024-11-18 02:12:14.479794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.093 [2024-11-18 02:12:14.479827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.093 [2024-11-18 02:12:14.486838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.093 [2024-11-18 02:12:14.486985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.093 [2024-11-18 02:12:14.487016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.353 [2024-11-18 02:12:14.493948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.353 [2024-11-18 02:12:14.494161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.353 [2024-11-18 02:12:14.494194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.353 [2024-11-18 02:12:14.501086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.353 [2024-11-18 02:12:14.501325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.353 [2024-11-18 02:12:14.501373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.353 [2024-11-18 02:12:14.508075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.353 [2024-11-18 02:12:14.508237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.353 [2024-11-18 02:12:14.508269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.353 [2024-11-18 02:12:14.514952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.353 [2024-11-18 02:12:14.515078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.353 [2024-11-18 02:12:14.515115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.353 [2024-11-18 02:12:14.522047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.353 [2024-11-18 02:12:14.522252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.353 [2024-11-18 02:12:14.522284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.353 [2024-11-18 02:12:14.528843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.353 [2024-11-18 02:12:14.529058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.353 [2024-11-18 02:12:14.529091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.353 [2024-11-18 02:12:14.535638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.353 [2024-11-18 02:12:14.535860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.353 [2024-11-18 02:12:14.535893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.353 [2024-11-18 02:12:14.542745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.353 [2024-11-18 02:12:14.542901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.353 [2024-11-18 02:12:14.542934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.353 [2024-11-18 02:12:14.549494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.353 [2024-11-18 02:12:14.549719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.353 [2024-11-18 02:12:14.549752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.353 [2024-11-18 02:12:14.556463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.353 [2024-11-18 02:12:14.556581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.353 [2024-11-18 02:12:14.556610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.353 [2024-11-18 02:12:14.563402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.353 [2024-11-18 02:12:14.563487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.353 [2024-11-18 02:12:14.563517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.353 [2024-11-18 02:12:14.570680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.570891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.570930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.577961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.578285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.578329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.585078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.585279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.585320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.592134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.592392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.592428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.599119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.599371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.599401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.606248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.606495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.606538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.613275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.613383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.613412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.620162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.620373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.620402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.627374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.627470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.627499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.634474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.634780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.634812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.641882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.642203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.642236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.648918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.649023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.649054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.655982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.656110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.656142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.662888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.663094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.663128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.669599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.669711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.669743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.676748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.676843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.676875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.683659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.683848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.683881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.690647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.690883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.690915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.697867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.698148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.698181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.704946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.705189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.705222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.711817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.712066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.712099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.719198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.719444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.719473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.725924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.726142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.726175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.732749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.732860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.732891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.739817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.740009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.740041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.746984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.747167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.747200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.354 [2024-11-18 02:12:14.754119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.354 [2024-11-18 02:12:14.754430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.354 [2024-11-18 02:12:14.754465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.616 [2024-11-18 02:12:14.760820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.616 [2024-11-18 02:12:14.761021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.616 [2024-11-18 02:12:14.761054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.616 [2024-11-18 02:12:14.767765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.616 [2024-11-18 02:12:14.767863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.616 [2024-11-18 02:12:14.767900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.616 [2024-11-18 02:12:14.774885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.616 [2024-11-18 02:12:14.775046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.616 [2024-11-18 02:12:14.775078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.616 [2024-11-18 02:12:14.781779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.616 [2024-11-18 02:12:14.782023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.616 [2024-11-18 02:12:14.782055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.616 [2024-11-18 02:12:14.788980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.616 [2024-11-18 02:12:14.789192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.616 [2024-11-18 02:12:14.789225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.616 [2024-11-18 02:12:14.795848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.616 [2024-11-18 02:12:14.795971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.616 [2024-11-18 02:12:14.796004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.616 [2024-11-18 02:12:14.803097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.616 [2024-11-18 02:12:14.803184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.803217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.810031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.810244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.810276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.816989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.817193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.817227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.823944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.824133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.824170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.830863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.831165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.831197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.837962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.838155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.838188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.844996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.845115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.845147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.852057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.852300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.852340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.858972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.859228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.859260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.865965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.866167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.866201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.872953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.873203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.873236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.879858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.880069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.880101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.887061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.887164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.887196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.893962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.894083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.894116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.901030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.901213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.901252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.908080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.908218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.908251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.915413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.915695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.915727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.922682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.922890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.922923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.929688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.929924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.929959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.936554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.936658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.936696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.943578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.943684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.943718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.950911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.951053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.951085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.957786] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.957961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.957994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.964585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.964756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.964788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.971290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.971428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.971457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.978416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.978657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.978702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.617 [2024-11-18 02:12:14.985123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.617 [2024-11-18 02:12:14.985266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.617 [2024-11-18 02:12:14.985298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.618 [2024-11-18 02:12:14.991666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.618 [2024-11-18 02:12:14.991830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.618 [2024-11-18 02:12:14.991862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.618 [2024-11-18 02:12:14.997960] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.618 [2024-11-18 02:12:14.998089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.618 [2024-11-18 02:12:14.998122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.618 [2024-11-18 02:12:15.004581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.618 [2024-11-18 02:12:15.004744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.618 [2024-11-18 02:12:15.004776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.618 [2024-11-18 02:12:15.011634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.618 [2024-11-18 02:12:15.011896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.618 [2024-11-18 02:12:15.011929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.877 [2024-11-18 02:12:15.018846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.019050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.019082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.026257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.026551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.026586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.032952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.033227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.033265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.039893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.040100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.040133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.046738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.046946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.046979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.053812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.053894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.053932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.060704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.060901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.060933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.067702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.067892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.067925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.074513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.074771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.074809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.081593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.081852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.081885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.088511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.088805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.088837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.095453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.095697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.095729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.102558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.102833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.102866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.109595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.109818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.109851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.116603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.116879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.116912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.123370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.123536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.123567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.130738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.130833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.130865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.137869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.138077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.138109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.144837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.145073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.145106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.151955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.152139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.152172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.159127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.159291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.159334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.166219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.166441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.166471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.173268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.173501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.173531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.180362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.180514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.180544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.187270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.187371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.187430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.194429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.194515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.194553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.878 [2024-11-18 02:12:15.201706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.878 [2024-11-18 02:12:15.201875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.878 [2024-11-18 02:12:15.201907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.879 [2024-11-18 02:12:15.208528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.879 [2024-11-18 02:12:15.208772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.879 [2024-11-18 02:12:15.208804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.879 [2024-11-18 02:12:15.215574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.879 [2024-11-18 02:12:15.215705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.879 [2024-11-18 02:12:15.215751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.879 [2024-11-18 02:12:15.222652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.879 [2024-11-18 02:12:15.222875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.879 [2024-11-18 02:12:15.222908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.879 [2024-11-18 02:12:15.229588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.879 [2024-11-18 02:12:15.229846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.879 [2024-11-18 02:12:15.229878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.879 [2024-11-18 02:12:15.236445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.879 [2024-11-18 02:12:15.236632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.879 [2024-11-18 02:12:15.236671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.879 [2024-11-18 02:12:15.243581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.879 [2024-11-18 02:12:15.243730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.879 [2024-11-18 02:12:15.243762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.879 [2024-11-18 02:12:15.250446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.879 [2024-11-18 02:12:15.250686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.879 [2024-11-18 02:12:15.250717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.879 [2024-11-18 02:12:15.257505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.879 [2024-11-18 02:12:15.257735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.879 [2024-11-18 02:12:15.257767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.879 [2024-11-18 02:12:15.264471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.879 [2024-11-18 02:12:15.264695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.879 [2024-11-18 02:12:15.264728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.879 [2024-11-18 02:12:15.271729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.879 [2024-11-18 02:12:15.272070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.879 [2024-11-18 02:12:15.272103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.879 [2024-11-18 02:12:15.278781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:40.879 [2024-11-18 02:12:15.279001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.879 [2024-11-18 02:12:15.279035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.286061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.286153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.286185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.292957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.293052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.293088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.300175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.300290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.300336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.306931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.307037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.307069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.314036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.314204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.314236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.321114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.321368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.321397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.328305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.328540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.328570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.335547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.335652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.335684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.342898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.343026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.343058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.349875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.350064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.350096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.357328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.357517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.357548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.364411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.364555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.364585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.371386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.371639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.371686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.378678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.379013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.379042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.385806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.385989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.386019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.392808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.392963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.392993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.399944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.400068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.400097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.406870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.407069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.407098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.413897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.414109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.414137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.420732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.420857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.420894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:41.138 [2024-11-18 02:12:15.427952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd92ac0) with pdu=0x2000190fef90 00:29:41.138 [2024-11-18 02:12:15.428096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.138 [2024-11-18 02:12:15.428125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:41.138 00:29:41.138 Latency(us) 00:29:41.138 [2024-11-18T01:12:15.540Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:41.138 [2024-11-18T01:12:15.540Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:41.138 nvme0n1 : 2.00 4463.72 557.96 0.00 0.00 3575.71 2730.67 8155.59 00:29:41.138 [2024-11-18T01:12:15.540Z] =================================================================================================================== 00:29:41.138 [2024-11-18T01:12:15.540Z] Total : 4463.72 557.96 0.00 0.00 3575.71 2730.67 8155.59 00:29:41.138 0 00:29:41.138 02:12:15 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:41.138 02:12:15 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:41.138 02:12:15 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:41.138 | .driver_specific 00:29:41.138 | .nvme_error 00:29:41.138 | .status_code 00:29:41.138 | .command_transient_transport_error' 00:29:41.138 02:12:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:41.397 02:12:15 -- host/digest.sh@71 -- # (( 288 > 0 )) 00:29:41.397 02:12:15 -- host/digest.sh@73 -- # killprocess 1330034 00:29:41.397 02:12:15 -- common/autotest_common.sh@936 -- # '[' -z 1330034 ']' 00:29:41.397 02:12:15 -- common/autotest_common.sh@940 -- # kill -0 1330034 00:29:41.397 02:12:15 -- common/autotest_common.sh@941 -- # uname 00:29:41.397 02:12:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:41.397 02:12:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1330034 00:29:41.397 02:12:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:41.397 02:12:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:41.397 02:12:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1330034' 00:29:41.397 killing process with pid 1330034 00:29:41.397 02:12:15 -- common/autotest_common.sh@955 -- # kill 1330034 00:29:41.397 Received shutdown signal, test time was about 2.000000 seconds 00:29:41.397 00:29:41.397 Latency(us) 00:29:41.397 [2024-11-18T01:12:15.799Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:41.397 [2024-11-18T01:12:15.799Z] =================================================================================================================== 00:29:41.397 [2024-11-18T01:12:15.799Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:41.397 02:12:15 -- common/autotest_common.sh@960 -- # wait 1330034 00:29:41.657 02:12:15 -- host/digest.sh@115 -- # killprocess 1327728 00:29:41.657 02:12:15 -- common/autotest_common.sh@936 -- # '[' -z 1327728 ']' 00:29:41.657 02:12:15 -- common/autotest_common.sh@940 -- # kill -0 1327728 00:29:41.657 02:12:15 -- common/autotest_common.sh@941 -- # uname 00:29:41.657 02:12:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:41.657 02:12:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1327728 00:29:41.657 02:12:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:41.657 02:12:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:41.657 02:12:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1327728' 00:29:41.657 killing process with pid 1327728 00:29:41.657 02:12:16 -- common/autotest_common.sh@955 -- # kill 1327728 00:29:41.657 02:12:16 -- common/autotest_common.sh@960 -- # wait 1327728 00:29:41.917 00:29:41.918 real 0m18.310s 00:29:41.918 user 0m36.605s 00:29:41.918 sys 0m4.725s 00:29:41.918 02:12:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:41.918 02:12:16 -- common/autotest_common.sh@10 -- # set +x 00:29:41.918 ************************************ 00:29:41.918 END TEST nvmf_digest_error 00:29:41.918 ************************************ 00:29:41.918 02:12:16 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:29:41.918 02:12:16 -- host/digest.sh@139 -- # nvmftestfini 00:29:41.918 02:12:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:41.918 02:12:16 -- nvmf/common.sh@116 -- # sync 00:29:41.918 02:12:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:41.918 02:12:16 -- nvmf/common.sh@119 -- # set +e 00:29:41.918 02:12:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:41.918 02:12:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:41.918 rmmod nvme_tcp 00:29:41.918 rmmod nvme_fabrics 00:29:41.918 rmmod nvme_keyring 00:29:41.918 02:12:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:41.918 02:12:16 -- nvmf/common.sh@123 -- # set -e 00:29:41.918 02:12:16 -- nvmf/common.sh@124 -- # return 0 00:29:41.918 02:12:16 -- nvmf/common.sh@477 -- # '[' -n 1327728 ']' 00:29:41.918 02:12:16 -- nvmf/common.sh@478 -- # killprocess 1327728 00:29:41.918 02:12:16 -- common/autotest_common.sh@936 -- # '[' -z 1327728 ']' 00:29:41.918 02:12:16 -- common/autotest_common.sh@940 -- # kill -0 1327728 00:29:41.918 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1327728) - No such process 00:29:41.918 02:12:16 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1327728 is not found' 00:29:41.918 Process with pid 1327728 is not found 00:29:41.918 02:12:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:41.918 02:12:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:41.918 02:12:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:41.918 02:12:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:41.918 02:12:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:41.918 02:12:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:41.918 02:12:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:41.918 02:12:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:44.459 02:12:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:44.459 00:29:44.459 real 0m38.124s 00:29:44.459 user 1m6.948s 00:29:44.459 sys 0m10.960s 00:29:44.459 02:12:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:44.459 02:12:18 -- common/autotest_common.sh@10 -- # set +x 00:29:44.459 ************************************ 00:29:44.459 END TEST nvmf_digest 00:29:44.459 ************************************ 00:29:44.459 02:12:18 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:29:44.459 02:12:18 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:29:44.459 02:12:18 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:29:44.459 02:12:18 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:44.459 02:12:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:44.459 02:12:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:44.459 02:12:18 -- common/autotest_common.sh@10 -- # set +x 00:29:44.459 ************************************ 00:29:44.459 START TEST nvmf_bdevperf 00:29:44.459 ************************************ 00:29:44.459 02:12:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:44.459 * Looking for test storage... 00:29:44.459 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:44.459 02:12:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:44.459 02:12:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:44.459 02:12:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:44.459 02:12:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:44.459 02:12:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:44.459 02:12:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:44.459 02:12:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:44.459 02:12:18 -- scripts/common.sh@335 -- # IFS=.-: 00:29:44.459 02:12:18 -- scripts/common.sh@335 -- # read -ra ver1 00:29:44.459 02:12:18 -- scripts/common.sh@336 -- # IFS=.-: 00:29:44.459 02:12:18 -- scripts/common.sh@336 -- # read -ra ver2 00:29:44.459 02:12:18 -- scripts/common.sh@337 -- # local 'op=<' 00:29:44.459 02:12:18 -- scripts/common.sh@339 -- # ver1_l=2 00:29:44.459 02:12:18 -- scripts/common.sh@340 -- # ver2_l=1 00:29:44.459 02:12:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:44.459 02:12:18 -- scripts/common.sh@343 -- # case "$op" in 00:29:44.459 02:12:18 -- scripts/common.sh@344 -- # : 1 00:29:44.459 02:12:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:44.459 02:12:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:44.459 02:12:18 -- scripts/common.sh@364 -- # decimal 1 00:29:44.459 02:12:18 -- scripts/common.sh@352 -- # local d=1 00:29:44.459 02:12:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:44.459 02:12:18 -- scripts/common.sh@354 -- # echo 1 00:29:44.459 02:12:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:44.459 02:12:18 -- scripts/common.sh@365 -- # decimal 2 00:29:44.459 02:12:18 -- scripts/common.sh@352 -- # local d=2 00:29:44.459 02:12:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:44.459 02:12:18 -- scripts/common.sh@354 -- # echo 2 00:29:44.459 02:12:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:44.459 02:12:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:44.459 02:12:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:44.459 02:12:18 -- scripts/common.sh@367 -- # return 0 00:29:44.459 02:12:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:44.459 02:12:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:44.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:44.459 --rc genhtml_branch_coverage=1 00:29:44.459 --rc genhtml_function_coverage=1 00:29:44.459 --rc genhtml_legend=1 00:29:44.459 --rc geninfo_all_blocks=1 00:29:44.459 --rc geninfo_unexecuted_blocks=1 00:29:44.459 00:29:44.459 ' 00:29:44.459 02:12:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:44.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:44.459 --rc genhtml_branch_coverage=1 00:29:44.459 --rc genhtml_function_coverage=1 00:29:44.459 --rc genhtml_legend=1 00:29:44.459 --rc geninfo_all_blocks=1 00:29:44.459 --rc geninfo_unexecuted_blocks=1 00:29:44.459 00:29:44.459 ' 00:29:44.459 02:12:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:44.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:44.459 --rc genhtml_branch_coverage=1 00:29:44.459 --rc genhtml_function_coverage=1 00:29:44.459 --rc genhtml_legend=1 00:29:44.459 --rc geninfo_all_blocks=1 00:29:44.459 --rc geninfo_unexecuted_blocks=1 00:29:44.459 00:29:44.459 ' 00:29:44.459 02:12:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:44.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:44.459 --rc genhtml_branch_coverage=1 00:29:44.459 --rc genhtml_function_coverage=1 00:29:44.459 --rc genhtml_legend=1 00:29:44.459 --rc geninfo_all_blocks=1 00:29:44.459 --rc geninfo_unexecuted_blocks=1 00:29:44.459 00:29:44.459 ' 00:29:44.459 02:12:18 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:44.459 02:12:18 -- nvmf/common.sh@7 -- # uname -s 00:29:44.459 02:12:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:44.459 02:12:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:44.459 02:12:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:44.459 02:12:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:44.459 02:12:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:44.459 02:12:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:44.459 02:12:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:44.459 02:12:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:44.459 02:12:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:44.459 02:12:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:44.459 02:12:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:44.459 02:12:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:44.459 02:12:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:44.459 02:12:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:44.459 02:12:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:44.459 02:12:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:44.459 02:12:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:44.459 02:12:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:44.459 02:12:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:44.459 02:12:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:44.459 02:12:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:44.459 02:12:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:44.459 02:12:18 -- paths/export.sh@5 -- # export PATH 00:29:44.459 02:12:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:44.459 02:12:18 -- nvmf/common.sh@46 -- # : 0 00:29:44.459 02:12:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:44.459 02:12:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:44.459 02:12:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:44.459 02:12:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:44.459 02:12:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:44.459 02:12:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:44.459 02:12:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:44.459 02:12:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:44.459 02:12:18 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:29:44.459 02:12:18 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:29:44.459 02:12:18 -- host/bdevperf.sh@24 -- # nvmftestinit 00:29:44.459 02:12:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:44.459 02:12:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:44.459 02:12:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:44.459 02:12:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:44.459 02:12:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:44.459 02:12:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:44.459 02:12:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:44.459 02:12:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:44.459 02:12:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:44.459 02:12:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:44.459 02:12:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:44.459 02:12:18 -- common/autotest_common.sh@10 -- # set +x 00:29:46.365 02:12:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:46.365 02:12:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:46.365 02:12:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:46.365 02:12:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:46.365 02:12:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:46.365 02:12:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:46.365 02:12:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:46.365 02:12:20 -- nvmf/common.sh@294 -- # net_devs=() 00:29:46.365 02:12:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:46.365 02:12:20 -- nvmf/common.sh@295 -- # e810=() 00:29:46.365 02:12:20 -- nvmf/common.sh@295 -- # local -ga e810 00:29:46.365 02:12:20 -- nvmf/common.sh@296 -- # x722=() 00:29:46.365 02:12:20 -- nvmf/common.sh@296 -- # local -ga x722 00:29:46.365 02:12:20 -- nvmf/common.sh@297 -- # mlx=() 00:29:46.365 02:12:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:46.365 02:12:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:46.365 02:12:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:46.365 02:12:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:46.365 02:12:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:46.365 02:12:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:46.365 02:12:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:46.365 02:12:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:46.365 02:12:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:46.365 02:12:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:46.365 02:12:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:46.365 02:12:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:46.365 02:12:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:46.365 02:12:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:46.365 02:12:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:46.365 02:12:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:46.365 02:12:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:46.365 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:46.365 02:12:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:46.365 02:12:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:46.365 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:46.365 02:12:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:46.365 02:12:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:46.365 02:12:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:46.365 02:12:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:46.365 02:12:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:46.365 02:12:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:46.365 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:46.365 02:12:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:46.365 02:12:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:46.365 02:12:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:46.365 02:12:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:46.365 02:12:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:46.365 02:12:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:46.365 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:46.365 02:12:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:46.365 02:12:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:46.365 02:12:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:46.365 02:12:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:46.365 02:12:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:46.366 02:12:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:46.366 02:12:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:46.366 02:12:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:46.366 02:12:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:46.366 02:12:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:46.366 02:12:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:46.366 02:12:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:46.366 02:12:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:46.366 02:12:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:46.366 02:12:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:46.366 02:12:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:46.366 02:12:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:46.366 02:12:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:46.366 02:12:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:46.366 02:12:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:46.366 02:12:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:46.366 02:12:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:46.366 02:12:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:46.366 02:12:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:46.366 02:12:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:46.366 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:46.366 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.264 ms 00:29:46.366 00:29:46.366 --- 10.0.0.2 ping statistics --- 00:29:46.366 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:46.366 rtt min/avg/max/mdev = 0.264/0.264/0.264/0.000 ms 00:29:46.366 02:12:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:46.366 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:46.366 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:29:46.366 00:29:46.366 --- 10.0.0.1 ping statistics --- 00:29:46.366 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:46.366 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:29:46.366 02:12:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:46.366 02:12:20 -- nvmf/common.sh@410 -- # return 0 00:29:46.366 02:12:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:46.366 02:12:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:46.366 02:12:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:46.366 02:12:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:46.366 02:12:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:46.366 02:12:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:46.366 02:12:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:46.366 02:12:20 -- host/bdevperf.sh@25 -- # tgt_init 00:29:46.366 02:12:20 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:46.366 02:12:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:46.366 02:12:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:46.366 02:12:20 -- common/autotest_common.sh@10 -- # set +x 00:29:46.366 02:12:20 -- nvmf/common.sh@469 -- # nvmfpid=1332546 00:29:46.366 02:12:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:46.366 02:12:20 -- nvmf/common.sh@470 -- # waitforlisten 1332546 00:29:46.366 02:12:20 -- common/autotest_common.sh@829 -- # '[' -z 1332546 ']' 00:29:46.366 02:12:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:46.366 02:12:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:46.366 02:12:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:46.366 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:46.366 02:12:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:46.366 02:12:20 -- common/autotest_common.sh@10 -- # set +x 00:29:46.366 [2024-11-18 02:12:20.701913] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:46.366 [2024-11-18 02:12:20.701988] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:46.366 EAL: No free 2048 kB hugepages reported on node 1 00:29:46.625 [2024-11-18 02:12:20.767440] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:46.625 [2024-11-18 02:12:20.857720] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:46.625 [2024-11-18 02:12:20.857876] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:46.625 [2024-11-18 02:12:20.857894] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:46.625 [2024-11-18 02:12:20.857906] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:46.625 [2024-11-18 02:12:20.858150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:46.625 [2024-11-18 02:12:20.858213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:46.625 [2024-11-18 02:12:20.858216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:47.562 02:12:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:47.562 02:12:21 -- common/autotest_common.sh@862 -- # return 0 00:29:47.562 02:12:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:47.562 02:12:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:47.562 02:12:21 -- common/autotest_common.sh@10 -- # set +x 00:29:47.562 02:12:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:47.562 02:12:21 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:47.562 02:12:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.562 02:12:21 -- common/autotest_common.sh@10 -- # set +x 00:29:47.562 [2024-11-18 02:12:21.710636] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:47.562 02:12:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.562 02:12:21 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:47.562 02:12:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.562 02:12:21 -- common/autotest_common.sh@10 -- # set +x 00:29:47.562 Malloc0 00:29:47.562 02:12:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.562 02:12:21 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:47.562 02:12:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.562 02:12:21 -- common/autotest_common.sh@10 -- # set +x 00:29:47.562 02:12:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.562 02:12:21 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:47.562 02:12:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.562 02:12:21 -- common/autotest_common.sh@10 -- # set +x 00:29:47.562 02:12:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.562 02:12:21 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:47.562 02:12:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.563 02:12:21 -- common/autotest_common.sh@10 -- # set +x 00:29:47.563 [2024-11-18 02:12:21.772286] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:47.563 02:12:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.563 02:12:21 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:29:47.563 02:12:21 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:29:47.563 02:12:21 -- nvmf/common.sh@520 -- # config=() 00:29:47.563 02:12:21 -- nvmf/common.sh@520 -- # local subsystem config 00:29:47.563 02:12:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:47.563 02:12:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:47.563 { 00:29:47.563 "params": { 00:29:47.563 "name": "Nvme$subsystem", 00:29:47.563 "trtype": "$TEST_TRANSPORT", 00:29:47.563 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:47.563 "adrfam": "ipv4", 00:29:47.563 "trsvcid": "$NVMF_PORT", 00:29:47.563 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:47.563 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:47.563 "hdgst": ${hdgst:-false}, 00:29:47.563 "ddgst": ${ddgst:-false} 00:29:47.563 }, 00:29:47.563 "method": "bdev_nvme_attach_controller" 00:29:47.563 } 00:29:47.563 EOF 00:29:47.563 )") 00:29:47.563 02:12:21 -- nvmf/common.sh@542 -- # cat 00:29:47.563 02:12:21 -- nvmf/common.sh@544 -- # jq . 00:29:47.563 02:12:21 -- nvmf/common.sh@545 -- # IFS=, 00:29:47.563 02:12:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:47.563 "params": { 00:29:47.563 "name": "Nvme1", 00:29:47.563 "trtype": "tcp", 00:29:47.563 "traddr": "10.0.0.2", 00:29:47.563 "adrfam": "ipv4", 00:29:47.563 "trsvcid": "4420", 00:29:47.563 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:47.563 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:47.563 "hdgst": false, 00:29:47.563 "ddgst": false 00:29:47.563 }, 00:29:47.563 "method": "bdev_nvme_attach_controller" 00:29:47.563 }' 00:29:47.563 [2024-11-18 02:12:21.814221] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:47.563 [2024-11-18 02:12:21.814308] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1332705 ] 00:29:47.563 EAL: No free 2048 kB hugepages reported on node 1 00:29:47.563 [2024-11-18 02:12:21.873401] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:47.563 [2024-11-18 02:12:21.961949] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:48.133 Running I/O for 1 seconds... 00:29:49.072 00:29:49.072 Latency(us) 00:29:49.072 [2024-11-18T01:12:23.474Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:49.072 [2024-11-18T01:12:23.474Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:49.072 Verification LBA range: start 0x0 length 0x4000 00:29:49.072 Nvme1n1 : 1.01 12830.84 50.12 0.00 0.00 9927.65 1808.31 15437.37 00:29:49.072 [2024-11-18T01:12:23.474Z] =================================================================================================================== 00:29:49.072 [2024-11-18T01:12:23.474Z] Total : 12830.84 50.12 0.00 0.00 9927.65 1808.31 15437.37 00:29:49.331 02:12:23 -- host/bdevperf.sh@30 -- # bdevperfpid=1332854 00:29:49.331 02:12:23 -- host/bdevperf.sh@32 -- # sleep 3 00:29:49.331 02:12:23 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:29:49.331 02:12:23 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:29:49.331 02:12:23 -- nvmf/common.sh@520 -- # config=() 00:29:49.331 02:12:23 -- nvmf/common.sh@520 -- # local subsystem config 00:29:49.331 02:12:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:49.331 02:12:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:49.331 { 00:29:49.331 "params": { 00:29:49.331 "name": "Nvme$subsystem", 00:29:49.331 "trtype": "$TEST_TRANSPORT", 00:29:49.331 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:49.331 "adrfam": "ipv4", 00:29:49.331 "trsvcid": "$NVMF_PORT", 00:29:49.331 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:49.331 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:49.331 "hdgst": ${hdgst:-false}, 00:29:49.331 "ddgst": ${ddgst:-false} 00:29:49.331 }, 00:29:49.331 "method": "bdev_nvme_attach_controller" 00:29:49.331 } 00:29:49.331 EOF 00:29:49.331 )") 00:29:49.331 02:12:23 -- nvmf/common.sh@542 -- # cat 00:29:49.331 02:12:23 -- nvmf/common.sh@544 -- # jq . 00:29:49.331 02:12:23 -- nvmf/common.sh@545 -- # IFS=, 00:29:49.331 02:12:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:49.331 "params": { 00:29:49.331 "name": "Nvme1", 00:29:49.331 "trtype": "tcp", 00:29:49.331 "traddr": "10.0.0.2", 00:29:49.331 "adrfam": "ipv4", 00:29:49.331 "trsvcid": "4420", 00:29:49.331 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:49.331 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:49.331 "hdgst": false, 00:29:49.331 "ddgst": false 00:29:49.331 }, 00:29:49.331 "method": "bdev_nvme_attach_controller" 00:29:49.331 }' 00:29:49.331 [2024-11-18 02:12:23.564417] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:49.331 [2024-11-18 02:12:23.564505] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1332854 ] 00:29:49.331 EAL: No free 2048 kB hugepages reported on node 1 00:29:49.331 [2024-11-18 02:12:23.623257] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:49.331 [2024-11-18 02:12:23.705225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:49.592 Running I/O for 15 seconds... 00:29:52.130 02:12:26 -- host/bdevperf.sh@33 -- # kill -9 1332546 00:29:52.130 02:12:26 -- host/bdevperf.sh@35 -- # sleep 3 00:29:52.393 [2024-11-18 02:12:26.537828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.537883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.537919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.537938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.537958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:10648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.537974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.537992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:10680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:10704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:10728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:10760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:10768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:10784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:10800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:10816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.393 [2024-11-18 02:12:26.538287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:10824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:10832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.393 [2024-11-18 02:12:26.538379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:10840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:10848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.393 [2024-11-18 02:12:26.538436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:10856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.393 [2024-11-18 02:12:26.538468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:10864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.393 [2024-11-18 02:12:26.538498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:10872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:10880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.393 [2024-11-18 02:12:26.538556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:10888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:10896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.393 [2024-11-18 02:12:26.538632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:10904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:10912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:10920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.393 [2024-11-18 02:12:26.538727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:10928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:10936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:10944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:10952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:10960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.393 [2024-11-18 02:12:26.538888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:10968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.393 [2024-11-18 02:12:26.538920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:10976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.393 [2024-11-18 02:12:26.538951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:10984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.393 [2024-11-18 02:12:26.538982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.393 [2024-11-18 02:12:26.538999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:10992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.393 [2024-11-18 02:12:26.539015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:11000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.394 [2024-11-18 02:12:26.539046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:10240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:10248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:10256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:10272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:10280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:10296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:11008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:11016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:11024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:10304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:10344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:10360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:10368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:10400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:10416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:10424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:11032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:11040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.394 [2024-11-18 02:12:26.539754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:11048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:11056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.394 [2024-11-18 02:12:26.539818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:11064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.394 [2024-11-18 02:12:26.539850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:11072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.394 [2024-11-18 02:12:26.539882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:11080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.394 [2024-11-18 02:12:26.539914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:11088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.539945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:11096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.394 [2024-11-18 02:12:26.539977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.539994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:11104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.540009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.540026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.540041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.540059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.540075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.540091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:11128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.540107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.540128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:10456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.540144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.540161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:10488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.540176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.540193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:10504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.540207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.540224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:10512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.540238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.540255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:10528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.540270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.540286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:10552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.394 [2024-11-18 02:12:26.540301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.394 [2024-11-18 02:12:26.540326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:10568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.540343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:10592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.540395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:11136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.540424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:11144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.540452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:11152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.540480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:11160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.540508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:11168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.540540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:11176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.540569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:11184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.540616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:11192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.540647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:11200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.540679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:11208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.540710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:11216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.540742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:11224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.540773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:11232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.540805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:11240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.540836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:11248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.540867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:11256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.540898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:11264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.540929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:11272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.540965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.540981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:11280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.540996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:11288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.541027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:11296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.541061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:11304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.541094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:11312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.541127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:11320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.541161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.541194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:11336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.541228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:11344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.541260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:11352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.541293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:11360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.541335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:11368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.541392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:11376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.541421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:11384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.541460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:11392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.541490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:11400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.541519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:11408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:52.395 [2024-11-18 02:12:26.541549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:11416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.541579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:11424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.395 [2024-11-18 02:12:26.541627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.395 [2024-11-18 02:12:26.541643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:10600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.541659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.541676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:10608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.541691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.541708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:10616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.541723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.541740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:10632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.541755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.541772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:10656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.541787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.541807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:10664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.541824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.541840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:10672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.541855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.541871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:10688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.541886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.541903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:10696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.541917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.541934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:10712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.541949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.541965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.541980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.541997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:10736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.542012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.542028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.542043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.542059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:10752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.542075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.542091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:10776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.396 [2024-11-18 02:12:26.542106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.542121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12b39a0 is same with the state(5) to be set 00:29:52.396 [2024-11-18 02:12:26.542140] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:52.396 [2024-11-18 02:12:26.542152] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:52.396 [2024-11-18 02:12:26.542165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10808 len:8 PRP1 0x0 PRP2 0x0 00:29:52.396 [2024-11-18 02:12:26.542179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.542247] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x12b39a0 was disconnected and freed. reset controller. 00:29:52.396 [2024-11-18 02:12:26.542335] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:52.396 [2024-11-18 02:12:26.542379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.542395] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:52.396 [2024-11-18 02:12:26.542407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.542421] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:52.396 [2024-11-18 02:12:26.542433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.542447] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:52.396 [2024-11-18 02:12:26.542460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:52.396 [2024-11-18 02:12:26.542471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.396 [2024-11-18 02:12:26.544768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.396 [2024-11-18 02:12:26.544817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.396 [2024-11-18 02:12:26.545301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.396 [2024-11-18 02:12:26.545468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.396 [2024-11-18 02:12:26.545494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.396 [2024-11-18 02:12:26.545510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.396 [2024-11-18 02:12:26.545685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.396 [2024-11-18 02:12:26.545854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.396 [2024-11-18 02:12:26.545875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.396 [2024-11-18 02:12:26.545894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.396 [2024-11-18 02:12:26.548267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.396 [2024-11-18 02:12:26.557509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.396 [2024-11-18 02:12:26.557917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.396 [2024-11-18 02:12:26.558036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.396 [2024-11-18 02:12:26.558062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.396 [2024-11-18 02:12:26.558079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.396 [2024-11-18 02:12:26.558210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.396 [2024-11-18 02:12:26.558375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.396 [2024-11-18 02:12:26.558411] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.396 [2024-11-18 02:12:26.558425] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.396 [2024-11-18 02:12:26.560578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.396 [2024-11-18 02:12:26.570101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.396 [2024-11-18 02:12:26.570457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.396 [2024-11-18 02:12:26.570589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.396 [2024-11-18 02:12:26.570615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.396 [2024-11-18 02:12:26.570648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.396 [2024-11-18 02:12:26.570830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.396 [2024-11-18 02:12:26.570980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.396 [2024-11-18 02:12:26.571003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.396 [2024-11-18 02:12:26.571018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.396 [2024-11-18 02:12:26.573500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.396 [2024-11-18 02:12:26.582643] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.396 [2024-11-18 02:12:26.582992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.396 [2024-11-18 02:12:26.583193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.396 [2024-11-18 02:12:26.583222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.396 [2024-11-18 02:12:26.583240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.396 [2024-11-18 02:12:26.583434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.396 [2024-11-18 02:12:26.583621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.396 [2024-11-18 02:12:26.583644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.396 [2024-11-18 02:12:26.583659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.396 [2024-11-18 02:12:26.585912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.396 [2024-11-18 02:12:26.595439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.397 [2024-11-18 02:12:26.595763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.595857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.595883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.397 [2024-11-18 02:12:26.595899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.397 [2024-11-18 02:12:26.596030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.397 [2024-11-18 02:12:26.596145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.397 [2024-11-18 02:12:26.596167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.397 [2024-11-18 02:12:26.596182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.397 [2024-11-18 02:12:26.598535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.397 [2024-11-18 02:12:26.608018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.397 [2024-11-18 02:12:26.608317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.608457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.608486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.397 [2024-11-18 02:12:26.608503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.397 [2024-11-18 02:12:26.608613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.397 [2024-11-18 02:12:26.608799] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.397 [2024-11-18 02:12:26.608821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.397 [2024-11-18 02:12:26.608836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.397 [2024-11-18 02:12:26.611071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.397 [2024-11-18 02:12:26.620326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.397 [2024-11-18 02:12:26.620659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.620829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.620855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.397 [2024-11-18 02:12:26.620871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.397 [2024-11-18 02:12:26.620970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.397 [2024-11-18 02:12:26.621162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.397 [2024-11-18 02:12:26.621185] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.397 [2024-11-18 02:12:26.621200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.397 [2024-11-18 02:12:26.623443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.397 [2024-11-18 02:12:26.632920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.397 [2024-11-18 02:12:26.633274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.633400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.633431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.397 [2024-11-18 02:12:26.633449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.397 [2024-11-18 02:12:26.633577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.397 [2024-11-18 02:12:26.633745] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.397 [2024-11-18 02:12:26.633768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.397 [2024-11-18 02:12:26.633783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.397 [2024-11-18 02:12:26.636054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.397 [2024-11-18 02:12:26.645481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.397 [2024-11-18 02:12:26.645834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.645974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.645999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.397 [2024-11-18 02:12:26.646015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.397 [2024-11-18 02:12:26.646223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.397 [2024-11-18 02:12:26.646402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.397 [2024-11-18 02:12:26.646426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.397 [2024-11-18 02:12:26.646441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.397 [2024-11-18 02:12:26.648621] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.397 [2024-11-18 02:12:26.658163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.397 [2024-11-18 02:12:26.658525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.658659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.658685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.397 [2024-11-18 02:12:26.658702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.397 [2024-11-18 02:12:26.658874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.397 [2024-11-18 02:12:26.659060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.397 [2024-11-18 02:12:26.659083] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.397 [2024-11-18 02:12:26.659098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.397 [2024-11-18 02:12:26.661436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.397 [2024-11-18 02:12:26.670661] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.397 [2024-11-18 02:12:26.671065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.671256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.671284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.397 [2024-11-18 02:12:26.671302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.397 [2024-11-18 02:12:26.671513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.397 [2024-11-18 02:12:26.671682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.397 [2024-11-18 02:12:26.671705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.397 [2024-11-18 02:12:26.671720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.397 [2024-11-18 02:12:26.674049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.397 [2024-11-18 02:12:26.683347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.397 [2024-11-18 02:12:26.683582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.683716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.397 [2024-11-18 02:12:26.683746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.397 [2024-11-18 02:12:26.683777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.397 [2024-11-18 02:12:26.683956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.397 [2024-11-18 02:12:26.684174] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.397 [2024-11-18 02:12:26.684197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.397 [2024-11-18 02:12:26.684213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.398 [2024-11-18 02:12:26.686368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.398 [2024-11-18 02:12:26.696198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.398 [2024-11-18 02:12:26.696481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.696613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.696656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.398 [2024-11-18 02:12:26.696672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.398 [2024-11-18 02:12:26.696864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.398 [2024-11-18 02:12:26.697046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.398 [2024-11-18 02:12:26.697068] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.398 [2024-11-18 02:12:26.697084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.398 [2024-11-18 02:12:26.699609] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.398 [2024-11-18 02:12:26.708962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.398 [2024-11-18 02:12:26.709284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.709459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.709486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.398 [2024-11-18 02:12:26.709502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.398 [2024-11-18 02:12:26.709679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.398 [2024-11-18 02:12:26.709898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.398 [2024-11-18 02:12:26.709921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.398 [2024-11-18 02:12:26.709936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.398 [2024-11-18 02:12:26.712492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.398 [2024-11-18 02:12:26.721555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.398 [2024-11-18 02:12:26.721871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.722037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.722063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.398 [2024-11-18 02:12:26.722085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.398 [2024-11-18 02:12:26.722248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.398 [2024-11-18 02:12:26.722431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.398 [2024-11-18 02:12:26.722456] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.398 [2024-11-18 02:12:26.722471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.398 [2024-11-18 02:12:26.725033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.398 [2024-11-18 02:12:26.734089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.398 [2024-11-18 02:12:26.734434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.734616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.734683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.398 [2024-11-18 02:12:26.734701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.398 [2024-11-18 02:12:26.734883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.398 [2024-11-18 02:12:26.735069] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.398 [2024-11-18 02:12:26.735092] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.398 [2024-11-18 02:12:26.735107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.398 [2024-11-18 02:12:26.737443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.398 [2024-11-18 02:12:26.746776] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.398 [2024-11-18 02:12:26.747071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.747229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.747255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.398 [2024-11-18 02:12:26.747271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.398 [2024-11-18 02:12:26.747446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.398 [2024-11-18 02:12:26.747682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.398 [2024-11-18 02:12:26.747706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.398 [2024-11-18 02:12:26.747721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.398 [2024-11-18 02:12:26.750153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.398 [2024-11-18 02:12:26.759243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.398 [2024-11-18 02:12:26.759563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.759725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.759754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.398 [2024-11-18 02:12:26.759771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.398 [2024-11-18 02:12:26.759923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.398 [2024-11-18 02:12:26.760109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.398 [2024-11-18 02:12:26.760132] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.398 [2024-11-18 02:12:26.760147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.398 [2024-11-18 02:12:26.762716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.398 [2024-11-18 02:12:26.771786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.398 [2024-11-18 02:12:26.772191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.772389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.772416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.398 [2024-11-18 02:12:26.772432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.398 [2024-11-18 02:12:26.772631] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.398 [2024-11-18 02:12:26.772783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.398 [2024-11-18 02:12:26.772806] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.398 [2024-11-18 02:12:26.772821] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.398 [2024-11-18 02:12:26.775187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.398 [2024-11-18 02:12:26.784423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.398 [2024-11-18 02:12:26.784673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.784840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.398 [2024-11-18 02:12:26.784866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.398 [2024-11-18 02:12:26.784882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.398 [2024-11-18 02:12:26.785029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.398 [2024-11-18 02:12:26.785209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.398 [2024-11-18 02:12:26.785232] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.398 [2024-11-18 02:12:26.785246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.398 [2024-11-18 02:12:26.787619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.658 [2024-11-18 02:12:26.796902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.658 [2024-11-18 02:12:26.797205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.658 [2024-11-18 02:12:26.797338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.658 [2024-11-18 02:12:26.797368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.658 [2024-11-18 02:12:26.797386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.658 [2024-11-18 02:12:26.797586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.658 [2024-11-18 02:12:26.797764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.658 [2024-11-18 02:12:26.797788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.658 [2024-11-18 02:12:26.797803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.658 [2024-11-18 02:12:26.799966] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.659 [2024-11-18 02:12:26.809245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.659 [2024-11-18 02:12:26.809544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.809700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.809745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.659 [2024-11-18 02:12:26.809762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.659 [2024-11-18 02:12:26.809926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.659 [2024-11-18 02:12:26.810073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.659 [2024-11-18 02:12:26.810093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.659 [2024-11-18 02:12:26.810107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.659 [2024-11-18 02:12:26.812420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.659 [2024-11-18 02:12:26.821885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.659 [2024-11-18 02:12:26.822201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.822336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.822366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.659 [2024-11-18 02:12:26.822384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.659 [2024-11-18 02:12:26.822541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.659 [2024-11-18 02:12:26.822748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.659 [2024-11-18 02:12:26.822771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.659 [2024-11-18 02:12:26.822786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.659 [2024-11-18 02:12:26.825151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.659 [2024-11-18 02:12:26.834371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.659 [2024-11-18 02:12:26.834656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.834785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.834814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.659 [2024-11-18 02:12:26.834831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.659 [2024-11-18 02:12:26.834996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.659 [2024-11-18 02:12:26.835200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.659 [2024-11-18 02:12:26.835228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.659 [2024-11-18 02:12:26.835244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.659 [2024-11-18 02:12:26.837582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.659 [2024-11-18 02:12:26.846852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.659 [2024-11-18 02:12:26.847166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.847301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.847342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.659 [2024-11-18 02:12:26.847361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.659 [2024-11-18 02:12:26.847544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.659 [2024-11-18 02:12:26.847694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.659 [2024-11-18 02:12:26.847717] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.659 [2024-11-18 02:12:26.847732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.659 [2024-11-18 02:12:26.849987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.659 [2024-11-18 02:12:26.859346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.659 [2024-11-18 02:12:26.859646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.859765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.859791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.659 [2024-11-18 02:12:26.859806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.659 [2024-11-18 02:12:26.860013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.659 [2024-11-18 02:12:26.860177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.659 [2024-11-18 02:12:26.860200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.659 [2024-11-18 02:12:26.860214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.659 [2024-11-18 02:12:26.862642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.659 [2024-11-18 02:12:26.871992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.659 [2024-11-18 02:12:26.872303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.872465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.872507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.659 [2024-11-18 02:12:26.872524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.659 [2024-11-18 02:12:26.872686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.659 [2024-11-18 02:12:26.872930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.659 [2024-11-18 02:12:26.872953] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.659 [2024-11-18 02:12:26.872974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.659 [2024-11-18 02:12:26.875372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.659 [2024-11-18 02:12:26.884634] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.659 [2024-11-18 02:12:26.884890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.885063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.885089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.659 [2024-11-18 02:12:26.885105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.659 [2024-11-18 02:12:26.885204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.659 [2024-11-18 02:12:26.885399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.659 [2024-11-18 02:12:26.885423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.659 [2024-11-18 02:12:26.885438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.659 [2024-11-18 02:12:26.887780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.659 [2024-11-18 02:12:26.897320] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.659 [2024-11-18 02:12:26.897590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.897741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.897767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.659 [2024-11-18 02:12:26.897784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.659 [2024-11-18 02:12:26.897992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.659 [2024-11-18 02:12:26.898160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.659 [2024-11-18 02:12:26.898182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.659 [2024-11-18 02:12:26.898197] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.659 [2024-11-18 02:12:26.900255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.659 [2024-11-18 02:12:26.909947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.659 [2024-11-18 02:12:26.910256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.910386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.910415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.659 [2024-11-18 02:12:26.910433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.659 [2024-11-18 02:12:26.910598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.659 [2024-11-18 02:12:26.910802] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.659 [2024-11-18 02:12:26.910825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.659 [2024-11-18 02:12:26.910839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.659 [2024-11-18 02:12:26.913172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.659 [2024-11-18 02:12:26.922465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.659 [2024-11-18 02:12:26.922803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.659 [2024-11-18 02:12:26.922935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.922963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.660 [2024-11-18 02:12:26.922981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.660 [2024-11-18 02:12:26.923162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.660 [2024-11-18 02:12:26.923379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.660 [2024-11-18 02:12:26.923403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.660 [2024-11-18 02:12:26.923418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.660 [2024-11-18 02:12:26.925616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.660 [2024-11-18 02:12:26.935098] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.660 [2024-11-18 02:12:26.935404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.935521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.935546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.660 [2024-11-18 02:12:26.935562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.660 [2024-11-18 02:12:26.935720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.660 [2024-11-18 02:12:26.935906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.660 [2024-11-18 02:12:26.935929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.660 [2024-11-18 02:12:26.935944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.660 [2024-11-18 02:12:26.938306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.660 [2024-11-18 02:12:26.947608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.660 [2024-11-18 02:12:26.947892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.948030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.948055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.660 [2024-11-18 02:12:26.948071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.660 [2024-11-18 02:12:26.948249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.660 [2024-11-18 02:12:26.948471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.660 [2024-11-18 02:12:26.948495] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.660 [2024-11-18 02:12:26.948510] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.660 [2024-11-18 02:12:26.950924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.660 [2024-11-18 02:12:26.960259] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.660 [2024-11-18 02:12:26.960572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.960698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.960726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.660 [2024-11-18 02:12:26.960744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.660 [2024-11-18 02:12:26.960890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.660 [2024-11-18 02:12:26.961075] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.660 [2024-11-18 02:12:26.961098] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.660 [2024-11-18 02:12:26.961113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.660 [2024-11-18 02:12:26.963296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.660 [2024-11-18 02:12:26.972872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.660 [2024-11-18 02:12:26.973200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.973334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.973360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.660 [2024-11-18 02:12:26.973376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.660 [2024-11-18 02:12:26.973569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.660 [2024-11-18 02:12:26.973738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.660 [2024-11-18 02:12:26.973760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.660 [2024-11-18 02:12:26.973776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.660 [2024-11-18 02:12:26.976068] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.660 [2024-11-18 02:12:26.985421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.660 [2024-11-18 02:12:26.985735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.985860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.985888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.660 [2024-11-18 02:12:26.985906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.660 [2024-11-18 02:12:26.986033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.660 [2024-11-18 02:12:26.986202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.660 [2024-11-18 02:12:26.986225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.660 [2024-11-18 02:12:26.986240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.660 [2024-11-18 02:12:26.988574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.660 [2024-11-18 02:12:26.998081] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.660 [2024-11-18 02:12:26.998352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.998462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:26.998490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.660 [2024-11-18 02:12:26.998508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.660 [2024-11-18 02:12:26.998672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.660 [2024-11-18 02:12:26.998876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.660 [2024-11-18 02:12:26.998900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.660 [2024-11-18 02:12:26.998915] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.660 [2024-11-18 02:12:27.001276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.660 [2024-11-18 02:12:27.010605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.660 [2024-11-18 02:12:27.010909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:27.011068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:27.011094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.660 [2024-11-18 02:12:27.011110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.660 [2024-11-18 02:12:27.011303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.660 [2024-11-18 02:12:27.011429] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.660 [2024-11-18 02:12:27.011452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.660 [2024-11-18 02:12:27.011467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.660 [2024-11-18 02:12:27.013646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.660 [2024-11-18 02:12:27.023045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.660 [2024-11-18 02:12:27.023410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:27.023552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:27.023598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.660 [2024-11-18 02:12:27.023616] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.660 [2024-11-18 02:12:27.023762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.660 [2024-11-18 02:12:27.023948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.660 [2024-11-18 02:12:27.023971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.660 [2024-11-18 02:12:27.023986] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.660 [2024-11-18 02:12:27.026259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.660 [2024-11-18 02:12:27.035836] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.660 [2024-11-18 02:12:27.036107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:27.036224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.660 [2024-11-18 02:12:27.036258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.660 [2024-11-18 02:12:27.036276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.660 [2024-11-18 02:12:27.036453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.661 [2024-11-18 02:12:27.036640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.661 [2024-11-18 02:12:27.036663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.661 [2024-11-18 02:12:27.036678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.661 [2024-11-18 02:12:27.038984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.661 [2024-11-18 02:12:27.048402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.661 [2024-11-18 02:12:27.048773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.661 [2024-11-18 02:12:27.048926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.661 [2024-11-18 02:12:27.048955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.661 [2024-11-18 02:12:27.048973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.661 [2024-11-18 02:12:27.049119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.661 [2024-11-18 02:12:27.049335] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.661 [2024-11-18 02:12:27.049359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.661 [2024-11-18 02:12:27.049374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.661 [2024-11-18 02:12:27.051661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.921 [2024-11-18 02:12:27.060901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.921 [2024-11-18 02:12:27.061247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.921 [2024-11-18 02:12:27.061379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.921 [2024-11-18 02:12:27.061409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.921 [2024-11-18 02:12:27.061427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.921 [2024-11-18 02:12:27.061574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.921 [2024-11-18 02:12:27.061688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.921 [2024-11-18 02:12:27.061710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.921 [2024-11-18 02:12:27.061725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.921 [2024-11-18 02:12:27.064154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.921 [2024-11-18 02:12:27.073432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.921 [2024-11-18 02:12:27.073726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.921 [2024-11-18 02:12:27.073853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.921 [2024-11-18 02:12:27.073882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.921 [2024-11-18 02:12:27.073905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.921 [2024-11-18 02:12:27.074070] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.921 [2024-11-18 02:12:27.074257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.921 [2024-11-18 02:12:27.074280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.921 [2024-11-18 02:12:27.074295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.921 [2024-11-18 02:12:27.076614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.921 [2024-11-18 02:12:27.085884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.921 [2024-11-18 02:12:27.086260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.921 [2024-11-18 02:12:27.086393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.921 [2024-11-18 02:12:27.086423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.921 [2024-11-18 02:12:27.086441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.921 [2024-11-18 02:12:27.086587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.921 [2024-11-18 02:12:27.086756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.922 [2024-11-18 02:12:27.086778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.922 [2024-11-18 02:12:27.086793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.922 [2024-11-18 02:12:27.089101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.922 [2024-11-18 02:12:27.098348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.922 [2024-11-18 02:12:27.098655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.098772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.098801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.922 [2024-11-18 02:12:27.098819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.922 [2024-11-18 02:12:27.099019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.922 [2024-11-18 02:12:27.099170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.922 [2024-11-18 02:12:27.099193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.922 [2024-11-18 02:12:27.099207] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.922 [2024-11-18 02:12:27.101469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.922 [2024-11-18 02:12:27.110958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.922 [2024-11-18 02:12:27.111315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.111443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.111472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.922 [2024-11-18 02:12:27.111489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.922 [2024-11-18 02:12:27.111641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.922 [2024-11-18 02:12:27.111792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.922 [2024-11-18 02:12:27.111815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.922 [2024-11-18 02:12:27.111830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.922 [2024-11-18 02:12:27.113921] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.922 [2024-11-18 02:12:27.123541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.922 [2024-11-18 02:12:27.123850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.123988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.124014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.922 [2024-11-18 02:12:27.124030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.922 [2024-11-18 02:12:27.124225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.922 [2024-11-18 02:12:27.124409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.922 [2024-11-18 02:12:27.124430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.922 [2024-11-18 02:12:27.124443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.922 [2024-11-18 02:12:27.126698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.922 [2024-11-18 02:12:27.136044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.922 [2024-11-18 02:12:27.136329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.136441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.136470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.922 [2024-11-18 02:12:27.136488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.922 [2024-11-18 02:12:27.136706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.922 [2024-11-18 02:12:27.136892] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.922 [2024-11-18 02:12:27.136915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.922 [2024-11-18 02:12:27.136929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.922 [2024-11-18 02:12:27.139517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.922 [2024-11-18 02:12:27.148502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.922 [2024-11-18 02:12:27.148795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.148935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.148961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.922 [2024-11-18 02:12:27.148976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.922 [2024-11-18 02:12:27.149156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.922 [2024-11-18 02:12:27.149340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.922 [2024-11-18 02:12:27.149365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.922 [2024-11-18 02:12:27.149380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.922 [2024-11-18 02:12:27.151597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.922 [2024-11-18 02:12:27.160998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.922 [2024-11-18 02:12:27.161349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.161456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.161485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.922 [2024-11-18 02:12:27.161502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.922 [2024-11-18 02:12:27.161685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.922 [2024-11-18 02:12:27.161835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.922 [2024-11-18 02:12:27.161857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.922 [2024-11-18 02:12:27.161872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.922 [2024-11-18 02:12:27.164008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.922 [2024-11-18 02:12:27.173451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.922 [2024-11-18 02:12:27.173807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.173917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.173948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.922 [2024-11-18 02:12:27.173966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.922 [2024-11-18 02:12:27.174148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.922 [2024-11-18 02:12:27.174350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.922 [2024-11-18 02:12:27.174376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.922 [2024-11-18 02:12:27.174391] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.922 [2024-11-18 02:12:27.176808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.922 [2024-11-18 02:12:27.185831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.922 [2024-11-18 02:12:27.186135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.186255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.186281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.922 [2024-11-18 02:12:27.186297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.922 [2024-11-18 02:12:27.186470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.922 [2024-11-18 02:12:27.186628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.922 [2024-11-18 02:12:27.186654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.922 [2024-11-18 02:12:27.186669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.922 [2024-11-18 02:12:27.188855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.922 [2024-11-18 02:12:27.198079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.922 [2024-11-18 02:12:27.198399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.198491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.922 [2024-11-18 02:12:27.198517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.922 [2024-11-18 02:12:27.198533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.922 [2024-11-18 02:12:27.198713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.922 [2024-11-18 02:12:27.198889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.922 [2024-11-18 02:12:27.198908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.922 [2024-11-18 02:12:27.198921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.923 [2024-11-18 02:12:27.200875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.923 [2024-11-18 02:12:27.210528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.923 [2024-11-18 02:12:27.210796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.210947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.210977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.923 [2024-11-18 02:12:27.210995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.923 [2024-11-18 02:12:27.211195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.923 [2024-11-18 02:12:27.211338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.923 [2024-11-18 02:12:27.211377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.923 [2024-11-18 02:12:27.211390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.923 [2024-11-18 02:12:27.213705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.923 [2024-11-18 02:12:27.223164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.923 [2024-11-18 02:12:27.223469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.223615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.223644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.923 [2024-11-18 02:12:27.223660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.923 [2024-11-18 02:12:27.223851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.923 [2024-11-18 02:12:27.224057] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.923 [2024-11-18 02:12:27.224079] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.923 [2024-11-18 02:12:27.224100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.923 [2024-11-18 02:12:27.226542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.923 [2024-11-18 02:12:27.235713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.923 [2024-11-18 02:12:27.236061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.236199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.236228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.923 [2024-11-18 02:12:27.236246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.923 [2024-11-18 02:12:27.236421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.923 [2024-11-18 02:12:27.236590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.923 [2024-11-18 02:12:27.236611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.923 [2024-11-18 02:12:27.236641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.923 [2024-11-18 02:12:27.238985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.923 [2024-11-18 02:12:27.248111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.923 [2024-11-18 02:12:27.248431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.248568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.248593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.923 [2024-11-18 02:12:27.248610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.923 [2024-11-18 02:12:27.248799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.923 [2024-11-18 02:12:27.248968] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.923 [2024-11-18 02:12:27.248990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.923 [2024-11-18 02:12:27.249005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.923 [2024-11-18 02:12:27.251463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.923 [2024-11-18 02:12:27.260497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.923 [2024-11-18 02:12:27.260782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.260906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.260933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.923 [2024-11-18 02:12:27.260949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.923 [2024-11-18 02:12:27.261135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.923 [2024-11-18 02:12:27.261353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.923 [2024-11-18 02:12:27.261376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.923 [2024-11-18 02:12:27.261390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.923 [2024-11-18 02:12:27.263600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.923 [2024-11-18 02:12:27.272758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.923 [2024-11-18 02:12:27.273052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.273179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.273205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.923 [2024-11-18 02:12:27.273220] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.923 [2024-11-18 02:12:27.273395] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.923 [2024-11-18 02:12:27.273544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.923 [2024-11-18 02:12:27.273565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.923 [2024-11-18 02:12:27.273578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.923 [2024-11-18 02:12:27.275693] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.923 [2024-11-18 02:12:27.285258] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.923 [2024-11-18 02:12:27.285572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.285711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.285737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.923 [2024-11-18 02:12:27.285753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.923 [2024-11-18 02:12:27.285885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.923 [2024-11-18 02:12:27.286050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.923 [2024-11-18 02:12:27.286073] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.923 [2024-11-18 02:12:27.286088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.923 [2024-11-18 02:12:27.288429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.923 [2024-11-18 02:12:27.297955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.923 [2024-11-18 02:12:27.298320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.298444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.298470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.923 [2024-11-18 02:12:27.298486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.923 [2024-11-18 02:12:27.298617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.923 [2024-11-18 02:12:27.298798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.923 [2024-11-18 02:12:27.298821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.923 [2024-11-18 02:12:27.298836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.923 [2024-11-18 02:12:27.301220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:52.923 [2024-11-18 02:12:27.310714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:52.923 [2024-11-18 02:12:27.311098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.311292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:52.923 [2024-11-18 02:12:27.311328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:52.923 [2024-11-18 02:12:27.311348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:52.923 [2024-11-18 02:12:27.311512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:52.923 [2024-11-18 02:12:27.311716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:52.923 [2024-11-18 02:12:27.311739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:52.923 [2024-11-18 02:12:27.311754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:52.923 [2024-11-18 02:12:27.314113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.185 [2024-11-18 02:12:27.323340] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.185 [2024-11-18 02:12:27.323714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.185 [2024-11-18 02:12:27.323876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.185 [2024-11-18 02:12:27.323905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.185 [2024-11-18 02:12:27.323922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.185 [2024-11-18 02:12:27.324104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.185 [2024-11-18 02:12:27.324273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.185 [2024-11-18 02:12:27.324296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.185 [2024-11-18 02:12:27.324320] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.185 [2024-11-18 02:12:27.326630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.185 [2024-11-18 02:12:27.336004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.185 [2024-11-18 02:12:27.336269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.185 [2024-11-18 02:12:27.336391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.185 [2024-11-18 02:12:27.336421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.185 [2024-11-18 02:12:27.336438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.185 [2024-11-18 02:12:27.336621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.185 [2024-11-18 02:12:27.336753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.185 [2024-11-18 02:12:27.336775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.185 [2024-11-18 02:12:27.336790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.185 [2024-11-18 02:12:27.339153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.185 [2024-11-18 02:12:27.348629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.185 [2024-11-18 02:12:27.349034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.185 [2024-11-18 02:12:27.349179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.185 [2024-11-18 02:12:27.349205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.185 [2024-11-18 02:12:27.349220] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.185 [2024-11-18 02:12:27.349345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.186 [2024-11-18 02:12:27.349520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.186 [2024-11-18 02:12:27.349543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.186 [2024-11-18 02:12:27.349558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.186 [2024-11-18 02:12:27.351680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.186 [2024-11-18 02:12:27.361233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.186 [2024-11-18 02:12:27.361585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.361715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.361744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.186 [2024-11-18 02:12:27.361762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.186 [2024-11-18 02:12:27.361890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.186 [2024-11-18 02:12:27.362076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.186 [2024-11-18 02:12:27.362099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.186 [2024-11-18 02:12:27.362113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.186 [2024-11-18 02:12:27.364591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.186 [2024-11-18 02:12:27.373503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.186 [2024-11-18 02:12:27.373775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.373913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.373939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.186 [2024-11-18 02:12:27.373954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.186 [2024-11-18 02:12:27.374162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.186 [2024-11-18 02:12:27.374360] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.186 [2024-11-18 02:12:27.374384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.186 [2024-11-18 02:12:27.374398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.186 [2024-11-18 02:12:27.376702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.186 [2024-11-18 02:12:27.386010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.186 [2024-11-18 02:12:27.386317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.386426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.386460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.186 [2024-11-18 02:12:27.386477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.186 [2024-11-18 02:12:27.386655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.186 [2024-11-18 02:12:27.386833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.186 [2024-11-18 02:12:27.386857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.186 [2024-11-18 02:12:27.386872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.186 [2024-11-18 02:12:27.389307] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.186 [2024-11-18 02:12:27.398489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.186 [2024-11-18 02:12:27.398793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.398955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.398983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.186 [2024-11-18 02:12:27.399001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.186 [2024-11-18 02:12:27.399165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.186 [2024-11-18 02:12:27.399297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.186 [2024-11-18 02:12:27.399330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.186 [2024-11-18 02:12:27.399346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.186 [2024-11-18 02:12:27.401599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.186 [2024-11-18 02:12:27.411114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.186 [2024-11-18 02:12:27.411421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.411543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.411569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.186 [2024-11-18 02:12:27.411585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.186 [2024-11-18 02:12:27.411733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.186 [2024-11-18 02:12:27.411943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.186 [2024-11-18 02:12:27.411966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.186 [2024-11-18 02:12:27.411981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.186 [2024-11-18 02:12:27.414383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.186 [2024-11-18 02:12:27.423538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.186 [2024-11-18 02:12:27.423825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.423948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.423976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.186 [2024-11-18 02:12:27.423999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.186 [2024-11-18 02:12:27.424165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.186 [2024-11-18 02:12:27.424297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.186 [2024-11-18 02:12:27.424330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.186 [2024-11-18 02:12:27.424346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.186 [2024-11-18 02:12:27.426398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.186 [2024-11-18 02:12:27.435995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.186 [2024-11-18 02:12:27.436301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.436425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.436467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.186 [2024-11-18 02:12:27.436483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.186 [2024-11-18 02:12:27.436598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.186 [2024-11-18 02:12:27.436747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.186 [2024-11-18 02:12:27.436770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.186 [2024-11-18 02:12:27.436784] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.186 [2024-11-18 02:12:27.438947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.186 [2024-11-18 02:12:27.448645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.186 [2024-11-18 02:12:27.448949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.449093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.449118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.186 [2024-11-18 02:12:27.449134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.186 [2024-11-18 02:12:27.449338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.186 [2024-11-18 02:12:27.449486] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.186 [2024-11-18 02:12:27.449508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.186 [2024-11-18 02:12:27.449523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.186 [2024-11-18 02:12:27.452023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.186 [2024-11-18 02:12:27.461252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.186 [2024-11-18 02:12:27.461505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.461657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.186 [2024-11-18 02:12:27.461685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.186 [2024-11-18 02:12:27.461703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.186 [2024-11-18 02:12:27.461891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.186 [2024-11-18 02:12:27.462077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.186 [2024-11-18 02:12:27.462100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.186 [2024-11-18 02:12:27.462114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.187 [2024-11-18 02:12:27.464447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.187 [2024-11-18 02:12:27.473710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.187 [2024-11-18 02:12:27.473946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.474111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.474136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.187 [2024-11-18 02:12:27.474152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.187 [2024-11-18 02:12:27.474299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.187 [2024-11-18 02:12:27.474512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.187 [2024-11-18 02:12:27.474535] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.187 [2024-11-18 02:12:27.474550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.187 [2024-11-18 02:12:27.476909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.187 [2024-11-18 02:12:27.486298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.187 [2024-11-18 02:12:27.486644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.486864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.486893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.187 [2024-11-18 02:12:27.486911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.187 [2024-11-18 02:12:27.487057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.187 [2024-11-18 02:12:27.487242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.187 [2024-11-18 02:12:27.487265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.187 [2024-11-18 02:12:27.487280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.187 [2024-11-18 02:12:27.489614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.187 [2024-11-18 02:12:27.498983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.187 [2024-11-18 02:12:27.499288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.499437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.499464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.187 [2024-11-18 02:12:27.499480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.187 [2024-11-18 02:12:27.499673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.187 [2024-11-18 02:12:27.499911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.187 [2024-11-18 02:12:27.499935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.187 [2024-11-18 02:12:27.499950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.187 [2024-11-18 02:12:27.502241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.187 [2024-11-18 02:12:27.511473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.187 [2024-11-18 02:12:27.511758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.511949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.511974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.187 [2024-11-18 02:12:27.511990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.187 [2024-11-18 02:12:27.512203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.187 [2024-11-18 02:12:27.512383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.187 [2024-11-18 02:12:27.512407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.187 [2024-11-18 02:12:27.512422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.187 [2024-11-18 02:12:27.514580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.187 [2024-11-18 02:12:27.524196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.187 [2024-11-18 02:12:27.524500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.524638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.524685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.187 [2024-11-18 02:12:27.524703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.187 [2024-11-18 02:12:27.524848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.187 [2024-11-18 02:12:27.524962] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.187 [2024-11-18 02:12:27.524984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.187 [2024-11-18 02:12:27.525000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.187 [2024-11-18 02:12:27.527494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.187 [2024-11-18 02:12:27.536869] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.187 [2024-11-18 02:12:27.537206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.537333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.537360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.187 [2024-11-18 02:12:27.537376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.187 [2024-11-18 02:12:27.537508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.187 [2024-11-18 02:12:27.537702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.187 [2024-11-18 02:12:27.537730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.187 [2024-11-18 02:12:27.537746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.187 [2024-11-18 02:12:27.539890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.187 [2024-11-18 02:12:27.549416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.187 [2024-11-18 02:12:27.549712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.549855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.549881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.187 [2024-11-18 02:12:27.549896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.187 [2024-11-18 02:12:27.550033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.187 [2024-11-18 02:12:27.550201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.187 [2024-11-18 02:12:27.550224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.187 [2024-11-18 02:12:27.550239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.187 [2024-11-18 02:12:27.552551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.187 [2024-11-18 02:12:27.561892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.187 [2024-11-18 02:12:27.562220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.562388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.562415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.187 [2024-11-18 02:12:27.562431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.187 [2024-11-18 02:12:27.562610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.187 [2024-11-18 02:12:27.562797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.187 [2024-11-18 02:12:27.562819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.187 [2024-11-18 02:12:27.562835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.187 [2024-11-18 02:12:27.565184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.187 [2024-11-18 02:12:27.574473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.187 [2024-11-18 02:12:27.574851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.574980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.187 [2024-11-18 02:12:27.575007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.187 [2024-11-18 02:12:27.575024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.187 [2024-11-18 02:12:27.575188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.187 [2024-11-18 02:12:27.575333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.187 [2024-11-18 02:12:27.575357] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.187 [2024-11-18 02:12:27.575379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.187 [2024-11-18 02:12:27.577630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.449 [2024-11-18 02:12:27.587127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.449 [2024-11-18 02:12:27.587492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.449 [2024-11-18 02:12:27.587605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.449 [2024-11-18 02:12:27.587631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.449 [2024-11-18 02:12:27.587646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.449 [2024-11-18 02:12:27.587836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.449 [2024-11-18 02:12:27.588023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.450 [2024-11-18 02:12:27.588046] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.450 [2024-11-18 02:12:27.588061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.450 [2024-11-18 02:12:27.590387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.450 [2024-11-18 02:12:27.599919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.450 [2024-11-18 02:12:27.600244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.600398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.600428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.450 [2024-11-18 02:12:27.600446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.450 [2024-11-18 02:12:27.600610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.450 [2024-11-18 02:12:27.600778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.450 [2024-11-18 02:12:27.600802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.450 [2024-11-18 02:12:27.600817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.450 [2024-11-18 02:12:27.602997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.450 [2024-11-18 02:12:27.612406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.450 [2024-11-18 02:12:27.612720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.612847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.612875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.450 [2024-11-18 02:12:27.612894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.450 [2024-11-18 02:12:27.613039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.450 [2024-11-18 02:12:27.613243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.450 [2024-11-18 02:12:27.613266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.450 [2024-11-18 02:12:27.613281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.450 [2024-11-18 02:12:27.615641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.450 [2024-11-18 02:12:27.624931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.450 [2024-11-18 02:12:27.625220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.625396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.625423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.450 [2024-11-18 02:12:27.625438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.450 [2024-11-18 02:12:27.625602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.450 [2024-11-18 02:12:27.625777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.450 [2024-11-18 02:12:27.625799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.450 [2024-11-18 02:12:27.625814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.450 [2024-11-18 02:12:27.628030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.450 [2024-11-18 02:12:27.637399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.450 [2024-11-18 02:12:27.637784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.637912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.637941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.450 [2024-11-18 02:12:27.637959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.450 [2024-11-18 02:12:27.638050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.450 [2024-11-18 02:12:27.638217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.450 [2024-11-18 02:12:27.638240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.450 [2024-11-18 02:12:27.638255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.450 [2024-11-18 02:12:27.640769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.450 [2024-11-18 02:12:27.650060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.450 [2024-11-18 02:12:27.650331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.650465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.650494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.450 [2024-11-18 02:12:27.650511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.450 [2024-11-18 02:12:27.650657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.450 [2024-11-18 02:12:27.650862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.450 [2024-11-18 02:12:27.650884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.450 [2024-11-18 02:12:27.650899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.450 [2024-11-18 02:12:27.653259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.450 [2024-11-18 02:12:27.662690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.450 [2024-11-18 02:12:27.662997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.663153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.663182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.450 [2024-11-18 02:12:27.663199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.450 [2024-11-18 02:12:27.663410] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.450 [2024-11-18 02:12:27.663616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.450 [2024-11-18 02:12:27.663638] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.450 [2024-11-18 02:12:27.663653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.450 [2024-11-18 02:12:27.665776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.450 [2024-11-18 02:12:27.675221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.450 [2024-11-18 02:12:27.675522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.675649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.675679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.450 [2024-11-18 02:12:27.675697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.450 [2024-11-18 02:12:27.675825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.450 [2024-11-18 02:12:27.675975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.450 [2024-11-18 02:12:27.675997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.450 [2024-11-18 02:12:27.676012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.450 [2024-11-18 02:12:27.678382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.450 [2024-11-18 02:12:27.687809] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.450 [2024-11-18 02:12:27.688125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.688275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.688301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.450 [2024-11-18 02:12:27.688327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.450 [2024-11-18 02:12:27.688492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.450 [2024-11-18 02:12:27.688637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.450 [2024-11-18 02:12:27.688660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.450 [2024-11-18 02:12:27.688674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.450 [2024-11-18 02:12:27.691054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.450 [2024-11-18 02:12:27.700372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.450 [2024-11-18 02:12:27.700701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.700836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.450 [2024-11-18 02:12:27.700864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.450 [2024-11-18 02:12:27.700882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.450 [2024-11-18 02:12:27.701082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.450 [2024-11-18 02:12:27.701268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.450 [2024-11-18 02:12:27.701290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.450 [2024-11-18 02:12:27.701305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.451 [2024-11-18 02:12:27.703625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.451 [2024-11-18 02:12:27.713012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.451 [2024-11-18 02:12:27.713258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.713399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.713429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.451 [2024-11-18 02:12:27.713446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.451 [2024-11-18 02:12:27.713629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.451 [2024-11-18 02:12:27.713796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.451 [2024-11-18 02:12:27.713819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.451 [2024-11-18 02:12:27.713834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.451 [2024-11-18 02:12:27.716234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.451 [2024-11-18 02:12:27.725512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.451 [2024-11-18 02:12:27.725928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.726092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.726121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.451 [2024-11-18 02:12:27.726139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.451 [2024-11-18 02:12:27.726331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.451 [2024-11-18 02:12:27.726500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.451 [2024-11-18 02:12:27.726523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.451 [2024-11-18 02:12:27.726538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.451 [2024-11-18 02:12:27.728717] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.451 [2024-11-18 02:12:27.737985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.451 [2024-11-18 02:12:27.738370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.738564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.738601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.451 [2024-11-18 02:12:27.738620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.451 [2024-11-18 02:12:27.738803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.451 [2024-11-18 02:12:27.738989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.451 [2024-11-18 02:12:27.739011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.451 [2024-11-18 02:12:27.739026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.451 [2024-11-18 02:12:27.741342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.451 [2024-11-18 02:12:27.750452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.451 [2024-11-18 02:12:27.750757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.750900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.750926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.451 [2024-11-18 02:12:27.750942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.451 [2024-11-18 02:12:27.751055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.451 [2024-11-18 02:12:27.751257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.451 [2024-11-18 02:12:27.751280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.451 [2024-11-18 02:12:27.751294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.451 [2024-11-18 02:12:27.753611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.451 [2024-11-18 02:12:27.763014] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.451 [2024-11-18 02:12:27.763366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.763491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.763517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.451 [2024-11-18 02:12:27.763533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.451 [2024-11-18 02:12:27.763681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.451 [2024-11-18 02:12:27.763865] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.451 [2024-11-18 02:12:27.763887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.451 [2024-11-18 02:12:27.763902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.451 [2024-11-18 02:12:27.766031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.451 [2024-11-18 02:12:27.775655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.451 [2024-11-18 02:12:27.775976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.776144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.776170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.451 [2024-11-18 02:12:27.776191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.451 [2024-11-18 02:12:27.776347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.451 [2024-11-18 02:12:27.776478] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.451 [2024-11-18 02:12:27.776498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.451 [2024-11-18 02:12:27.776511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.451 [2024-11-18 02:12:27.778932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.451 [2024-11-18 02:12:27.788145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.451 [2024-11-18 02:12:27.788520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.788619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.788647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.451 [2024-11-18 02:12:27.788665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.451 [2024-11-18 02:12:27.788829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.451 [2024-11-18 02:12:27.789051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.451 [2024-11-18 02:12:27.789074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.451 [2024-11-18 02:12:27.789089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.451 [2024-11-18 02:12:27.791567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.451 [2024-11-18 02:12:27.800798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.451 [2024-11-18 02:12:27.801106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.801244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.801269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.451 [2024-11-18 02:12:27.801285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.451 [2024-11-18 02:12:27.801452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.451 [2024-11-18 02:12:27.801621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.451 [2024-11-18 02:12:27.801644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.451 [2024-11-18 02:12:27.801659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.451 [2024-11-18 02:12:27.803928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.451 [2024-11-18 02:12:27.813545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.451 [2024-11-18 02:12:27.813886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.814029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.451 [2024-11-18 02:12:27.814055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.451 [2024-11-18 02:12:27.814070] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.451 [2024-11-18 02:12:27.814224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.451 [2024-11-18 02:12:27.814428] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.451 [2024-11-18 02:12:27.814452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.451 [2024-11-18 02:12:27.814467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.451 [2024-11-18 02:12:27.816953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.451 [2024-11-18 02:12:27.826165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.451 [2024-11-18 02:12:27.826439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.452 [2024-11-18 02:12:27.826563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.452 [2024-11-18 02:12:27.826589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.452 [2024-11-18 02:12:27.826605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.452 [2024-11-18 02:12:27.826795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.452 [2024-11-18 02:12:27.826982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.452 [2024-11-18 02:12:27.827005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.452 [2024-11-18 02:12:27.827020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.452 [2024-11-18 02:12:27.829292] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.452 [2024-11-18 02:12:27.838794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.452 [2024-11-18 02:12:27.839087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.452 [2024-11-18 02:12:27.839219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.452 [2024-11-18 02:12:27.839247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.452 [2024-11-18 02:12:27.839265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.452 [2024-11-18 02:12:27.839440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.452 [2024-11-18 02:12:27.839609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.452 [2024-11-18 02:12:27.839633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.452 [2024-11-18 02:12:27.839648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.452 [2024-11-18 02:12:27.841917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.714 [2024-11-18 02:12:27.851565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.714 [2024-11-18 02:12:27.851836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.714 [2024-11-18 02:12:27.851971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.714 [2024-11-18 02:12:27.851997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.714 [2024-11-18 02:12:27.852012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.714 [2024-11-18 02:12:27.852193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.714 [2024-11-18 02:12:27.852430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.714 [2024-11-18 02:12:27.852454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.714 [2024-11-18 02:12:27.852469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.714 [2024-11-18 02:12:27.854702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.714 [2024-11-18 02:12:27.864198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.714 [2024-11-18 02:12:27.864473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.714 [2024-11-18 02:12:27.864603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.714 [2024-11-18 02:12:27.864644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.714 [2024-11-18 02:12:27.864660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.714 [2024-11-18 02:12:27.864835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.714 [2024-11-18 02:12:27.865029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.714 [2024-11-18 02:12:27.865052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.714 [2024-11-18 02:12:27.865067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.715 [2024-11-18 02:12:27.867344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.715 [2024-11-18 02:12:27.876768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.715 [2024-11-18 02:12:27.877076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.877184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.877210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.715 [2024-11-18 02:12:27.877226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.715 [2024-11-18 02:12:27.877464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.715 [2024-11-18 02:12:27.877633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.715 [2024-11-18 02:12:27.877656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.715 [2024-11-18 02:12:27.877671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.715 [2024-11-18 02:12:27.879815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.715 [2024-11-18 02:12:27.889233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.715 [2024-11-18 02:12:27.889603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.889747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.889774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.715 [2024-11-18 02:12:27.889790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.715 [2024-11-18 02:12:27.889905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.715 [2024-11-18 02:12:27.890112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.715 [2024-11-18 02:12:27.890141] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.715 [2024-11-18 02:12:27.890156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.715 [2024-11-18 02:12:27.892565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.715 [2024-11-18 02:12:27.901912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.715 [2024-11-18 02:12:27.902161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.902325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.902355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.715 [2024-11-18 02:12:27.902372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.715 [2024-11-18 02:12:27.902518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.715 [2024-11-18 02:12:27.902688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.715 [2024-11-18 02:12:27.902710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.715 [2024-11-18 02:12:27.902725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.715 [2024-11-18 02:12:27.904959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.715 [2024-11-18 02:12:27.914700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.715 [2024-11-18 02:12:27.914975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.915105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.915148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.715 [2024-11-18 02:12:27.915164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.715 [2024-11-18 02:12:27.915293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.715 [2024-11-18 02:12:27.915477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.715 [2024-11-18 02:12:27.915501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.715 [2024-11-18 02:12:27.915516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.715 [2024-11-18 02:12:27.917787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.715 [2024-11-18 02:12:27.927366] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.715 [2024-11-18 02:12:27.927725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.927860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.927889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.715 [2024-11-18 02:12:27.927906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.715 [2024-11-18 02:12:27.928034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.715 [2024-11-18 02:12:27.928166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.715 [2024-11-18 02:12:27.928188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.715 [2024-11-18 02:12:27.928208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.715 [2024-11-18 02:12:27.930577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.715 [2024-11-18 02:12:27.939880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.715 [2024-11-18 02:12:27.940208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.940349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.940376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.715 [2024-11-18 02:12:27.940392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.715 [2024-11-18 02:12:27.940583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.715 [2024-11-18 02:12:27.940751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.715 [2024-11-18 02:12:27.940774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.715 [2024-11-18 02:12:27.940788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.715 [2024-11-18 02:12:27.943129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.715 [2024-11-18 02:12:27.952537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.715 [2024-11-18 02:12:27.952892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.953011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.953037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.715 [2024-11-18 02:12:27.953053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.715 [2024-11-18 02:12:27.953251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.715 [2024-11-18 02:12:27.953431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.715 [2024-11-18 02:12:27.953455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.715 [2024-11-18 02:12:27.953470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.715 [2024-11-18 02:12:27.955705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.715 [2024-11-18 02:12:27.965212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.715 [2024-11-18 02:12:27.965524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.965655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.715 [2024-11-18 02:12:27.965697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.715 [2024-11-18 02:12:27.965713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.715 [2024-11-18 02:12:27.965828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.715 [2024-11-18 02:12:27.966039] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.715 [2024-11-18 02:12:27.966062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.715 [2024-11-18 02:12:27.966076] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.715 [2024-11-18 02:12:27.968178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.715 [2024-11-18 02:12:27.977843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.716 [2024-11-18 02:12:27.978173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:27.978325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:27.978351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.716 [2024-11-18 02:12:27.978367] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.716 [2024-11-18 02:12:27.978514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.716 [2024-11-18 02:12:27.978656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.716 [2024-11-18 02:12:27.978679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.716 [2024-11-18 02:12:27.978694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.716 [2024-11-18 02:12:27.980995] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.716 [2024-11-18 02:12:27.990450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.716 [2024-11-18 02:12:27.990778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:27.990933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:27.990962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.716 [2024-11-18 02:12:27.990980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.716 [2024-11-18 02:12:27.991163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.716 [2024-11-18 02:12:27.991343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.716 [2024-11-18 02:12:27.991367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.716 [2024-11-18 02:12:27.991382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.716 [2024-11-18 02:12:27.993669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.716 [2024-11-18 02:12:28.003078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.716 [2024-11-18 02:12:28.003377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:28.003503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:28.003529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.716 [2024-11-18 02:12:28.003545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.716 [2024-11-18 02:12:28.003708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.716 [2024-11-18 02:12:28.003875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.716 [2024-11-18 02:12:28.003897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.716 [2024-11-18 02:12:28.003913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.716 [2024-11-18 02:12:28.006317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.716 [2024-11-18 02:12:28.015649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.716 [2024-11-18 02:12:28.015930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:28.016057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:28.016086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.716 [2024-11-18 02:12:28.016104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.716 [2024-11-18 02:12:28.016285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.716 [2024-11-18 02:12:28.016482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.716 [2024-11-18 02:12:28.016506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.716 [2024-11-18 02:12:28.016521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.716 [2024-11-18 02:12:28.018702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.716 [2024-11-18 02:12:28.028167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.716 [2024-11-18 02:12:28.028461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:28.028602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:28.028628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.716 [2024-11-18 02:12:28.028644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.716 [2024-11-18 02:12:28.028776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.716 [2024-11-18 02:12:28.029001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.716 [2024-11-18 02:12:28.029024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.716 [2024-11-18 02:12:28.029039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.716 [2024-11-18 02:12:28.031410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.716 [2024-11-18 02:12:28.040539] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.716 [2024-11-18 02:12:28.040833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:28.040967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:28.040996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.716 [2024-11-18 02:12:28.041014] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.716 [2024-11-18 02:12:28.041142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.716 [2024-11-18 02:12:28.041321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.716 [2024-11-18 02:12:28.041345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.716 [2024-11-18 02:12:28.041359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.716 [2024-11-18 02:12:28.043917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.716 [2024-11-18 02:12:28.053057] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.716 [2024-11-18 02:12:28.053359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:28.053470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:28.053499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.716 [2024-11-18 02:12:28.053517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.716 [2024-11-18 02:12:28.053664] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.716 [2024-11-18 02:12:28.053868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.716 [2024-11-18 02:12:28.053891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.716 [2024-11-18 02:12:28.053906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.716 [2024-11-18 02:12:28.056158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.716 [2024-11-18 02:12:28.065561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.716 [2024-11-18 02:12:28.065848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:28.065942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.716 [2024-11-18 02:12:28.065985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.716 [2024-11-18 02:12:28.066001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.716 [2024-11-18 02:12:28.066148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.716 [2024-11-18 02:12:28.066328] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.717 [2024-11-18 02:12:28.066353] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.717 [2024-11-18 02:12:28.066367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.717 [2024-11-18 02:12:28.068884] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.717 [2024-11-18 02:12:28.078088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.717 [2024-11-18 02:12:28.078442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.717 [2024-11-18 02:12:28.078558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.717 [2024-11-18 02:12:28.078584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.717 [2024-11-18 02:12:28.078599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.717 [2024-11-18 02:12:28.078772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.717 [2024-11-18 02:12:28.078959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.717 [2024-11-18 02:12:28.078982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.717 [2024-11-18 02:12:28.078997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.717 [2024-11-18 02:12:28.081306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.717 [2024-11-18 02:12:28.090636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.717 [2024-11-18 02:12:28.090922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.717 [2024-11-18 02:12:28.091077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.717 [2024-11-18 02:12:28.091111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.717 [2024-11-18 02:12:28.091130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.717 [2024-11-18 02:12:28.091258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.717 [2024-11-18 02:12:28.091419] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.717 [2024-11-18 02:12:28.091443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.717 [2024-11-18 02:12:28.091458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.717 [2024-11-18 02:12:28.093727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.717 [2024-11-18 02:12:28.103194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.717 [2024-11-18 02:12:28.103502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.717 [2024-11-18 02:12:28.103619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.717 [2024-11-18 02:12:28.103646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.717 [2024-11-18 02:12:28.103662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.717 [2024-11-18 02:12:28.103854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.717 [2024-11-18 02:12:28.104005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.717 [2024-11-18 02:12:28.104028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.717 [2024-11-18 02:12:28.104042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.717 [2024-11-18 02:12:28.106418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.978 [2024-11-18 02:12:28.115790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.978 [2024-11-18 02:12:28.116081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.978 [2024-11-18 02:12:28.116209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.978 [2024-11-18 02:12:28.116237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.978 [2024-11-18 02:12:28.116255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.978 [2024-11-18 02:12:28.116415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.978 [2024-11-18 02:12:28.116566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.978 [2024-11-18 02:12:28.116589] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.978 [2024-11-18 02:12:28.116605] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.978 [2024-11-18 02:12:28.118765] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.978 [2024-11-18 02:12:28.128474] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.978 [2024-11-18 02:12:28.128801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.978 [2024-11-18 02:12:28.129021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.978 [2024-11-18 02:12:28.129046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.978 [2024-11-18 02:12:28.129068] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.978 [2024-11-18 02:12:28.129290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.978 [2024-11-18 02:12:28.129433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.978 [2024-11-18 02:12:28.129457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.978 [2024-11-18 02:12:28.129472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.978 [2024-11-18 02:12:28.131724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.978 [2024-11-18 02:12:28.141162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.978 [2024-11-18 02:12:28.141463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.978 [2024-11-18 02:12:28.141618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.978 [2024-11-18 02:12:28.141647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.978 [2024-11-18 02:12:28.141664] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.978 [2024-11-18 02:12:28.141828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.978 [2024-11-18 02:12:28.142015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.978 [2024-11-18 02:12:28.142037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.978 [2024-11-18 02:12:28.142053] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.978 [2024-11-18 02:12:28.144477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.978 [2024-11-18 02:12:28.153580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.978 [2024-11-18 02:12:28.153937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.978 [2024-11-18 02:12:28.154036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.978 [2024-11-18 02:12:28.154062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.978 [2024-11-18 02:12:28.154077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.978 [2024-11-18 02:12:28.154307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.978 [2024-11-18 02:12:28.154512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.978 [2024-11-18 02:12:28.154532] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.979 [2024-11-18 02:12:28.154545] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.979 [2024-11-18 02:12:28.156839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.979 [2024-11-18 02:12:28.166187] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.979 [2024-11-18 02:12:28.166506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.166667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.166696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.979 [2024-11-18 02:12:28.166713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.979 [2024-11-18 02:12:28.166864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.979 [2024-11-18 02:12:28.167050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.979 [2024-11-18 02:12:28.167073] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.979 [2024-11-18 02:12:28.167088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.979 [2024-11-18 02:12:28.169479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.979 [2024-11-18 02:12:28.178763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.979 [2024-11-18 02:12:28.179049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.179175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.179205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.979 [2024-11-18 02:12:28.179222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.979 [2024-11-18 02:12:28.179384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.979 [2024-11-18 02:12:28.179571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.979 [2024-11-18 02:12:28.179595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.979 [2024-11-18 02:12:28.179610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.979 [2024-11-18 02:12:28.181918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.979 [2024-11-18 02:12:28.191288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.979 [2024-11-18 02:12:28.191646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.191843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.191873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.979 [2024-11-18 02:12:28.191890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.979 [2024-11-18 02:12:28.192036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.979 [2024-11-18 02:12:28.192168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.979 [2024-11-18 02:12:28.192190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.979 [2024-11-18 02:12:28.192205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.979 [2024-11-18 02:12:28.194505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.979 [2024-11-18 02:12:28.203728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.979 [2024-11-18 02:12:28.204036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.204163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.204206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.979 [2024-11-18 02:12:28.204223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.979 [2024-11-18 02:12:28.204412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.979 [2024-11-18 02:12:28.204637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.979 [2024-11-18 02:12:28.204660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.979 [2024-11-18 02:12:28.204675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.979 [2024-11-18 02:12:28.206854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.979 [2024-11-18 02:12:28.216332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.979 [2024-11-18 02:12:28.216638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.216777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.216802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.979 [2024-11-18 02:12:28.216818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.979 [2024-11-18 02:12:28.216977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.979 [2024-11-18 02:12:28.217163] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.979 [2024-11-18 02:12:28.217186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.979 [2024-11-18 02:12:28.217201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.979 [2024-11-18 02:12:28.219752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.979 [2024-11-18 02:12:28.228770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.979 [2024-11-18 02:12:28.229133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.229232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.229257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.979 [2024-11-18 02:12:28.229272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.979 [2024-11-18 02:12:28.229463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.979 [2024-11-18 02:12:28.229628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.979 [2024-11-18 02:12:28.229651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.979 [2024-11-18 02:12:28.229666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.979 [2024-11-18 02:12:28.231879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.979 [2024-11-18 02:12:28.241247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.979 [2024-11-18 02:12:28.241620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.241717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.241746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.979 [2024-11-18 02:12:28.241763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.979 [2024-11-18 02:12:28.241927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.979 [2024-11-18 02:12:28.242078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.979 [2024-11-18 02:12:28.242106] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.979 [2024-11-18 02:12:28.242122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.979 [2024-11-18 02:12:28.244549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.979 [2024-11-18 02:12:28.253884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.979 [2024-11-18 02:12:28.254148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.254280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.254319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.979 [2024-11-18 02:12:28.254339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.979 [2024-11-18 02:12:28.254534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.979 [2024-11-18 02:12:28.254685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.979 [2024-11-18 02:12:28.254708] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.979 [2024-11-18 02:12:28.254723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.979 [2024-11-18 02:12:28.257049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.979 [2024-11-18 02:12:28.266534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.979 [2024-11-18 02:12:28.266910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.267063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.979 [2024-11-18 02:12:28.267093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.979 [2024-11-18 02:12:28.267111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.979 [2024-11-18 02:12:28.267323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.979 [2024-11-18 02:12:28.267457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.979 [2024-11-18 02:12:28.267480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.979 [2024-11-18 02:12:28.267495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.979 [2024-11-18 02:12:28.269657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.979 [2024-11-18 02:12:28.279181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.980 [2024-11-18 02:12:28.279481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.279610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.279638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.980 [2024-11-18 02:12:28.279656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.980 [2024-11-18 02:12:28.279820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.980 [2024-11-18 02:12:28.279970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.980 [2024-11-18 02:12:28.279993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.980 [2024-11-18 02:12:28.280014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.980 [2024-11-18 02:12:28.282389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.980 [2024-11-18 02:12:28.291732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.980 [2024-11-18 02:12:28.292041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.292177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.292218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.980 [2024-11-18 02:12:28.292234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.980 [2024-11-18 02:12:28.292456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.980 [2024-11-18 02:12:28.292693] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.980 [2024-11-18 02:12:28.292716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.980 [2024-11-18 02:12:28.292731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.980 [2024-11-18 02:12:28.295076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.980 [2024-11-18 02:12:28.304219] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.980 [2024-11-18 02:12:28.304496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.304613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.304642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.980 [2024-11-18 02:12:28.304660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.980 [2024-11-18 02:12:28.304878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.980 [2024-11-18 02:12:28.305010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.980 [2024-11-18 02:12:28.305033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.980 [2024-11-18 02:12:28.305047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.980 [2024-11-18 02:12:28.307348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.980 [2024-11-18 02:12:28.316827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.980 [2024-11-18 02:12:28.317085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.317214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.317243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.980 [2024-11-18 02:12:28.317260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.980 [2024-11-18 02:12:28.317420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.980 [2024-11-18 02:12:28.317554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.980 [2024-11-18 02:12:28.317577] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.980 [2024-11-18 02:12:28.317592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.980 [2024-11-18 02:12:28.319887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.980 [2024-11-18 02:12:28.329449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.980 [2024-11-18 02:12:28.329742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.329893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.329922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.980 [2024-11-18 02:12:28.329939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.980 [2024-11-18 02:12:28.330086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.980 [2024-11-18 02:12:28.330255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.980 [2024-11-18 02:12:28.330278] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.980 [2024-11-18 02:12:28.330293] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.980 [2024-11-18 02:12:28.332475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.980 [2024-11-18 02:12:28.342049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.980 [2024-11-18 02:12:28.342396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.342507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.342533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.980 [2024-11-18 02:12:28.342549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.980 [2024-11-18 02:12:28.342744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.980 [2024-11-18 02:12:28.342876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.980 [2024-11-18 02:12:28.342899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.980 [2024-11-18 02:12:28.342914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.980 [2024-11-18 02:12:28.345230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.980 [2024-11-18 02:12:28.354636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.980 [2024-11-18 02:12:28.354942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.355079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.355107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.980 [2024-11-18 02:12:28.355125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.980 [2024-11-18 02:12:28.355306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.980 [2024-11-18 02:12:28.355465] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.980 [2024-11-18 02:12:28.355486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.980 [2024-11-18 02:12:28.355500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.980 [2024-11-18 02:12:28.357873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:53.980 [2024-11-18 02:12:28.367347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:53.980 [2024-11-18 02:12:28.367712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.367863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:53.980 [2024-11-18 02:12:28.367905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:53.980 [2024-11-18 02:12:28.367920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:53.980 [2024-11-18 02:12:28.368110] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:53.980 [2024-11-18 02:12:28.368271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:53.980 [2024-11-18 02:12:28.368290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:53.980 [2024-11-18 02:12:28.368333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:53.980 [2024-11-18 02:12:28.370567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.240 [2024-11-18 02:12:28.379990] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.240 [2024-11-18 02:12:28.380257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.240 [2024-11-18 02:12:28.380384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.240 [2024-11-18 02:12:28.380413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.240 [2024-11-18 02:12:28.380429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.240 [2024-11-18 02:12:28.380561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.240 [2024-11-18 02:12:28.380734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.240 [2024-11-18 02:12:28.380758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.240 [2024-11-18 02:12:28.380773] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.240 [2024-11-18 02:12:28.383146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.240 [2024-11-18 02:12:28.392880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.240 [2024-11-18 02:12:28.393193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.240 [2024-11-18 02:12:28.393336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.240 [2024-11-18 02:12:28.393363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.240 [2024-11-18 02:12:28.393379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.240 [2024-11-18 02:12:28.393543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.240 [2024-11-18 02:12:28.393703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.240 [2024-11-18 02:12:28.393726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.240 [2024-11-18 02:12:28.393741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.240 [2024-11-18 02:12:28.395977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.241 [2024-11-18 02:12:28.405520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.241 [2024-11-18 02:12:28.405825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.405994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.406020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.241 [2024-11-18 02:12:28.406036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.241 [2024-11-18 02:12:28.406165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.241 [2024-11-18 02:12:28.406337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.241 [2024-11-18 02:12:28.406362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.241 [2024-11-18 02:12:28.406392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.241 [2024-11-18 02:12:28.408846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.241 [2024-11-18 02:12:28.417954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.241 [2024-11-18 02:12:28.418340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.418473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.418499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.241 [2024-11-18 02:12:28.418515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.241 [2024-11-18 02:12:28.418670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.241 [2024-11-18 02:12:28.418857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.241 [2024-11-18 02:12:28.418880] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.241 [2024-11-18 02:12:28.418895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.241 [2024-11-18 02:12:28.421131] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.241 [2024-11-18 02:12:28.430362] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.241 [2024-11-18 02:12:28.430722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.430894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.430923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.241 [2024-11-18 02:12:28.430940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.241 [2024-11-18 02:12:28.431104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.241 [2024-11-18 02:12:28.431254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.241 [2024-11-18 02:12:28.431277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.241 [2024-11-18 02:12:28.431292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.241 [2024-11-18 02:12:28.433790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.241 [2024-11-18 02:12:28.442937] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.241 [2024-11-18 02:12:28.443397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.443533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.443567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.241 [2024-11-18 02:12:28.443586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.241 [2024-11-18 02:12:28.443750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.241 [2024-11-18 02:12:28.443901] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.241 [2024-11-18 02:12:28.443923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.241 [2024-11-18 02:12:28.443939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.241 [2024-11-18 02:12:28.446301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.241 [2024-11-18 02:12:28.455500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.241 [2024-11-18 02:12:28.455801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.455929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.455957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.241 [2024-11-18 02:12:28.455975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.241 [2024-11-18 02:12:28.456139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.241 [2024-11-18 02:12:28.456307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.241 [2024-11-18 02:12:28.456342] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.241 [2024-11-18 02:12:28.456358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.241 [2024-11-18 02:12:28.458753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.241 [2024-11-18 02:12:28.468123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.241 [2024-11-18 02:12:28.468501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.468693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.468719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.241 [2024-11-18 02:12:28.468735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.241 [2024-11-18 02:12:28.468948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.241 [2024-11-18 02:12:28.469135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.241 [2024-11-18 02:12:28.469158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.241 [2024-11-18 02:12:28.469172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.241 [2024-11-18 02:12:28.471328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.241 [2024-11-18 02:12:28.480767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.241 [2024-11-18 02:12:28.481058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.481211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.481240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.241 [2024-11-18 02:12:28.481263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.241 [2024-11-18 02:12:28.481440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.241 [2024-11-18 02:12:28.481610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.241 [2024-11-18 02:12:28.481633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.241 [2024-11-18 02:12:28.481648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.241 [2024-11-18 02:12:28.483955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.241 [2024-11-18 02:12:28.493277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.241 [2024-11-18 02:12:28.493615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.493751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.493777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.241 [2024-11-18 02:12:28.493793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.241 [2024-11-18 02:12:28.493968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.241 [2024-11-18 02:12:28.494154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.241 [2024-11-18 02:12:28.494177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.241 [2024-11-18 02:12:28.494192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.241 [2024-11-18 02:12:28.496654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.241 [2024-11-18 02:12:28.505764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.241 [2024-11-18 02:12:28.506041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.506198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.506227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.241 [2024-11-18 02:12:28.506245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.241 [2024-11-18 02:12:28.506440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.241 [2024-11-18 02:12:28.506609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.241 [2024-11-18 02:12:28.506632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.241 [2024-11-18 02:12:28.506647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.241 [2024-11-18 02:12:28.509061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.241 [2024-11-18 02:12:28.518228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.241 [2024-11-18 02:12:28.518547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.518688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.241 [2024-11-18 02:12:28.518714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.242 [2024-11-18 02:12:28.518729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.242 [2024-11-18 02:12:28.518880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.242 [2024-11-18 02:12:28.519041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.242 [2024-11-18 02:12:28.519064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.242 [2024-11-18 02:12:28.519079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.242 [2024-11-18 02:12:28.521504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.242 [2024-11-18 02:12:28.530642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.242 [2024-11-18 02:12:28.531017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.531104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.531131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.242 [2024-11-18 02:12:28.531147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.242 [2024-11-18 02:12:28.531262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.242 [2024-11-18 02:12:28.531424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.242 [2024-11-18 02:12:28.531446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.242 [2024-11-18 02:12:28.531459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.242 [2024-11-18 02:12:28.533700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.242 [2024-11-18 02:12:28.543151] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.242 [2024-11-18 02:12:28.543457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.543555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.543580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.242 [2024-11-18 02:12:28.543596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.242 [2024-11-18 02:12:28.543774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.242 [2024-11-18 02:12:28.543925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.242 [2024-11-18 02:12:28.543948] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.242 [2024-11-18 02:12:28.543963] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.242 [2024-11-18 02:12:28.546610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.242 [2024-11-18 02:12:28.555741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.242 [2024-11-18 02:12:28.556038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.556158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.556186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.242 [2024-11-18 02:12:28.556204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.242 [2024-11-18 02:12:28.556440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.242 [2024-11-18 02:12:28.556620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.242 [2024-11-18 02:12:28.556643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.242 [2024-11-18 02:12:28.556658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.242 [2024-11-18 02:12:28.559092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.242 [2024-11-18 02:12:28.568516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.242 [2024-11-18 02:12:28.568839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.568958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.568984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.242 [2024-11-18 02:12:28.569000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.242 [2024-11-18 02:12:28.569155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.242 [2024-11-18 02:12:28.569335] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.242 [2024-11-18 02:12:28.569373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.242 [2024-11-18 02:12:28.569387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.242 [2024-11-18 02:12:28.571780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.242 [2024-11-18 02:12:28.580914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.242 [2024-11-18 02:12:28.581242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.581383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.581413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.242 [2024-11-18 02:12:28.581430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.242 [2024-11-18 02:12:28.581577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.242 [2024-11-18 02:12:28.581726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.242 [2024-11-18 02:12:28.581749] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.242 [2024-11-18 02:12:28.581765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.242 [2024-11-18 02:12:28.583910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.242 [2024-11-18 02:12:28.593627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.242 [2024-11-18 02:12:28.594007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.594211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.594239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.242 [2024-11-18 02:12:28.594257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.242 [2024-11-18 02:12:28.594449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.242 [2024-11-18 02:12:28.594601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.242 [2024-11-18 02:12:28.594629] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.242 [2024-11-18 02:12:28.594645] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.242 [2024-11-18 02:12:28.596882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.242 [2024-11-18 02:12:28.606299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.242 [2024-11-18 02:12:28.606559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.606725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.606750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.242 [2024-11-18 02:12:28.606766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.242 [2024-11-18 02:12:28.606929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.242 [2024-11-18 02:12:28.607115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.242 [2024-11-18 02:12:28.607137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.242 [2024-11-18 02:12:28.607152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.242 [2024-11-18 02:12:28.609435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.242 [2024-11-18 02:12:28.618824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.242 [2024-11-18 02:12:28.619146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.619256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.619284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.242 [2024-11-18 02:12:28.619301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.242 [2024-11-18 02:12:28.619496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.242 [2024-11-18 02:12:28.619664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.242 [2024-11-18 02:12:28.619687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.242 [2024-11-18 02:12:28.619702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.242 [2024-11-18 02:12:28.621919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.242 [2024-11-18 02:12:28.631413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.242 [2024-11-18 02:12:28.631721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.631871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.242 [2024-11-18 02:12:28.631900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.242 [2024-11-18 02:12:28.631918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.243 [2024-11-18 02:12:28.632100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.243 [2024-11-18 02:12:28.632267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.243 [2024-11-18 02:12:28.632290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.243 [2024-11-18 02:12:28.632320] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.243 [2024-11-18 02:12:28.634795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.502 [2024-11-18 02:12:28.643903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.502 [2024-11-18 02:12:28.644267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.502 [2024-11-18 02:12:28.644453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.502 [2024-11-18 02:12:28.644482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.502 [2024-11-18 02:12:28.644499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.502 [2024-11-18 02:12:28.644681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.502 [2024-11-18 02:12:28.644795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.502 [2024-11-18 02:12:28.644817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.502 [2024-11-18 02:12:28.644832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.502 [2024-11-18 02:12:28.647196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.502 [2024-11-18 02:12:28.656451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.502 [2024-11-18 02:12:28.656766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.502 [2024-11-18 02:12:28.656931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.502 [2024-11-18 02:12:28.656957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.502 [2024-11-18 02:12:28.656973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.502 [2024-11-18 02:12:28.657163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.502 [2024-11-18 02:12:28.657409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.502 [2024-11-18 02:12:28.657434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.502 [2024-11-18 02:12:28.657449] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.502 [2024-11-18 02:12:28.659629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.502 [2024-11-18 02:12:28.668980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.502 [2024-11-18 02:12:28.669362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.502 [2024-11-18 02:12:28.669518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.502 [2024-11-18 02:12:28.669547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.502 [2024-11-18 02:12:28.669565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.502 [2024-11-18 02:12:28.669712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.502 [2024-11-18 02:12:28.669880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.502 [2024-11-18 02:12:28.669902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.502 [2024-11-18 02:12:28.669917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.502 [2024-11-18 02:12:28.672140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.502 [2024-11-18 02:12:28.681401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.502 [2024-11-18 02:12:28.681708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.681835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.681878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.503 [2024-11-18 02:12:28.681895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.503 [2024-11-18 02:12:28.682087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.503 [2024-11-18 02:12:28.682249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.503 [2024-11-18 02:12:28.682272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.503 [2024-11-18 02:12:28.682287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.503 [2024-11-18 02:12:28.684872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.503 [2024-11-18 02:12:28.694051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.503 [2024-11-18 02:12:28.694339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.694481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.694507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.503 [2024-11-18 02:12:28.694523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.503 [2024-11-18 02:12:28.694677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.503 [2024-11-18 02:12:28.694809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.503 [2024-11-18 02:12:28.694832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.503 [2024-11-18 02:12:28.694847] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.503 [2024-11-18 02:12:28.697328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.503 [2024-11-18 02:12:28.706536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.503 [2024-11-18 02:12:28.706858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.706985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.707011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.503 [2024-11-18 02:12:28.707027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.503 [2024-11-18 02:12:28.707201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.503 [2024-11-18 02:12:28.707346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.503 [2024-11-18 02:12:28.707370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.503 [2024-11-18 02:12:28.707385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.503 [2024-11-18 02:12:28.709764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.503 [2024-11-18 02:12:28.719085] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.503 [2024-11-18 02:12:28.719357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.719488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.719531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.503 [2024-11-18 02:12:28.719547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.503 [2024-11-18 02:12:28.719693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.503 [2024-11-18 02:12:28.719899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.503 [2024-11-18 02:12:28.719922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.503 [2024-11-18 02:12:28.719937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.503 [2024-11-18 02:12:28.722154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.503 [2024-11-18 02:12:28.731648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.503 [2024-11-18 02:12:28.731931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.732052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.732078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.503 [2024-11-18 02:12:28.732093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.503 [2024-11-18 02:12:28.732256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.503 [2024-11-18 02:12:28.732474] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.503 [2024-11-18 02:12:28.732498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.503 [2024-11-18 02:12:28.732513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.503 [2024-11-18 02:12:28.734764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.503 [2024-11-18 02:12:28.744360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.503 [2024-11-18 02:12:28.744636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.744761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.744791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.503 [2024-11-18 02:12:28.744808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.503 [2024-11-18 02:12:28.744990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.503 [2024-11-18 02:12:28.745122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.503 [2024-11-18 02:12:28.745144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.503 [2024-11-18 02:12:28.745159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.503 [2024-11-18 02:12:28.747508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.503 [2024-11-18 02:12:28.756901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.503 [2024-11-18 02:12:28.757238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.757361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.757390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.503 [2024-11-18 02:12:28.757408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.503 [2024-11-18 02:12:28.757590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.503 [2024-11-18 02:12:28.757776] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.503 [2024-11-18 02:12:28.757799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.503 [2024-11-18 02:12:28.757814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.503 [2024-11-18 02:12:28.760265] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.503 [2024-11-18 02:12:28.769371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.503 [2024-11-18 02:12:28.769678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.769808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.769837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.503 [2024-11-18 02:12:28.769855] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.503 [2024-11-18 02:12:28.769983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.503 [2024-11-18 02:12:28.770187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.503 [2024-11-18 02:12:28.770210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.503 [2024-11-18 02:12:28.770225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.503 [2024-11-18 02:12:28.772703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.503 [2024-11-18 02:12:28.781958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.503 [2024-11-18 02:12:28.782228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.782382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.782411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.503 [2024-11-18 02:12:28.782429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.503 [2024-11-18 02:12:28.782538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.503 [2024-11-18 02:12:28.782688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.503 [2024-11-18 02:12:28.782711] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.503 [2024-11-18 02:12:28.782726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.503 [2024-11-18 02:12:28.785011] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.503 [2024-11-18 02:12:28.794460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.503 [2024-11-18 02:12:28.794749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.794909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.503 [2024-11-18 02:12:28.794938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.503 [2024-11-18 02:12:28.794955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.504 [2024-11-18 02:12:28.795155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.504 [2024-11-18 02:12:28.795371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.504 [2024-11-18 02:12:28.795395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.504 [2024-11-18 02:12:28.795410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.504 [2024-11-18 02:12:28.797696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.504 [2024-11-18 02:12:28.807346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.504 [2024-11-18 02:12:28.807598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.807760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.807786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.504 [2024-11-18 02:12:28.807801] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.504 [2024-11-18 02:12:28.808010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.504 [2024-11-18 02:12:28.808143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.504 [2024-11-18 02:12:28.808166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.504 [2024-11-18 02:12:28.808181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.504 [2024-11-18 02:12:28.810494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.504 [2024-11-18 02:12:28.819828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.504 [2024-11-18 02:12:28.820123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.820256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.820282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.504 [2024-11-18 02:12:28.820298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.504 [2024-11-18 02:12:28.820503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.504 [2024-11-18 02:12:28.820636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.504 [2024-11-18 02:12:28.820659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.504 [2024-11-18 02:12:28.820674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.504 [2024-11-18 02:12:28.823030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.504 [2024-11-18 02:12:28.832510] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.504 [2024-11-18 02:12:28.832854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.833031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.833057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.504 [2024-11-18 02:12:28.833078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.504 [2024-11-18 02:12:28.833256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.504 [2024-11-18 02:12:28.833402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.504 [2024-11-18 02:12:28.833426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.504 [2024-11-18 02:12:28.833441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.504 [2024-11-18 02:12:28.835855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.504 [2024-11-18 02:12:28.845052] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.504 [2024-11-18 02:12:28.845484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.845609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.845638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.504 [2024-11-18 02:12:28.845656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.504 [2024-11-18 02:12:28.845821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.504 [2024-11-18 02:12:28.845989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.504 [2024-11-18 02:12:28.846012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.504 [2024-11-18 02:12:28.846027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.504 [2024-11-18 02:12:28.848576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.504 [2024-11-18 02:12:28.857440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.504 [2024-11-18 02:12:28.857725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.857917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.857970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.504 [2024-11-18 02:12:28.857987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.504 [2024-11-18 02:12:28.858134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.504 [2024-11-18 02:12:28.858283] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.504 [2024-11-18 02:12:28.858306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.504 [2024-11-18 02:12:28.858333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.504 [2024-11-18 02:12:28.860585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.504 [2024-11-18 02:12:28.869934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.504 [2024-11-18 02:12:28.870296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.870407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.870436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.504 [2024-11-18 02:12:28.870453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.504 [2024-11-18 02:12:28.870677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.504 [2024-11-18 02:12:28.870846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.504 [2024-11-18 02:12:28.870869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.504 [2024-11-18 02:12:28.870883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.504 [2024-11-18 02:12:28.873101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.504 [2024-11-18 02:12:28.882709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.504 [2024-11-18 02:12:28.883012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.883167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.883196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.504 [2024-11-18 02:12:28.883214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.504 [2024-11-18 02:12:28.883408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.504 [2024-11-18 02:12:28.883578] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.504 [2024-11-18 02:12:28.883600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.504 [2024-11-18 02:12:28.883615] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.504 [2024-11-18 02:12:28.886013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.504 [2024-11-18 02:12:28.895019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.504 [2024-11-18 02:12:28.895382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.895507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.504 [2024-11-18 02:12:28.895550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.504 [2024-11-18 02:12:28.895567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.504 [2024-11-18 02:12:28.895726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.504 [2024-11-18 02:12:28.895867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.504 [2024-11-18 02:12:28.895890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.504 [2024-11-18 02:12:28.895905] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.504 [2024-11-18 02:12:28.898138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.764 [2024-11-18 02:12:28.907612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.764 [2024-11-18 02:12:28.907924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.764 [2024-11-18 02:12:28.908059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.764 [2024-11-18 02:12:28.908087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.764 [2024-11-18 02:12:28.908105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.764 [2024-11-18 02:12:28.908286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.764 [2024-11-18 02:12:28.908437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.764 [2024-11-18 02:12:28.908461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.764 [2024-11-18 02:12:28.908476] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.764 [2024-11-18 02:12:28.910725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.764 [2024-11-18 02:12:28.920421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.764 [2024-11-18 02:12:28.920734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.764 [2024-11-18 02:12:28.920920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.764 [2024-11-18 02:12:28.920954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.765 [2024-11-18 02:12:28.920993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.765 [2024-11-18 02:12:28.921137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.765 [2024-11-18 02:12:28.921305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.765 [2024-11-18 02:12:28.921339] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.765 [2024-11-18 02:12:28.921355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.765 [2024-11-18 02:12:28.923697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.765 [2024-11-18 02:12:28.932921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.765 [2024-11-18 02:12:28.933197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:28.933324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:28.933354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.765 [2024-11-18 02:12:28.933386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.765 [2024-11-18 02:12:28.933535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.765 [2024-11-18 02:12:28.933716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.765 [2024-11-18 02:12:28.933739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.765 [2024-11-18 02:12:28.933753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.765 [2024-11-18 02:12:28.936187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.765 [2024-11-18 02:12:28.945268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.765 [2024-11-18 02:12:28.945597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:28.945739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:28.945765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.765 [2024-11-18 02:12:28.945781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.765 [2024-11-18 02:12:28.945977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.765 [2024-11-18 02:12:28.946163] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.765 [2024-11-18 02:12:28.946191] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.765 [2024-11-18 02:12:28.946206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.765 [2024-11-18 02:12:28.948377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.765 [2024-11-18 02:12:28.957701] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.765 [2024-11-18 02:12:28.958048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:28.958147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:28.958176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.765 [2024-11-18 02:12:28.958209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.765 [2024-11-18 02:12:28.958385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.765 [2024-11-18 02:12:28.958577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.765 [2024-11-18 02:12:28.958600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.765 [2024-11-18 02:12:28.958615] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.765 [2024-11-18 02:12:28.960974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.765 [2024-11-18 02:12:28.970448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.765 [2024-11-18 02:12:28.970688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:28.970859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:28.970885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.765 [2024-11-18 02:12:28.970901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.765 [2024-11-18 02:12:28.971095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.765 [2024-11-18 02:12:28.971272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.765 [2024-11-18 02:12:28.971295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.765 [2024-11-18 02:12:28.971320] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.765 [2024-11-18 02:12:28.973701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.765 [2024-11-18 02:12:28.982943] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.765 [2024-11-18 02:12:28.983215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:28.983352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:28.983383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.765 [2024-11-18 02:12:28.983401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.765 [2024-11-18 02:12:28.983547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.765 [2024-11-18 02:12:28.983770] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.765 [2024-11-18 02:12:28.983793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.765 [2024-11-18 02:12:28.983814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.765 [2024-11-18 02:12:28.986229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.765 [2024-11-18 02:12:28.995783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.765 [2024-11-18 02:12:28.996122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:28.996246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:28.996275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.765 [2024-11-18 02:12:28.996293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.765 [2024-11-18 02:12:28.996467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.765 [2024-11-18 02:12:28.996654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.765 [2024-11-18 02:12:28.996677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.765 [2024-11-18 02:12:28.996692] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.765 [2024-11-18 02:12:28.999144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.765 [2024-11-18 02:12:29.008507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.765 [2024-11-18 02:12:29.008801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:29.008954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:29.008983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.765 [2024-11-18 02:12:29.009001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.765 [2024-11-18 02:12:29.009165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.765 [2024-11-18 02:12:29.009297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.765 [2024-11-18 02:12:29.009330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.765 [2024-11-18 02:12:29.009347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.765 [2024-11-18 02:12:29.011705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.765 [2024-11-18 02:12:29.020932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.765 [2024-11-18 02:12:29.021279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:29.021386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.765 [2024-11-18 02:12:29.021415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.765 [2024-11-18 02:12:29.021433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.766 [2024-11-18 02:12:29.021597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.766 [2024-11-18 02:12:29.021747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.766 [2024-11-18 02:12:29.021770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.766 [2024-11-18 02:12:29.021785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.766 [2024-11-18 02:12:29.023935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.766 [2024-11-18 02:12:29.033433] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.766 [2024-11-18 02:12:29.033788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.033948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.033973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.766 [2024-11-18 02:12:29.033989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.766 [2024-11-18 02:12:29.034146] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.766 [2024-11-18 02:12:29.034324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.766 [2024-11-18 02:12:29.034348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.766 [2024-11-18 02:12:29.034363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.766 [2024-11-18 02:12:29.036667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.766 [2024-11-18 02:12:29.046186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.766 [2024-11-18 02:12:29.046532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.046618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.046643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.766 [2024-11-18 02:12:29.046659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.766 [2024-11-18 02:12:29.046829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.766 [2024-11-18 02:12:29.046998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.766 [2024-11-18 02:12:29.047021] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.766 [2024-11-18 02:12:29.047036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.766 [2024-11-18 02:12:29.049108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.766 [2024-11-18 02:12:29.058846] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.766 [2024-11-18 02:12:29.059100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.059237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.059265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.766 [2024-11-18 02:12:29.059283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.766 [2024-11-18 02:12:29.059475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.766 [2024-11-18 02:12:29.059645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.766 [2024-11-18 02:12:29.059668] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.766 [2024-11-18 02:12:29.059683] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.766 [2024-11-18 02:12:29.061952] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.766 [2024-11-18 02:12:29.071630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.766 [2024-11-18 02:12:29.071985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.072076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.072102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.766 [2024-11-18 02:12:29.072118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.766 [2024-11-18 02:12:29.072298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.766 [2024-11-18 02:12:29.072527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.766 [2024-11-18 02:12:29.072551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.766 [2024-11-18 02:12:29.072566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.766 [2024-11-18 02:12:29.074874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.766 [2024-11-18 02:12:29.084188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.766 [2024-11-18 02:12:29.084523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.084658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.084684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.766 [2024-11-18 02:12:29.084699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.766 [2024-11-18 02:12:29.084897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.766 [2024-11-18 02:12:29.085066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.766 [2024-11-18 02:12:29.085088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.766 [2024-11-18 02:12:29.085104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.766 [2024-11-18 02:12:29.087347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.766 [2024-11-18 02:12:29.096821] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.766 [2024-11-18 02:12:29.097133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.097261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.097289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.766 [2024-11-18 02:12:29.097307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.766 [2024-11-18 02:12:29.097482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.766 [2024-11-18 02:12:29.097596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.766 [2024-11-18 02:12:29.097620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.766 [2024-11-18 02:12:29.097634] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.766 [2024-11-18 02:12:29.099812] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.766 [2024-11-18 02:12:29.109398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.766 [2024-11-18 02:12:29.109762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.109866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.766 [2024-11-18 02:12:29.109895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.766 [2024-11-18 02:12:29.109913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.767 [2024-11-18 02:12:29.110059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.767 [2024-11-18 02:12:29.110245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.767 [2024-11-18 02:12:29.110268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.767 [2024-11-18 02:12:29.110282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.767 [2024-11-18 02:12:29.112578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.767 [2024-11-18 02:12:29.122226] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.767 [2024-11-18 02:12:29.122604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.767 [2024-11-18 02:12:29.122722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.767 [2024-11-18 02:12:29.122748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.767 [2024-11-18 02:12:29.122764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.767 [2024-11-18 02:12:29.122927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.767 [2024-11-18 02:12:29.123119] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.767 [2024-11-18 02:12:29.123143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.767 [2024-11-18 02:12:29.123158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.767 [2024-11-18 02:12:29.125546] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.767 [2024-11-18 02:12:29.134762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.767 [2024-11-18 02:12:29.135050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.767 [2024-11-18 02:12:29.135207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.767 [2024-11-18 02:12:29.135236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.767 [2024-11-18 02:12:29.135253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.767 [2024-11-18 02:12:29.135430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.767 [2024-11-18 02:12:29.135599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.767 [2024-11-18 02:12:29.135622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.767 [2024-11-18 02:12:29.135637] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.767 [2024-11-18 02:12:29.137813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.767 [2024-11-18 02:12:29.147446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.767 [2024-11-18 02:12:29.147778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.767 [2024-11-18 02:12:29.147919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.767 [2024-11-18 02:12:29.147961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.767 [2024-11-18 02:12:29.147976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.767 [2024-11-18 02:12:29.148139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.767 [2024-11-18 02:12:29.148265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.767 [2024-11-18 02:12:29.148288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.767 [2024-11-18 02:12:29.148303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.767 [2024-11-18 02:12:29.150619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:54.767 [2024-11-18 02:12:29.159985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:54.767 [2024-11-18 02:12:29.160290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.767 [2024-11-18 02:12:29.160450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:54.767 [2024-11-18 02:12:29.160479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:54.767 [2024-11-18 02:12:29.160496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:54.767 [2024-11-18 02:12:29.160624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:54.767 [2024-11-18 02:12:29.160775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:54.767 [2024-11-18 02:12:29.160798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:54.767 [2024-11-18 02:12:29.160812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:54.767 [2024-11-18 02:12:29.162920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.026 [2024-11-18 02:12:29.172491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.026 [2024-11-18 02:12:29.172813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.026 [2024-11-18 02:12:29.172923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.026 [2024-11-18 02:12:29.172948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.026 [2024-11-18 02:12:29.172964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.026 [2024-11-18 02:12:29.173112] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.026 [2024-11-18 02:12:29.173290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.026 [2024-11-18 02:12:29.173321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.026 [2024-11-18 02:12:29.173339] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.026 [2024-11-18 02:12:29.175594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.026 [2024-11-18 02:12:29.185402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.026 [2024-11-18 02:12:29.185677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.026 [2024-11-18 02:12:29.185802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.026 [2024-11-18 02:12:29.185832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.026 [2024-11-18 02:12:29.185855] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.026 [2024-11-18 02:12:29.186020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.026 [2024-11-18 02:12:29.186188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.026 [2024-11-18 02:12:29.186211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.026 [2024-11-18 02:12:29.186226] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.026 [2024-11-18 02:12:29.188613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.026 [2024-11-18 02:12:29.197953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.026 [2024-11-18 02:12:29.198221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.026 [2024-11-18 02:12:29.198364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.026 [2024-11-18 02:12:29.198391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.026 [2024-11-18 02:12:29.198406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.026 [2024-11-18 02:12:29.198538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.026 [2024-11-18 02:12:29.198764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.026 [2024-11-18 02:12:29.198787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.026 [2024-11-18 02:12:29.198802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.026 [2024-11-18 02:12:29.201160] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.026 [2024-11-18 02:12:29.210413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.026 [2024-11-18 02:12:29.210725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.026 [2024-11-18 02:12:29.210865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.026 [2024-11-18 02:12:29.210891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.026 [2024-11-18 02:12:29.210907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.026 [2024-11-18 02:12:29.211069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.026 [2024-11-18 02:12:29.211248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.026 [2024-11-18 02:12:29.211271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.026 [2024-11-18 02:12:29.211285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.026 [2024-11-18 02:12:29.213745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.026 [2024-11-18 02:12:29.222881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.026 [2024-11-18 02:12:29.223191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.026 [2024-11-18 02:12:29.223326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.026 [2024-11-18 02:12:29.223356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.026 [2024-11-18 02:12:29.223373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.026 [2024-11-18 02:12:29.223561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.026 [2024-11-18 02:12:29.223747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.026 [2024-11-18 02:12:29.223770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.026 [2024-11-18 02:12:29.223784] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.026 [2024-11-18 02:12:29.225981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.026 [2024-11-18 02:12:29.235356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.026 [2024-11-18 02:12:29.235666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.026 [2024-11-18 02:12:29.235788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.026 [2024-11-18 02:12:29.235831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.026 [2024-11-18 02:12:29.235847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.026 [2024-11-18 02:12:29.236025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.026 [2024-11-18 02:12:29.236187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.026 [2024-11-18 02:12:29.236210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.026 [2024-11-18 02:12:29.236224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.238592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.247849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.248079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.248229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.248258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.248275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.248486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.248637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.248660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.248675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.251180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.260395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.260733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.260838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.260867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.260885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.260994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.261169] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.261192] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.261207] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.263484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.273199] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.273460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.273614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.273643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.273661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.273806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.273993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.274016] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.274031] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.276407] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.285725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.286046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.286198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.286240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.286256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.286413] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.286579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.286602] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.286616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.288797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.298266] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.298548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.298672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.298702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.298720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.298902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.299087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.299115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.299131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.301464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.310674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.311039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.311163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.311192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.311210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.311439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.311590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.311613] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.311628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.313967] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.323109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.323424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.323564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.323590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.323606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.323812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.323978] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.324000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.324015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.326197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.335662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.335991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.336111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.336140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.336157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.336248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.336462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.336486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.336507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.338760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.348282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.348573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.348695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.348723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.348741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.348923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.349091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.349113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.349129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.351391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.360992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.361339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.361468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.361512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.361528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.361689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.361862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.361885] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.361900] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.364115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.373560] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.373847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.373989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.374015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.374031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.374226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.374405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.374430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.374445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.376936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.386066] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.386343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.386499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.386524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.386540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.386686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.386882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.386905] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.386920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.389084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.398466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.398840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.398972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.399001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.399018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.399182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.399409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.399432] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.399445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.401479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.410947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.411321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.411429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.411456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.411472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.411603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.411772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.411795] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.411810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.413994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.027 [2024-11-18 02:12:29.423812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.027 [2024-11-18 02:12:29.424085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.424238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.027 [2024-11-18 02:12:29.424267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.027 [2024-11-18 02:12:29.424285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.027 [2024-11-18 02:12:29.424497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.027 [2024-11-18 02:12:29.424694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.027 [2024-11-18 02:12:29.424717] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.027 [2024-11-18 02:12:29.424732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.027 [2024-11-18 02:12:29.426951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.287 [2024-11-18 02:12:29.436261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.287 [2024-11-18 02:12:29.436534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.436699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.436727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.287 [2024-11-18 02:12:29.436745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.287 [2024-11-18 02:12:29.436909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.287 [2024-11-18 02:12:29.437095] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.287 [2024-11-18 02:12:29.437119] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.287 [2024-11-18 02:12:29.437134] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.287 [2024-11-18 02:12:29.439523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.287 [2024-11-18 02:12:29.448808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.287 [2024-11-18 02:12:29.449053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.449182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.449211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.287 [2024-11-18 02:12:29.449228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.287 [2024-11-18 02:12:29.449403] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.287 [2024-11-18 02:12:29.449609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.287 [2024-11-18 02:12:29.449631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.287 [2024-11-18 02:12:29.449646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.287 [2024-11-18 02:12:29.452149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.287 [2024-11-18 02:12:29.461403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.287 [2024-11-18 02:12:29.461736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.461841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.461867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.287 [2024-11-18 02:12:29.461883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.287 [2024-11-18 02:12:29.462047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.287 [2024-11-18 02:12:29.462210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.287 [2024-11-18 02:12:29.462230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.287 [2024-11-18 02:12:29.462259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.287 [2024-11-18 02:12:29.464561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.287 [2024-11-18 02:12:29.474079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.287 [2024-11-18 02:12:29.474408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.474507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.474534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.287 [2024-11-18 02:12:29.474550] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.287 [2024-11-18 02:12:29.474718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.287 [2024-11-18 02:12:29.474885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.287 [2024-11-18 02:12:29.474909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.287 [2024-11-18 02:12:29.474923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.287 [2024-11-18 02:12:29.477152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.287 [2024-11-18 02:12:29.486645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.287 [2024-11-18 02:12:29.486919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.487016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.487042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.287 [2024-11-18 02:12:29.487058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.287 [2024-11-18 02:12:29.487174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.287 [2024-11-18 02:12:29.487318] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.287 [2024-11-18 02:12:29.487357] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.287 [2024-11-18 02:12:29.487372] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.287 [2024-11-18 02:12:29.489695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.287 [2024-11-18 02:12:29.499298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.287 [2024-11-18 02:12:29.499600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.499720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.499749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.287 [2024-11-18 02:12:29.499767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.287 [2024-11-18 02:12:29.499967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.287 [2024-11-18 02:12:29.500135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.287 [2024-11-18 02:12:29.500158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.287 [2024-11-18 02:12:29.500173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.287 [2024-11-18 02:12:29.502473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.287 [2024-11-18 02:12:29.512032] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.287 [2024-11-18 02:12:29.512289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.512405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.512432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.287 [2024-11-18 02:12:29.512448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.287 [2024-11-18 02:12:29.512615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.287 [2024-11-18 02:12:29.512793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.287 [2024-11-18 02:12:29.512817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.287 [2024-11-18 02:12:29.512831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.287 [2024-11-18 02:12:29.515221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.287 [2024-11-18 02:12:29.524805] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.287 [2024-11-18 02:12:29.525079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.525208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.287 [2024-11-18 02:12:29.525237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.287 [2024-11-18 02:12:29.525254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.287 [2024-11-18 02:12:29.525469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.287 [2024-11-18 02:12:29.525649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.287 [2024-11-18 02:12:29.525685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.287 [2024-11-18 02:12:29.525699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.288 [2024-11-18 02:12:29.528039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.288 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1332546 Killed "${NVMF_APP[@]}" "$@" 00:29:55.288 02:12:29 -- host/bdevperf.sh@36 -- # tgt_init 00:29:55.288 02:12:29 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:55.288 02:12:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:55.288 02:12:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:55.288 02:12:29 -- common/autotest_common.sh@10 -- # set +x 00:29:55.288 02:12:29 -- nvmf/common.sh@469 -- # nvmfpid=1333657 00:29:55.288 02:12:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:55.288 02:12:29 -- nvmf/common.sh@470 -- # waitforlisten 1333657 00:29:55.288 02:12:29 -- common/autotest_common.sh@829 -- # '[' -z 1333657 ']' 00:29:55.288 02:12:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:55.288 02:12:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:55.288 02:12:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:55.288 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:55.288 02:12:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:55.288 02:12:29 -- common/autotest_common.sh@10 -- # set +x 00:29:55.288 [2024-11-18 02:12:29.537285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.288 [2024-11-18 02:12:29.537550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.537703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.537732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.288 [2024-11-18 02:12:29.537751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.288 [2024-11-18 02:12:29.537916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.288 [2024-11-18 02:12:29.538103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.288 [2024-11-18 02:12:29.538126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.288 [2024-11-18 02:12:29.538142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.288 [2024-11-18 02:12:29.540566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.288 [2024-11-18 02:12:29.549926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.288 [2024-11-18 02:12:29.550158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.550282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.550308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.288 [2024-11-18 02:12:29.550336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.288 [2024-11-18 02:12:29.550486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.288 [2024-11-18 02:12:29.550639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.288 [2024-11-18 02:12:29.550662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.288 [2024-11-18 02:12:29.550676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.288 [2024-11-18 02:12:29.553019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.288 [2024-11-18 02:12:29.562269] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.288 [2024-11-18 02:12:29.562544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.562656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.562683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.288 [2024-11-18 02:12:29.562699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.288 [2024-11-18 02:12:29.562828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.288 [2024-11-18 02:12:29.563056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.288 [2024-11-18 02:12:29.563076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.288 [2024-11-18 02:12:29.563089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.288 [2024-11-18 02:12:29.565375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.288 [2024-11-18 02:12:29.574504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.288 [2024-11-18 02:12:29.574826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.574953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.574979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.288 [2024-11-18 02:12:29.574995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.288 [2024-11-18 02:12:29.575143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.288 [2024-11-18 02:12:29.575395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.288 [2024-11-18 02:12:29.575417] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.288 [2024-11-18 02:12:29.575432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.288 [2024-11-18 02:12:29.577418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.288 [2024-11-18 02:12:29.578565] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:55.288 [2024-11-18 02:12:29.578648] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:55.288 [2024-11-18 02:12:29.587069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.288 [2024-11-18 02:12:29.587413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.587539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.587565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.288 [2024-11-18 02:12:29.587581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.288 [2024-11-18 02:12:29.587697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.288 [2024-11-18 02:12:29.587916] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.288 [2024-11-18 02:12:29.587935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.288 [2024-11-18 02:12:29.587947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.288 [2024-11-18 02:12:29.590125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.288 [2024-11-18 02:12:29.599222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.288 [2024-11-18 02:12:29.599547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.599661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.599687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.288 [2024-11-18 02:12:29.599709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.288 [2024-11-18 02:12:29.599840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.288 [2024-11-18 02:12:29.600013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.288 [2024-11-18 02:12:29.600032] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.288 [2024-11-18 02:12:29.600044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.288 [2024-11-18 02:12:29.601943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.288 [2024-11-18 02:12:29.611393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.288 [2024-11-18 02:12:29.611808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.611926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.611951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.288 [2024-11-18 02:12:29.611967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.288 [2024-11-18 02:12:29.612112] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.288 [2024-11-18 02:12:29.612284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.288 [2024-11-18 02:12:29.612336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.288 [2024-11-18 02:12:29.612352] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.288 EAL: No free 2048 kB hugepages reported on node 1 00:29:55.288 [2024-11-18 02:12:29.614380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.288 [2024-11-18 02:12:29.623965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.288 [2024-11-18 02:12:29.624263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.624397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.288 [2024-11-18 02:12:29.624423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.288 [2024-11-18 02:12:29.624439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.288 [2024-11-18 02:12:29.624571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.288 [2024-11-18 02:12:29.624755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.288 [2024-11-18 02:12:29.624778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.289 [2024-11-18 02:12:29.624793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.289 [2024-11-18 02:12:29.627115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.289 [2024-11-18 02:12:29.636487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.289 [2024-11-18 02:12:29.636768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.289 [2024-11-18 02:12:29.636871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.289 [2024-11-18 02:12:29.636899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.289 [2024-11-18 02:12:29.636922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.289 [2024-11-18 02:12:29.637069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.289 [2024-11-18 02:12:29.637238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.289 [2024-11-18 02:12:29.637261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.289 [2024-11-18 02:12:29.637276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.289 [2024-11-18 02:12:29.639524] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.289 [2024-11-18 02:12:29.648480] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:55.289 [2024-11-18 02:12:29.649117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.289 [2024-11-18 02:12:29.649480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.289 [2024-11-18 02:12:29.649578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.289 [2024-11-18 02:12:29.649621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.289 [2024-11-18 02:12:29.649639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.289 [2024-11-18 02:12:29.649803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.289 [2024-11-18 02:12:29.649972] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.289 [2024-11-18 02:12:29.649995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.289 [2024-11-18 02:12:29.650009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.289 [2024-11-18 02:12:29.652243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.289 [2024-11-18 02:12:29.661847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.289 [2024-11-18 02:12:29.662339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.289 [2024-11-18 02:12:29.662505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.289 [2024-11-18 02:12:29.662532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.289 [2024-11-18 02:12:29.662551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.289 [2024-11-18 02:12:29.662717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.289 [2024-11-18 02:12:29.662889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.289 [2024-11-18 02:12:29.662913] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.289 [2024-11-18 02:12:29.662931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.289 [2024-11-18 02:12:29.665261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.289 [2024-11-18 02:12:29.674524] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.289 [2024-11-18 02:12:29.674870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.289 [2024-11-18 02:12:29.675012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.289 [2024-11-18 02:12:29.675038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.289 [2024-11-18 02:12:29.675055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.289 [2024-11-18 02:12:29.675212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.289 [2024-11-18 02:12:29.675418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.289 [2024-11-18 02:12:29.675441] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.289 [2024-11-18 02:12:29.675454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.289 [2024-11-18 02:12:29.677748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.289 [2024-11-18 02:12:29.687000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.289 [2024-11-18 02:12:29.687350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.289 [2024-11-18 02:12:29.687518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.289 [2024-11-18 02:12:29.687545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.289 [2024-11-18 02:12:29.687562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.289 [2024-11-18 02:12:29.687739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.289 [2024-11-18 02:12:29.687909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.289 [2024-11-18 02:12:29.687932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.289 [2024-11-18 02:12:29.687948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.550 [2024-11-18 02:12:29.690188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.550 [2024-11-18 02:12:29.699286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.550 [2024-11-18 02:12:29.699671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.550 [2024-11-18 02:12:29.699825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.550 [2024-11-18 02:12:29.699851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.550 [2024-11-18 02:12:29.699869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.550 [2024-11-18 02:12:29.700054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.550 [2024-11-18 02:12:29.700240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.550 [2024-11-18 02:12:29.700264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.550 [2024-11-18 02:12:29.700281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.550 [2024-11-18 02:12:29.702473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.550 [2024-11-18 02:12:29.711834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.550 [2024-11-18 02:12:29.712210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.550 [2024-11-18 02:12:29.712370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.550 [2024-11-18 02:12:29.712397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.550 [2024-11-18 02:12:29.712415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.550 [2024-11-18 02:12:29.712577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.550 [2024-11-18 02:12:29.712801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.550 [2024-11-18 02:12:29.712825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.550 [2024-11-18 02:12:29.712842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.550 [2024-11-18 02:12:29.714920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.550 [2024-11-18 02:12:29.724442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.550 [2024-11-18 02:12:29.724724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.550 [2024-11-18 02:12:29.724888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.550 [2024-11-18 02:12:29.724917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.550 [2024-11-18 02:12:29.724935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.550 [2024-11-18 02:12:29.725154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.550 [2024-11-18 02:12:29.725379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.550 [2024-11-18 02:12:29.725401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.550 [2024-11-18 02:12:29.725413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.550 [2024-11-18 02:12:29.727571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.550 [2024-11-18 02:12:29.736840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.550 [2024-11-18 02:12:29.737133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.550 [2024-11-18 02:12:29.737300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.550 [2024-11-18 02:12:29.737356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.551 [2024-11-18 02:12:29.737374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.551 [2024-11-18 02:12:29.737538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.551 [2024-11-18 02:12:29.737764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.551 [2024-11-18 02:12:29.737788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.551 [2024-11-18 02:12:29.737803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.551 [2024-11-18 02:12:29.738628] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:55.551 [2024-11-18 02:12:29.738743] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:55.551 [2024-11-18 02:12:29.738761] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:55.551 [2024-11-18 02:12:29.738773] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:55.551 [2024-11-18 02:12:29.738831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:55.551 [2024-11-18 02:12:29.738860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:55.551 [2024-11-18 02:12:29.738864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:55.551 [2024-11-18 02:12:29.739821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.551 [2024-11-18 02:12:29.749121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.551 [2024-11-18 02:12:29.749552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.749715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.749743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.551 [2024-11-18 02:12:29.749762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.551 [2024-11-18 02:12:29.749949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.551 [2024-11-18 02:12:29.750113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.551 [2024-11-18 02:12:29.750134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.551 [2024-11-18 02:12:29.750150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.551 [2024-11-18 02:12:29.752095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.551 [2024-11-18 02:12:29.761734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.551 [2024-11-18 02:12:29.762146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.762323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.762350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.551 [2024-11-18 02:12:29.762369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.551 [2024-11-18 02:12:29.762510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.551 [2024-11-18 02:12:29.762724] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.551 [2024-11-18 02:12:29.762744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.551 [2024-11-18 02:12:29.762760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.551 [2024-11-18 02:12:29.764780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.551 [2024-11-18 02:12:29.774189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.551 [2024-11-18 02:12:29.774626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.774765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.774793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.551 [2024-11-18 02:12:29.774812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.551 [2024-11-18 02:12:29.774984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.551 [2024-11-18 02:12:29.775151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.551 [2024-11-18 02:12:29.775172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.551 [2024-11-18 02:12:29.775188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.551 [2024-11-18 02:12:29.777194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.551 [2024-11-18 02:12:29.786760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.551 [2024-11-18 02:12:29.787168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.787324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.787353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.551 [2024-11-18 02:12:29.787382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.551 [2024-11-18 02:12:29.787539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.551 [2024-11-18 02:12:29.787747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.551 [2024-11-18 02:12:29.787767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.551 [2024-11-18 02:12:29.787782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.551 [2024-11-18 02:12:29.789895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.551 [2024-11-18 02:12:29.798910] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.551 [2024-11-18 02:12:29.799187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.799328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.799355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.551 [2024-11-18 02:12:29.799373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.551 [2024-11-18 02:12:29.799558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.551 [2024-11-18 02:12:29.799722] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.551 [2024-11-18 02:12:29.799742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.551 [2024-11-18 02:12:29.799756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.551 [2024-11-18 02:12:29.801883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.551 [2024-11-18 02:12:29.811231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.551 [2024-11-18 02:12:29.811717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.811829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.811856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.551 [2024-11-18 02:12:29.811875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.551 [2024-11-18 02:12:29.812016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.551 [2024-11-18 02:12:29.812211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.551 [2024-11-18 02:12:29.812232] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.551 [2024-11-18 02:12:29.812248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.551 [2024-11-18 02:12:29.814158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.551 [2024-11-18 02:12:29.823470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.551 [2024-11-18 02:12:29.823789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.823947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.823981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.551 [2024-11-18 02:12:29.823998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.551 [2024-11-18 02:12:29.824117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.551 [2024-11-18 02:12:29.824280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.551 [2024-11-18 02:12:29.824321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.551 [2024-11-18 02:12:29.824338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.551 [2024-11-18 02:12:29.826519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.551 [2024-11-18 02:12:29.835607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.551 [2024-11-18 02:12:29.835915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.836018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.836043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.551 [2024-11-18 02:12:29.836060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.551 [2024-11-18 02:12:29.836175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.551 [2024-11-18 02:12:29.836343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.551 [2024-11-18 02:12:29.836365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.551 [2024-11-18 02:12:29.836378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.551 [2024-11-18 02:12:29.838404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.551 [2024-11-18 02:12:29.847836] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.551 [2024-11-18 02:12:29.848175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.848274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.551 [2024-11-18 02:12:29.848301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.551 [2024-11-18 02:12:29.848326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.551 [2024-11-18 02:12:29.848475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.551 [2024-11-18 02:12:29.848656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.551 [2024-11-18 02:12:29.848676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.551 [2024-11-18 02:12:29.848689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.552 [2024-11-18 02:12:29.850819] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.552 [2024-11-18 02:12:29.860168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.552 [2024-11-18 02:12:29.860495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.860597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.860624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.552 [2024-11-18 02:12:29.860645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.552 [2024-11-18 02:12:29.860793] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.552 [2024-11-18 02:12:29.860984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.552 [2024-11-18 02:12:29.861003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.552 [2024-11-18 02:12:29.861016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.552 [2024-11-18 02:12:29.863235] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.552 [2024-11-18 02:12:29.872413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.552 [2024-11-18 02:12:29.872717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.872843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.872869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.552 [2024-11-18 02:12:29.872885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.552 [2024-11-18 02:12:29.873000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.552 [2024-11-18 02:12:29.873162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.552 [2024-11-18 02:12:29.873181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.552 [2024-11-18 02:12:29.873194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.552 [2024-11-18 02:12:29.875234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.552 [2024-11-18 02:12:29.884854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.552 [2024-11-18 02:12:29.885154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.885309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.885341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.552 [2024-11-18 02:12:29.885357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.552 [2024-11-18 02:12:29.885537] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.552 [2024-11-18 02:12:29.885703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.552 [2024-11-18 02:12:29.885722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.552 [2024-11-18 02:12:29.885735] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.552 [2024-11-18 02:12:29.887896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.552 [2024-11-18 02:12:29.897223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.552 [2024-11-18 02:12:29.897502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.897624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.897650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.552 [2024-11-18 02:12:29.897666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.552 [2024-11-18 02:12:29.897803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.552 [2024-11-18 02:12:29.897966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.552 [2024-11-18 02:12:29.897985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.552 [2024-11-18 02:12:29.897997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.552 [2024-11-18 02:12:29.900098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.552 [2024-11-18 02:12:29.909574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.552 [2024-11-18 02:12:29.909817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.909970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.909996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.552 [2024-11-18 02:12:29.910012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.552 [2024-11-18 02:12:29.910161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.552 [2024-11-18 02:12:29.910363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.552 [2024-11-18 02:12:29.910385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.552 [2024-11-18 02:12:29.910398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.552 [2024-11-18 02:12:29.912369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.552 [2024-11-18 02:12:29.921847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.552 [2024-11-18 02:12:29.922204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.922296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.922329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.552 [2024-11-18 02:12:29.922346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.552 [2024-11-18 02:12:29.922493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.552 [2024-11-18 02:12:29.922658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.552 [2024-11-18 02:12:29.922677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.552 [2024-11-18 02:12:29.922690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.552 [2024-11-18 02:12:29.924775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.552 [2024-11-18 02:12:29.934120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.552 [2024-11-18 02:12:29.934423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.934541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.934566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.552 [2024-11-18 02:12:29.934582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.552 [2024-11-18 02:12:29.934730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.552 [2024-11-18 02:12:29.934911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.552 [2024-11-18 02:12:29.934930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.552 [2024-11-18 02:12:29.934943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.552 [2024-11-18 02:12:29.936852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.552 [2024-11-18 02:12:29.946541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.552 [2024-11-18 02:12:29.946863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.946979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.552 [2024-11-18 02:12:29.947005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.552 [2024-11-18 02:12:29.947022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.552 [2024-11-18 02:12:29.947153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.552 [2024-11-18 02:12:29.947353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.552 [2024-11-18 02:12:29.947375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.552 [2024-11-18 02:12:29.947387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.552 [2024-11-18 02:12:29.949580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.815 [2024-11-18 02:12:29.958897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.815 [2024-11-18 02:12:29.959153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.815 [2024-11-18 02:12:29.959240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.815 [2024-11-18 02:12:29.959266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.815 [2024-11-18 02:12:29.959282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.815 [2024-11-18 02:12:29.959454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.815 [2024-11-18 02:12:29.959601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.815 [2024-11-18 02:12:29.959620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.815 [2024-11-18 02:12:29.959633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.815 [2024-11-18 02:12:29.961660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.815 [2024-11-18 02:12:29.971099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.815 [2024-11-18 02:12:29.971436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.815 [2024-11-18 02:12:29.971532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.815 [2024-11-18 02:12:29.971560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.815 [2024-11-18 02:12:29.971576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.815 [2024-11-18 02:12:29.971708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.816 [2024-11-18 02:12:29.971899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.816 [2024-11-18 02:12:29.971924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.816 [2024-11-18 02:12:29.971937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.816 [2024-11-18 02:12:29.974053] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.816 [2024-11-18 02:12:29.983386] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.816 [2024-11-18 02:12:29.983668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:29.983787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:29.983813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.816 [2024-11-18 02:12:29.983829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.816 [2024-11-18 02:12:29.983976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.816 [2024-11-18 02:12:29.984097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.816 [2024-11-18 02:12:29.984132] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.816 [2024-11-18 02:12:29.984145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.816 [2024-11-18 02:12:29.986082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.816 [2024-11-18 02:12:29.995544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.816 [2024-11-18 02:12:29.995820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:29.995940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:29.995965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.816 [2024-11-18 02:12:29.995981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.816 [2024-11-18 02:12:29.996145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.816 [2024-11-18 02:12:29.996345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.816 [2024-11-18 02:12:29.996366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.816 [2024-11-18 02:12:29.996379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.816 [2024-11-18 02:12:29.998505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.816 [2024-11-18 02:12:30.007797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.816 [2024-11-18 02:12:30.008058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.008178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.008205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.816 [2024-11-18 02:12:30.008221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.816 [2024-11-18 02:12:30.008362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.816 [2024-11-18 02:12:30.008547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.816 [2024-11-18 02:12:30.008568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.816 [2024-11-18 02:12:30.008587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.816 [2024-11-18 02:12:30.010759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.816 [2024-11-18 02:12:30.020040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.816 [2024-11-18 02:12:30.020317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.020406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.020434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.816 [2024-11-18 02:12:30.020450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.816 [2024-11-18 02:12:30.020615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.816 [2024-11-18 02:12:30.020780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.816 [2024-11-18 02:12:30.020800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.816 [2024-11-18 02:12:30.020813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.816 [2024-11-18 02:12:30.023017] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.816 [2024-11-18 02:12:30.032571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.816 [2024-11-18 02:12:30.032851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.032970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.032996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.816 [2024-11-18 02:12:30.033012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.816 [2024-11-18 02:12:30.033144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.816 [2024-11-18 02:12:30.033319] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.816 [2024-11-18 02:12:30.033355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.816 [2024-11-18 02:12:30.033369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.816 [2024-11-18 02:12:30.035485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.816 [2024-11-18 02:12:30.044908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.816 [2024-11-18 02:12:30.045291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.045400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.045427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.816 [2024-11-18 02:12:30.045443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.816 [2024-11-18 02:12:30.045623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.816 [2024-11-18 02:12:30.045798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.816 [2024-11-18 02:12:30.045818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.816 [2024-11-18 02:12:30.045831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.816 [2024-11-18 02:12:30.047892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.816 [2024-11-18 02:12:30.057775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.816 [2024-11-18 02:12:30.058045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.058178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.058205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.816 [2024-11-18 02:12:30.058222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.816 [2024-11-18 02:12:30.058362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.816 [2024-11-18 02:12:30.058500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.816 [2024-11-18 02:12:30.058521] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.816 [2024-11-18 02:12:30.058534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.816 [2024-11-18 02:12:30.060669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.816 [2024-11-18 02:12:30.070058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.816 [2024-11-18 02:12:30.070345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.070448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.070475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.816 [2024-11-18 02:12:30.070491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.816 [2024-11-18 02:12:30.070606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.816 [2024-11-18 02:12:30.070775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.816 [2024-11-18 02:12:30.070796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.816 [2024-11-18 02:12:30.070809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.816 [2024-11-18 02:12:30.072880] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.816 [2024-11-18 02:12:30.082608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.816 [2024-11-18 02:12:30.082896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.083020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.816 [2024-11-18 02:12:30.083046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.816 [2024-11-18 02:12:30.083062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.816 [2024-11-18 02:12:30.083258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.816 [2024-11-18 02:12:30.083433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.817 [2024-11-18 02:12:30.083455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.817 [2024-11-18 02:12:30.083469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.817 [2024-11-18 02:12:30.085602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.817 [2024-11-18 02:12:30.094848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.817 [2024-11-18 02:12:30.095111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.095211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.095237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.817 [2024-11-18 02:12:30.095253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.817 [2024-11-18 02:12:30.095427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.817 [2024-11-18 02:12:30.095612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.817 [2024-11-18 02:12:30.095634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.817 [2024-11-18 02:12:30.095647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.817 [2024-11-18 02:12:30.097822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.817 [2024-11-18 02:12:30.107108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.817 [2024-11-18 02:12:30.107390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.107536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.107563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.817 [2024-11-18 02:12:30.107579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.817 [2024-11-18 02:12:30.107711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.817 [2024-11-18 02:12:30.107845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.817 [2024-11-18 02:12:30.107880] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.817 [2024-11-18 02:12:30.107892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.817 [2024-11-18 02:12:30.109988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.817 [2024-11-18 02:12:30.119462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.817 [2024-11-18 02:12:30.119787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.119908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.119934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.817 [2024-11-18 02:12:30.119950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.817 [2024-11-18 02:12:30.120098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.817 [2024-11-18 02:12:30.120259] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.817 [2024-11-18 02:12:30.120279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.817 [2024-11-18 02:12:30.120306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.817 [2024-11-18 02:12:30.122479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.817 [2024-11-18 02:12:30.131838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.817 [2024-11-18 02:12:30.132139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.132275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.132301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.817 [2024-11-18 02:12:30.132325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.817 [2024-11-18 02:12:30.132474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.817 [2024-11-18 02:12:30.132607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.817 [2024-11-18 02:12:30.132627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.817 [2024-11-18 02:12:30.132640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.817 [2024-11-18 02:12:30.134691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.817 [2024-11-18 02:12:30.144073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.817 [2024-11-18 02:12:30.144336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.144454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.144480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.817 [2024-11-18 02:12:30.144496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.817 [2024-11-18 02:12:30.144644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.817 [2024-11-18 02:12:30.144810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.817 [2024-11-18 02:12:30.144830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.817 [2024-11-18 02:12:30.144843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.817 [2024-11-18 02:12:30.146873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.817 [2024-11-18 02:12:30.156466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.817 [2024-11-18 02:12:30.156751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.156845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.156872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.817 [2024-11-18 02:12:30.156888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.817 [2024-11-18 02:12:30.157052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.817 [2024-11-18 02:12:30.157244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.817 [2024-11-18 02:12:30.157264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.817 [2024-11-18 02:12:30.157276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.817 [2024-11-18 02:12:30.159513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.817 [2024-11-18 02:12:30.168852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.817 [2024-11-18 02:12:30.169128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.169210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.169241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.817 [2024-11-18 02:12:30.169258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.817 [2024-11-18 02:12:30.169399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.817 [2024-11-18 02:12:30.169534] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.817 [2024-11-18 02:12:30.169554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.817 [2024-11-18 02:12:30.169567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.817 [2024-11-18 02:12:30.171648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.817 [2024-11-18 02:12:30.181210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.817 [2024-11-18 02:12:30.181454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.181572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.181599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.817 [2024-11-18 02:12:30.181615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.817 [2024-11-18 02:12:30.181810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.817 [2024-11-18 02:12:30.181954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.817 [2024-11-18 02:12:30.181973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.817 [2024-11-18 02:12:30.181985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.817 [2024-11-18 02:12:30.183992] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.817 [2024-11-18 02:12:30.193507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.817 [2024-11-18 02:12:30.193812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.193907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.817 [2024-11-18 02:12:30.193933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.817 [2024-11-18 02:12:30.193949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.817 [2024-11-18 02:12:30.194097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.817 [2024-11-18 02:12:30.194291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.817 [2024-11-18 02:12:30.194318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.817 [2024-11-18 02:12:30.194333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.817 [2024-11-18 02:12:30.196470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:55.818 [2024-11-18 02:12:30.205988] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:55.818 [2024-11-18 02:12:30.206326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.818 [2024-11-18 02:12:30.206421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:55.818 [2024-11-18 02:12:30.206447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:55.818 [2024-11-18 02:12:30.206470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:55.818 [2024-11-18 02:12:30.206636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:55.818 [2024-11-18 02:12:30.206782] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:55.818 [2024-11-18 02:12:30.206802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:55.818 [2024-11-18 02:12:30.206815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:55.818 [2024-11-18 02:12:30.208879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.078 [2024-11-18 02:12:30.218308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.078 [2024-11-18 02:12:30.218615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.078 [2024-11-18 02:12:30.218728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.078 [2024-11-18 02:12:30.218754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.078 [2024-11-18 02:12:30.218770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.078 [2024-11-18 02:12:30.218885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.078 [2024-11-18 02:12:30.219093] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.078 [2024-11-18 02:12:30.219113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.078 [2024-11-18 02:12:30.219126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.078 [2024-11-18 02:12:30.221136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.078 [2024-11-18 02:12:30.230671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.078 [2024-11-18 02:12:30.231035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.078 [2024-11-18 02:12:30.231119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.078 [2024-11-18 02:12:30.231145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.078 [2024-11-18 02:12:30.231161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.078 [2024-11-18 02:12:30.231276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.078 [2024-11-18 02:12:30.231435] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.078 [2024-11-18 02:12:30.231457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.078 [2024-11-18 02:12:30.231471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.078 [2024-11-18 02:12:30.233535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.078 [2024-11-18 02:12:30.242792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.078 [2024-11-18 02:12:30.243126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.078 [2024-11-18 02:12:30.243244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.078 [2024-11-18 02:12:30.243270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.078 [2024-11-18 02:12:30.243286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.078 [2024-11-18 02:12:30.243463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.078 [2024-11-18 02:12:30.243660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.078 [2024-11-18 02:12:30.243694] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.078 [2024-11-18 02:12:30.243707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.078 [2024-11-18 02:12:30.245871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.078 [2024-11-18 02:12:30.254957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.078 [2024-11-18 02:12:30.255222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.078 [2024-11-18 02:12:30.255342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.078 [2024-11-18 02:12:30.255369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.078 [2024-11-18 02:12:30.255385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.078 [2024-11-18 02:12:30.255500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.078 [2024-11-18 02:12:30.255670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.078 [2024-11-18 02:12:30.255705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.078 [2024-11-18 02:12:30.255717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.079 [2024-11-18 02:12:30.257792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.079 [2024-11-18 02:12:30.267256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.079 [2024-11-18 02:12:30.267560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.267706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.267732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.079 [2024-11-18 02:12:30.267748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.079 [2024-11-18 02:12:30.267830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.079 [2024-11-18 02:12:30.268041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.079 [2024-11-18 02:12:30.268061] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.079 [2024-11-18 02:12:30.268074] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.079 [2024-11-18 02:12:30.270023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.079 [2024-11-18 02:12:30.279451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.079 [2024-11-18 02:12:30.279750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.279903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.279929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.079 [2024-11-18 02:12:30.279945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.079 [2024-11-18 02:12:30.280076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.079 [2024-11-18 02:12:30.280264] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.079 [2024-11-18 02:12:30.280284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.079 [2024-11-18 02:12:30.280322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.079 [2024-11-18 02:12:30.282619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.079 [2024-11-18 02:12:30.291610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.079 [2024-11-18 02:12:30.292012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.292105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.292131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.079 [2024-11-18 02:12:30.292147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.079 [2024-11-18 02:12:30.292295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.079 [2024-11-18 02:12:30.292488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.079 [2024-11-18 02:12:30.292510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.079 [2024-11-18 02:12:30.292523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.079 [2024-11-18 02:12:30.294898] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.079 [2024-11-18 02:12:30.303779] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.079 [2024-11-18 02:12:30.304006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.304140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.304166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.079 [2024-11-18 02:12:30.304182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.079 [2024-11-18 02:12:30.304341] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.079 [2024-11-18 02:12:30.304509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.079 [2024-11-18 02:12:30.304530] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.079 [2024-11-18 02:12:30.304544] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.079 [2024-11-18 02:12:30.306639] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.079 [2024-11-18 02:12:30.316102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.079 [2024-11-18 02:12:30.316370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.316465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.316491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.079 [2024-11-18 02:12:30.316507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.079 [2024-11-18 02:12:30.316703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.079 [2024-11-18 02:12:30.316943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.079 [2024-11-18 02:12:30.316970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.079 [2024-11-18 02:12:30.316984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.079 [2024-11-18 02:12:30.318987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.079 [2024-11-18 02:12:30.328317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.079 [2024-11-18 02:12:30.328576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.328665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.328690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.079 [2024-11-18 02:12:30.328706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.079 [2024-11-18 02:12:30.328870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.079 [2024-11-18 02:12:30.329005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.079 [2024-11-18 02:12:30.329025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.079 [2024-11-18 02:12:30.329039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.079 [2024-11-18 02:12:30.331080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.079 [2024-11-18 02:12:30.340685] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.079 [2024-11-18 02:12:30.341044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.341139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.341164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.079 [2024-11-18 02:12:30.341180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.079 [2024-11-18 02:12:30.341353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.079 [2024-11-18 02:12:30.341505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.079 [2024-11-18 02:12:30.341526] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.079 [2024-11-18 02:12:30.341540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.079 [2024-11-18 02:12:30.343822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.079 [2024-11-18 02:12:30.352989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.079 [2024-11-18 02:12:30.353363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.353459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.353486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.079 [2024-11-18 02:12:30.353502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.079 [2024-11-18 02:12:30.353665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.079 [2024-11-18 02:12:30.353838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.079 [2024-11-18 02:12:30.353858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.079 [2024-11-18 02:12:30.353875] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.079 [2024-11-18 02:12:30.356008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.079 [2024-11-18 02:12:30.365138] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.079 [2024-11-18 02:12:30.365449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.365567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.365593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.079 [2024-11-18 02:12:30.365609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.079 [2024-11-18 02:12:30.365725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.079 [2024-11-18 02:12:30.365920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.079 [2024-11-18 02:12:30.365940] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.079 [2024-11-18 02:12:30.365952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.079 [2024-11-18 02:12:30.368082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.079 [2024-11-18 02:12:30.377531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.079 [2024-11-18 02:12:30.377850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.079 [2024-11-18 02:12:30.377970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.377996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.080 [2024-11-18 02:12:30.378012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.080 [2024-11-18 02:12:30.378190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.080 [2024-11-18 02:12:30.378344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.080 [2024-11-18 02:12:30.378365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.080 [2024-11-18 02:12:30.378378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.080 [2024-11-18 02:12:30.380357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.080 [2024-11-18 02:12:30.389844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.080 [2024-11-18 02:12:30.390157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.390286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.390319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.080 [2024-11-18 02:12:30.390337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.080 [2024-11-18 02:12:30.390452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.080 [2024-11-18 02:12:30.390648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.080 [2024-11-18 02:12:30.390668] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.080 [2024-11-18 02:12:30.390680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.080 [2024-11-18 02:12:30.392674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.080 [2024-11-18 02:12:30.402164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.080 [2024-11-18 02:12:30.402501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.402645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.402671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.080 [2024-11-18 02:12:30.402687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.080 [2024-11-18 02:12:30.402819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.080 [2024-11-18 02:12:30.402997] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.080 [2024-11-18 02:12:30.403017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.080 [2024-11-18 02:12:30.403029] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.080 [2024-11-18 02:12:30.405129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.080 [2024-11-18 02:12:30.414268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.080 [2024-11-18 02:12:30.414569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.414711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.414737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.080 [2024-11-18 02:12:30.414754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.080 [2024-11-18 02:12:30.414901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.080 [2024-11-18 02:12:30.415077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.080 [2024-11-18 02:12:30.415097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.080 [2024-11-18 02:12:30.415109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.080 [2024-11-18 02:12:30.417211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.080 [2024-11-18 02:12:30.426537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.080 [2024-11-18 02:12:30.426888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.427030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.427056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.080 [2024-11-18 02:12:30.427072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.080 [2024-11-18 02:12:30.427220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.080 [2024-11-18 02:12:30.427412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.080 [2024-11-18 02:12:30.427434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.080 [2024-11-18 02:12:30.427448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.080 [2024-11-18 02:12:30.429404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.080 [2024-11-18 02:12:30.438856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.080 [2024-11-18 02:12:30.439127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.439273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.439299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.080 [2024-11-18 02:12:30.439323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.080 [2024-11-18 02:12:30.439473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.080 [2024-11-18 02:12:30.439656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.080 [2024-11-18 02:12:30.439691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.080 [2024-11-18 02:12:30.439704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.080 [2024-11-18 02:12:30.441764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.080 [2024-11-18 02:12:30.451100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.080 [2024-11-18 02:12:30.451341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.451461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.451488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.080 [2024-11-18 02:12:30.451504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.080 [2024-11-18 02:12:30.451701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.080 [2024-11-18 02:12:30.451907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.080 [2024-11-18 02:12:30.451927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.080 [2024-11-18 02:12:30.451939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.080 [2024-11-18 02:12:30.454040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.080 [2024-11-18 02:12:30.463400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.080 [2024-11-18 02:12:30.463723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.463836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.463862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.080 [2024-11-18 02:12:30.463878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.080 [2024-11-18 02:12:30.464010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.080 [2024-11-18 02:12:30.464189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.080 [2024-11-18 02:12:30.464208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.080 [2024-11-18 02:12:30.464222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.080 [2024-11-18 02:12:30.466144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.080 [2024-11-18 02:12:30.475598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.080 [2024-11-18 02:12:30.475967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.476111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.080 [2024-11-18 02:12:30.476137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.080 [2024-11-18 02:12:30.476153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.080 [2024-11-18 02:12:30.476327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.080 [2024-11-18 02:12:30.476464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.080 [2024-11-18 02:12:30.476485] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.080 [2024-11-18 02:12:30.476498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.080 [2024-11-18 02:12:30.478707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.340 [2024-11-18 02:12:30.487833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.340 [2024-11-18 02:12:30.488164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.340 [2024-11-18 02:12:30.488243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.340 [2024-11-18 02:12:30.488269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.340 [2024-11-18 02:12:30.488285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.340 [2024-11-18 02:12:30.488506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.340 [2024-11-18 02:12:30.488714] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.340 [2024-11-18 02:12:30.488734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.340 [2024-11-18 02:12:30.488747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.340 [2024-11-18 02:12:30.490820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.340 [2024-11-18 02:12:30.500414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.340 [2024-11-18 02:12:30.500729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.340 [2024-11-18 02:12:30.500810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.340 [2024-11-18 02:12:30.500836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.340 [2024-11-18 02:12:30.500851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.340 [2024-11-18 02:12:30.501015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.340 [2024-11-18 02:12:30.501223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.340 [2024-11-18 02:12:30.501242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.340 [2024-11-18 02:12:30.501255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.340 [2024-11-18 02:12:30.503463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.340 [2024-11-18 02:12:30.512498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.340 [2024-11-18 02:12:30.512887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.340 [2024-11-18 02:12:30.512979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.340 [2024-11-18 02:12:30.513010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.340 [2024-11-18 02:12:30.513027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.340 [2024-11-18 02:12:30.513191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.340 [2024-11-18 02:12:30.513407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.340 [2024-11-18 02:12:30.513429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.340 [2024-11-18 02:12:30.513443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.340 [2024-11-18 02:12:30.515347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.340 [2024-11-18 02:12:30.524495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.340 [2024-11-18 02:12:30.524886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.340 [2024-11-18 02:12:30.525029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.340 [2024-11-18 02:12:30.525056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.341 [2024-11-18 02:12:30.525072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.341 [2024-11-18 02:12:30.525220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.341 [2024-11-18 02:12:30.525396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.341 [2024-11-18 02:12:30.525418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.341 [2024-11-18 02:12:30.525433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.341 [2024-11-18 02:12:30.527376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.341 [2024-11-18 02:12:30.536793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.341 [2024-11-18 02:12:30.537097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.537245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.537271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.341 [2024-11-18 02:12:30.537287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.341 [2024-11-18 02:12:30.537444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.341 [2024-11-18 02:12:30.537581] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.341 [2024-11-18 02:12:30.537602] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.341 [2024-11-18 02:12:30.537629] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.341 [2024-11-18 02:12:30.539701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.341 [2024-11-18 02:12:30.549192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.341 [2024-11-18 02:12:30.549497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.549596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.549622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.341 [2024-11-18 02:12:30.549644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.341 [2024-11-18 02:12:30.549777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.341 [2024-11-18 02:12:30.549955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.341 [2024-11-18 02:12:30.549975] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.341 [2024-11-18 02:12:30.550003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.341 [2024-11-18 02:12:30.552126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.341 [2024-11-18 02:12:30.561530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.341 [2024-11-18 02:12:30.561822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.561944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.561970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.341 [2024-11-18 02:12:30.561986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.341 [2024-11-18 02:12:30.562150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.341 [2024-11-18 02:12:30.562372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.341 [2024-11-18 02:12:30.562394] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.341 [2024-11-18 02:12:30.562407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.341 [2024-11-18 02:12:30.564332] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.341 [2024-11-18 02:12:30.574004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.341 [2024-11-18 02:12:30.574323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.574473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.574499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.341 [2024-11-18 02:12:30.574515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.341 [2024-11-18 02:12:30.574662] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.341 [2024-11-18 02:12:30.574842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.341 [2024-11-18 02:12:30.574863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.341 [2024-11-18 02:12:30.574876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.341 [2024-11-18 02:12:30.577115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.341 02:12:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:56.341 02:12:30 -- common/autotest_common.sh@862 -- # return 0 00:29:56.341 02:12:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:56.341 02:12:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:56.341 02:12:30 -- common/autotest_common.sh@10 -- # set +x 00:29:56.341 [2024-11-18 02:12:30.586274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.341 [2024-11-18 02:12:30.586548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.586668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.586699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.341 [2024-11-18 02:12:30.586715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.341 [2024-11-18 02:12:30.586880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.341 [2024-11-18 02:12:30.587032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.341 [2024-11-18 02:12:30.587053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.341 [2024-11-18 02:12:30.587067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.341 [2024-11-18 02:12:30.589141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.341 [2024-11-18 02:12:30.598515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.341 [2024-11-18 02:12:30.598797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.598895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.598921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.341 [2024-11-18 02:12:30.598938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.341 [2024-11-18 02:12:30.599086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.341 [2024-11-18 02:12:30.599207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.341 [2024-11-18 02:12:30.599228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.341 [2024-11-18 02:12:30.599241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.341 [2024-11-18 02:12:30.601391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.341 02:12:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:56.341 02:12:30 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:56.341 02:12:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:56.341 02:12:30 -- common/autotest_common.sh@10 -- # set +x 00:29:56.341 [2024-11-18 02:12:30.606032] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:56.341 [2024-11-18 02:12:30.610911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.341 [2024-11-18 02:12:30.611237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.611366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.611393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.341 [2024-11-18 02:12:30.611409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.341 [2024-11-18 02:12:30.611574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.341 02:12:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:56.341 [2024-11-18 02:12:30.611726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.341 [2024-11-18 02:12:30.611766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.341 [2024-11-18 02:12:30.611780] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.341 02:12:30 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:56.341 02:12:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:56.341 02:12:30 -- common/autotest_common.sh@10 -- # set +x 00:29:56.341 [2024-11-18 02:12:30.613876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.341 [2024-11-18 02:12:30.623336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.341 [2024-11-18 02:12:30.623614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.623760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.341 [2024-11-18 02:12:30.623786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.341 [2024-11-18 02:12:30.623802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.341 [2024-11-18 02:12:30.623966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.341 [2024-11-18 02:12:30.624168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.341 [2024-11-18 02:12:30.624188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.342 [2024-11-18 02:12:30.624200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.342 [2024-11-18 02:12:30.626371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.342 [2024-11-18 02:12:30.635773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.342 [2024-11-18 02:12:30.636145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.342 [2024-11-18 02:12:30.636301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.342 [2024-11-18 02:12:30.636335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.342 [2024-11-18 02:12:30.636352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.342 [2024-11-18 02:12:30.636504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.342 [2024-11-18 02:12:30.636700] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.342 [2024-11-18 02:12:30.636720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.342 [2024-11-18 02:12:30.636734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.342 [2024-11-18 02:12:30.638822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.342 [2024-11-18 02:12:30.648029] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.342 [2024-11-18 02:12:30.648382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.342 [2024-11-18 02:12:30.648474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.342 [2024-11-18 02:12:30.648500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.342 [2024-11-18 02:12:30.648518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.342 [2024-11-18 02:12:30.648686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.342 [2024-11-18 02:12:30.648854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.342 [2024-11-18 02:12:30.648875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.342 [2024-11-18 02:12:30.648890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.342 Malloc0 00:29:56.342 02:12:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:56.342 [2024-11-18 02:12:30.650942] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.342 02:12:30 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:56.342 02:12:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:56.342 02:12:30 -- common/autotest_common.sh@10 -- # set +x 00:29:56.342 02:12:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:56.342 02:12:30 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:56.342 02:12:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:56.342 02:12:30 -- common/autotest_common.sh@10 -- # set +x 00:29:56.342 [2024-11-18 02:12:30.660444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.342 [2024-11-18 02:12:30.660775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.342 [2024-11-18 02:12:30.660945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.342 [2024-11-18 02:12:30.660971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x128e1d0 with addr=10.0.0.2, port=4420 00:29:56.342 [2024-11-18 02:12:30.660987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x128e1d0 is same with the state(5) to be set 00:29:56.342 [2024-11-18 02:12:30.661136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x128e1d0 (9): Bad file descriptor 00:29:56.342 [2024-11-18 02:12:30.661335] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.342 [2024-11-18 02:12:30.661371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.342 [2024-11-18 02:12:30.661386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.342 [2024-11-18 02:12:30.663659] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.342 02:12:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:56.342 02:12:30 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:56.342 02:12:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:56.342 02:12:30 -- common/autotest_common.sh@10 -- # set +x 00:29:56.342 [2024-11-18 02:12:30.670247] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:56.342 [2024-11-18 02:12:30.672644] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.342 02:12:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:56.342 02:12:30 -- host/bdevperf.sh@38 -- # wait 1332854 00:29:56.342 [2024-11-18 02:12:30.705514] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:06.340 00:30:06.340 Latency(us) 00:30:06.340 [2024-11-18T01:12:40.742Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:06.340 [2024-11-18T01:12:40.742Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:06.340 Verification LBA range: start 0x0 length 0x4000 00:30:06.340 Nvme1n1 : 15.01 9358.42 36.56 16067.96 0.00 5019.39 892.02 19320.98 00:30:06.340 [2024-11-18T01:12:40.742Z] =================================================================================================================== 00:30:06.340 [2024-11-18T01:12:40.742Z] Total : 9358.42 36.56 16067.96 0.00 5019.39 892.02 19320.98 00:30:06.340 02:12:39 -- host/bdevperf.sh@39 -- # sync 00:30:06.340 02:12:39 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:06.340 02:12:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:06.340 02:12:39 -- common/autotest_common.sh@10 -- # set +x 00:30:06.340 02:12:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:06.340 02:12:39 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:06.340 02:12:39 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:06.340 02:12:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:06.340 02:12:39 -- nvmf/common.sh@116 -- # sync 00:30:06.340 02:12:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:06.340 02:12:39 -- nvmf/common.sh@119 -- # set +e 00:30:06.340 02:12:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:06.340 02:12:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:06.340 rmmod nvme_tcp 00:30:06.340 rmmod nvme_fabrics 00:30:06.340 rmmod nvme_keyring 00:30:06.340 02:12:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:06.340 02:12:39 -- nvmf/common.sh@123 -- # set -e 00:30:06.340 02:12:39 -- nvmf/common.sh@124 -- # return 0 00:30:06.340 02:12:39 -- nvmf/common.sh@477 -- # '[' -n 1333657 ']' 00:30:06.340 02:12:39 -- nvmf/common.sh@478 -- # killprocess 1333657 00:30:06.340 02:12:39 -- common/autotest_common.sh@936 -- # '[' -z 1333657 ']' 00:30:06.340 02:12:39 -- common/autotest_common.sh@940 -- # kill -0 1333657 00:30:06.340 02:12:39 -- common/autotest_common.sh@941 -- # uname 00:30:06.340 02:12:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:06.340 02:12:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1333657 00:30:06.340 02:12:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:06.340 02:12:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:06.340 02:12:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1333657' 00:30:06.340 killing process with pid 1333657 00:30:06.340 02:12:39 -- common/autotest_common.sh@955 -- # kill 1333657 00:30:06.340 02:12:39 -- common/autotest_common.sh@960 -- # wait 1333657 00:30:06.340 02:12:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:06.340 02:12:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:06.340 02:12:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:06.340 02:12:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:06.340 02:12:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:06.340 02:12:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:06.340 02:12:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:06.340 02:12:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:07.278 02:12:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:07.278 00:30:07.278 real 0m23.168s 00:30:07.278 user 1m2.430s 00:30:07.278 sys 0m4.384s 00:30:07.278 02:12:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:07.278 02:12:41 -- common/autotest_common.sh@10 -- # set +x 00:30:07.278 ************************************ 00:30:07.278 END TEST nvmf_bdevperf 00:30:07.278 ************************************ 00:30:07.278 02:12:41 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:07.278 02:12:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:07.278 02:12:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:07.278 02:12:41 -- common/autotest_common.sh@10 -- # set +x 00:30:07.278 ************************************ 00:30:07.278 START TEST nvmf_target_disconnect 00:30:07.278 ************************************ 00:30:07.278 02:12:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:07.278 * Looking for test storage... 00:30:07.278 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:07.278 02:12:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:07.278 02:12:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:07.278 02:12:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:07.537 02:12:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:07.537 02:12:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:07.537 02:12:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:07.537 02:12:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:07.537 02:12:41 -- scripts/common.sh@335 -- # IFS=.-: 00:30:07.537 02:12:41 -- scripts/common.sh@335 -- # read -ra ver1 00:30:07.537 02:12:41 -- scripts/common.sh@336 -- # IFS=.-: 00:30:07.537 02:12:41 -- scripts/common.sh@336 -- # read -ra ver2 00:30:07.537 02:12:41 -- scripts/common.sh@337 -- # local 'op=<' 00:30:07.537 02:12:41 -- scripts/common.sh@339 -- # ver1_l=2 00:30:07.537 02:12:41 -- scripts/common.sh@340 -- # ver2_l=1 00:30:07.537 02:12:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:07.537 02:12:41 -- scripts/common.sh@343 -- # case "$op" in 00:30:07.537 02:12:41 -- scripts/common.sh@344 -- # : 1 00:30:07.537 02:12:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:07.537 02:12:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:07.537 02:12:41 -- scripts/common.sh@364 -- # decimal 1 00:30:07.537 02:12:41 -- scripts/common.sh@352 -- # local d=1 00:30:07.537 02:12:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:07.537 02:12:41 -- scripts/common.sh@354 -- # echo 1 00:30:07.537 02:12:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:07.537 02:12:41 -- scripts/common.sh@365 -- # decimal 2 00:30:07.537 02:12:41 -- scripts/common.sh@352 -- # local d=2 00:30:07.537 02:12:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:07.537 02:12:41 -- scripts/common.sh@354 -- # echo 2 00:30:07.537 02:12:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:07.537 02:12:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:07.537 02:12:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:07.537 02:12:41 -- scripts/common.sh@367 -- # return 0 00:30:07.537 02:12:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:07.537 02:12:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:07.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:07.537 --rc genhtml_branch_coverage=1 00:30:07.537 --rc genhtml_function_coverage=1 00:30:07.537 --rc genhtml_legend=1 00:30:07.537 --rc geninfo_all_blocks=1 00:30:07.537 --rc geninfo_unexecuted_blocks=1 00:30:07.537 00:30:07.537 ' 00:30:07.537 02:12:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:07.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:07.537 --rc genhtml_branch_coverage=1 00:30:07.537 --rc genhtml_function_coverage=1 00:30:07.537 --rc genhtml_legend=1 00:30:07.537 --rc geninfo_all_blocks=1 00:30:07.537 --rc geninfo_unexecuted_blocks=1 00:30:07.537 00:30:07.537 ' 00:30:07.537 02:12:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:07.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:07.538 --rc genhtml_branch_coverage=1 00:30:07.538 --rc genhtml_function_coverage=1 00:30:07.538 --rc genhtml_legend=1 00:30:07.538 --rc geninfo_all_blocks=1 00:30:07.538 --rc geninfo_unexecuted_blocks=1 00:30:07.538 00:30:07.538 ' 00:30:07.538 02:12:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:07.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:07.538 --rc genhtml_branch_coverage=1 00:30:07.538 --rc genhtml_function_coverage=1 00:30:07.538 --rc genhtml_legend=1 00:30:07.538 --rc geninfo_all_blocks=1 00:30:07.538 --rc geninfo_unexecuted_blocks=1 00:30:07.538 00:30:07.538 ' 00:30:07.538 02:12:41 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:07.538 02:12:41 -- nvmf/common.sh@7 -- # uname -s 00:30:07.538 02:12:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:07.538 02:12:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:07.538 02:12:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:07.538 02:12:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:07.538 02:12:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:07.538 02:12:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:07.538 02:12:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:07.538 02:12:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:07.538 02:12:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:07.538 02:12:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:07.538 02:12:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:07.538 02:12:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:07.538 02:12:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:07.538 02:12:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:07.538 02:12:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:07.538 02:12:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:07.538 02:12:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:07.538 02:12:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:07.538 02:12:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:07.538 02:12:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:07.538 02:12:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:07.538 02:12:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:07.538 02:12:41 -- paths/export.sh@5 -- # export PATH 00:30:07.538 02:12:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:07.538 02:12:41 -- nvmf/common.sh@46 -- # : 0 00:30:07.538 02:12:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:07.538 02:12:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:07.538 02:12:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:07.538 02:12:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:07.538 02:12:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:07.538 02:12:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:07.538 02:12:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:07.538 02:12:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:07.538 02:12:41 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:07.538 02:12:41 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:07.538 02:12:41 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:07.538 02:12:41 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:07.538 02:12:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:07.538 02:12:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:07.538 02:12:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:07.538 02:12:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:07.538 02:12:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:07.538 02:12:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:07.538 02:12:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:07.538 02:12:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:07.538 02:12:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:07.538 02:12:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:07.538 02:12:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:07.538 02:12:41 -- common/autotest_common.sh@10 -- # set +x 00:30:10.079 02:12:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:10.079 02:12:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:10.079 02:12:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:10.079 02:12:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:10.079 02:12:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:10.079 02:12:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:10.079 02:12:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:10.079 02:12:43 -- nvmf/common.sh@294 -- # net_devs=() 00:30:10.079 02:12:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:10.079 02:12:43 -- nvmf/common.sh@295 -- # e810=() 00:30:10.079 02:12:43 -- nvmf/common.sh@295 -- # local -ga e810 00:30:10.079 02:12:43 -- nvmf/common.sh@296 -- # x722=() 00:30:10.079 02:12:43 -- nvmf/common.sh@296 -- # local -ga x722 00:30:10.079 02:12:43 -- nvmf/common.sh@297 -- # mlx=() 00:30:10.079 02:12:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:10.079 02:12:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:10.079 02:12:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:10.079 02:12:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:10.079 02:12:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:10.079 02:12:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:10.079 02:12:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:10.079 02:12:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:10.079 02:12:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:10.079 02:12:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:10.079 02:12:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:10.079 02:12:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:10.079 02:12:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:10.079 02:12:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:10.079 02:12:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:10.079 02:12:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:10.079 02:12:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:10.079 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:10.079 02:12:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:10.079 02:12:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:10.079 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:10.079 02:12:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:10.079 02:12:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:10.079 02:12:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:10.079 02:12:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:10.079 02:12:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:10.079 02:12:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:10.079 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:10.079 02:12:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:10.079 02:12:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:10.079 02:12:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:10.079 02:12:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:10.079 02:12:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:10.079 02:12:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:10.079 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:10.079 02:12:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:10.079 02:12:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:10.079 02:12:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:10.079 02:12:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:10.079 02:12:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:10.079 02:12:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:10.079 02:12:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:10.079 02:12:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:10.079 02:12:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:10.079 02:12:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:10.079 02:12:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:10.079 02:12:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:10.079 02:12:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:10.079 02:12:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:10.079 02:12:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:10.079 02:12:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:10.079 02:12:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:10.079 02:12:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:10.079 02:12:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:10.079 02:12:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:10.079 02:12:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:10.079 02:12:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:10.079 02:12:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:10.079 02:12:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:10.079 02:12:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:10.079 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:10.079 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.202 ms 00:30:10.079 00:30:10.079 --- 10.0.0.2 ping statistics --- 00:30:10.079 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:10.079 rtt min/avg/max/mdev = 0.202/0.202/0.202/0.000 ms 00:30:10.079 02:12:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:10.079 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:10.079 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.128 ms 00:30:10.079 00:30:10.080 --- 10.0.0.1 ping statistics --- 00:30:10.080 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:10.080 rtt min/avg/max/mdev = 0.128/0.128/0.128/0.000 ms 00:30:10.080 02:12:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:10.080 02:12:43 -- nvmf/common.sh@410 -- # return 0 00:30:10.080 02:12:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:10.080 02:12:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:10.080 02:12:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:10.080 02:12:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:10.080 02:12:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:10.080 02:12:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:10.080 02:12:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:10.080 02:12:43 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:10.080 02:12:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:10.080 02:12:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:10.080 02:12:43 -- common/autotest_common.sh@10 -- # set +x 00:30:10.080 ************************************ 00:30:10.080 START TEST nvmf_target_disconnect_tc1 00:30:10.080 ************************************ 00:30:10.080 02:12:44 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:10.080 02:12:44 -- host/target_disconnect.sh@32 -- # set +e 00:30:10.080 02:12:44 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:10.080 EAL: No free 2048 kB hugepages reported on node 1 00:30:10.080 [2024-11-18 02:12:44.086199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.080 [2024-11-18 02:12:44.086377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.080 [2024-11-18 02:12:44.086415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1231270 with addr=10.0.0.2, port=4420 00:30:10.080 [2024-11-18 02:12:44.086449] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:10.080 [2024-11-18 02:12:44.086473] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:10.080 [2024-11-18 02:12:44.086488] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:10.080 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:10.080 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:10.080 Initializing NVMe Controllers 00:30:10.080 02:12:44 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:10.080 02:12:44 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:10.080 02:12:44 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:10.080 02:12:44 -- common/autotest_common.sh@1142 -- # return 0 00:30:10.080 02:12:44 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:10.080 02:12:44 -- host/target_disconnect.sh@41 -- # set -e 00:30:10.080 00:30:10.080 real 0m0.091s 00:30:10.080 user 0m0.036s 00:30:10.080 sys 0m0.055s 00:30:10.080 02:12:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:10.080 02:12:44 -- common/autotest_common.sh@10 -- # set +x 00:30:10.080 ************************************ 00:30:10.080 END TEST nvmf_target_disconnect_tc1 00:30:10.080 ************************************ 00:30:10.080 02:12:44 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:10.080 02:12:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:10.080 02:12:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:10.080 02:12:44 -- common/autotest_common.sh@10 -- # set +x 00:30:10.080 ************************************ 00:30:10.080 START TEST nvmf_target_disconnect_tc2 00:30:10.080 ************************************ 00:30:10.080 02:12:44 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:10.080 02:12:44 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:10.080 02:12:44 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:10.080 02:12:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:10.080 02:12:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:10.080 02:12:44 -- common/autotest_common.sh@10 -- # set +x 00:30:10.080 02:12:44 -- nvmf/common.sh@469 -- # nvmfpid=1336754 00:30:10.080 02:12:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:10.080 02:12:44 -- nvmf/common.sh@470 -- # waitforlisten 1336754 00:30:10.080 02:12:44 -- common/autotest_common.sh@829 -- # '[' -z 1336754 ']' 00:30:10.080 02:12:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:10.080 02:12:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:10.080 02:12:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:10.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:10.080 02:12:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:10.080 02:12:44 -- common/autotest_common.sh@10 -- # set +x 00:30:10.080 [2024-11-18 02:12:44.173886] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:10.080 [2024-11-18 02:12:44.173988] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:10.080 EAL: No free 2048 kB hugepages reported on node 1 00:30:10.080 [2024-11-18 02:12:44.242801] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:10.080 [2024-11-18 02:12:44.330306] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:10.080 [2024-11-18 02:12:44.330470] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:10.080 [2024-11-18 02:12:44.330488] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:10.080 [2024-11-18 02:12:44.330502] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:10.080 [2024-11-18 02:12:44.330711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:10.080 [2024-11-18 02:12:44.330774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:10.080 [2024-11-18 02:12:44.330842] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:10.080 [2024-11-18 02:12:44.330845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:11.050 02:12:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:11.050 02:12:45 -- common/autotest_common.sh@862 -- # return 0 00:30:11.050 02:12:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:11.050 02:12:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:11.050 02:12:45 -- common/autotest_common.sh@10 -- # set +x 00:30:11.050 02:12:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:11.050 02:12:45 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:11.050 02:12:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.050 02:12:45 -- common/autotest_common.sh@10 -- # set +x 00:30:11.050 Malloc0 00:30:11.050 02:12:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.050 02:12:45 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:11.050 02:12:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.050 02:12:45 -- common/autotest_common.sh@10 -- # set +x 00:30:11.050 [2024-11-18 02:12:45.248764] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:11.050 02:12:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.050 02:12:45 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:11.050 02:12:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.050 02:12:45 -- common/autotest_common.sh@10 -- # set +x 00:30:11.050 02:12:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.050 02:12:45 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:11.050 02:12:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.050 02:12:45 -- common/autotest_common.sh@10 -- # set +x 00:30:11.050 02:12:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.050 02:12:45 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:11.050 02:12:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.050 02:12:45 -- common/autotest_common.sh@10 -- # set +x 00:30:11.050 [2024-11-18 02:12:45.277044] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:11.050 02:12:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.050 02:12:45 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:11.050 02:12:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.050 02:12:45 -- common/autotest_common.sh@10 -- # set +x 00:30:11.050 02:12:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.050 02:12:45 -- host/target_disconnect.sh@50 -- # reconnectpid=1336912 00:30:11.050 02:12:45 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:11.050 02:12:45 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:11.050 EAL: No free 2048 kB hugepages reported on node 1 00:30:12.963 02:12:47 -- host/target_disconnect.sh@53 -- # kill -9 1336754 00:30:12.963 02:12:47 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 [2024-11-18 02:12:47.303193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 [2024-11-18 02:12:47.303499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Write completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 [2024-11-18 02:12:47.303776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.963 starting I/O failed 00:30:12.963 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Write completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Write completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Write completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Write completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Write completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Write completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Write completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Write completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Write completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Write completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Write completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Write completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 Read completed with error (sct=0, sc=8) 00:30:12.964 starting I/O failed 00:30:12.964 [2024-11-18 02:12:47.304095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:12.964 [2024-11-18 02:12:47.304268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.304398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.304428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.304548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.304652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.304678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.304797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.304913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.304940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.305027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.305116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.305142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.305225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.305300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.305332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.305439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.305533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.305559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.305699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.305788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.305815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.305906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.306019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.306049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.306214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.306336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.306363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.306469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.306582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.306608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.306689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.306806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.306832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.306907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.307064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.307107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.307238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.307324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.307351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.307442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.307551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.307577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.307661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.307784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.307811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.307944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.308077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.308107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.308198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.308292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.308342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.308433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.308520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.308546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.308748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.308853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.308883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.309021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.309141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.309166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.964 qpair failed and we were unable to recover it. 00:30:12.964 [2024-11-18 02:12:47.309282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.964 [2024-11-18 02:12:47.309379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.309406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.309522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.309664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.309690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.309835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.309976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.310002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.310141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.310225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.310251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.310347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.310468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.310494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.310573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.310691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.310718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.310831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.310907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.310933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.311048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.311132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.311157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.311332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.311475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.311501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.311608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.311701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.311730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.311880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.312012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.312039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.312186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.312292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.312324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.312436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.312530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.312556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.312642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.312751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.312776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.312856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.313002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.313028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.313213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.313331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.313369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.313449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.313539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.313566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.313682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.313804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.313830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.313949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.314029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.314055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.314145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.314265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.314290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.314485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.314608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.314640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.314760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.314906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.314932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.315040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.315134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.315159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.315234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.315328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.315354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.315437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.315510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.315536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.315619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.315727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.315764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.315870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.315954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.315981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.316060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.316175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.316200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.965 qpair failed and we were unable to recover it. 00:30:12.965 [2024-11-18 02:12:47.316376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.965 [2024-11-18 02:12:47.316500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.316526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.316666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.316789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.316817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.316955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.317043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.317068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.317158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.317237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.317262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.317359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.317479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.317505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.317645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.317755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.317780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.317918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.318037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.318062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.318189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.318278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.318335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.318486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.318600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.318626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.318727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.318847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.318873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.318984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.319095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.319121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.319200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.319318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.319345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.319459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.319540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.319565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.319647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.319790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.319816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.319960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.320043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.320070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.320188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.320268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.320309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.320476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.320599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.320624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.320711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.320852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.320877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.320977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.321068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.321094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.321236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.321359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.321385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.321468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.321559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.321584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.321668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.321745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.321770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.321851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.321984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.322013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.322125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.322235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.322261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.322349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.322466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.322492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.322578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.322686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.322712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.322818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.322928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.322953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.323033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.323173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.323198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.323330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.323431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.966 [2024-11-18 02:12:47.323460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.966 qpair failed and we were unable to recover it. 00:30:12.966 [2024-11-18 02:12:47.323580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.323695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.323721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.323866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.323957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.323984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.324125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.324214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.324240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.324358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.324439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.324466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.324585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.324726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.324752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.324898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.325025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.325050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.325171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.325286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.325318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.325478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.325593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.325619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.325760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.325876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.325901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.326044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.326167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.326194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.326286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.326443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.326470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.326560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.326681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.326709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.326857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.326941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.326967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.327053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.327163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.327189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.327275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.327403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.327430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.327546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.327661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.327688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.327830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.327914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.327940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.328019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.328103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.328129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.328250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.328361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.328388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.328474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.328608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.328634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.328747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.328859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.328885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.328998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.329091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.329118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.329233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.329378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.967 [2024-11-18 02:12:47.329404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.967 qpair failed and we were unable to recover it. 00:30:12.967 [2024-11-18 02:12:47.329522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.329637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.329662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.329749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.329828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.329855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.329941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.330082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.330107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.330249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.330339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.330366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.330506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.330613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.330639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.330753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.330840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.330865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.330973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.331084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.331110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.331251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.331367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.331393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.331479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.331623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.331648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.331760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.331845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.331871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.332014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.332156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.332182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.332264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.332379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.332407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.332525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.332666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.332691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.332805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.332922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.332948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.333065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.333145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.333171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.333262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.333356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.333383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.333500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.333619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.333645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.333757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.333876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.333902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.334021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.334135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.334162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.334268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.334394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.334421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.334503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.334616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.334642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.334785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.334871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.334897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.335013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.335153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.335178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.335288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.335385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.335412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.335528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.335612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.335638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.335753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.335872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.335898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.336011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.336126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.336156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.336269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.336356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.336383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.968 qpair failed and we were unable to recover it. 00:30:12.968 [2024-11-18 02:12:47.336464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.968 [2024-11-18 02:12:47.336579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.336606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.336691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.336803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.336829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.336912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.337000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.337027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.337114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.337221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.337247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.337355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.337437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.337464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.337551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.337691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.337717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.337830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.337939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.337965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.338079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.338189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.338214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.338335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.338419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.338449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.338556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.338674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.338700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.338810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.338914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.338941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.339076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.339161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.339187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.339295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.339399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.339426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.339545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.339635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.339661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.339748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.339825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.339851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.339963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.340044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.340068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.340148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.340287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.340320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.340415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.340497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.340524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.340644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.340755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.340785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.340902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.340984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.341009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.341094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.341202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.341228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.341336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.341457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.341483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.341595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.341711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.341737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.341823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.341937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.341964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.342104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.342220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.342246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.342342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.342488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.342514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.342654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.342766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.342791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.342874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.342984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.343010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.969 [2024-11-18 02:12:47.343090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.343202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.969 [2024-11-18 02:12:47.343231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.969 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.343328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.343470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.343496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.343607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.343729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.343755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.343864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.343975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.344001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.344086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.344193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.344219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.344296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.344417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.344444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.344520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.344602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.344627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.344769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.344885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.344911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.345024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.345142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.345168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.345244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.345358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.345384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.345523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.345669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.345695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.345822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.345932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.345958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.346043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.346155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.346182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.346293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.346385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.346411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.346497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.346605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.346631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.346718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.346864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.346890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.346972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.347060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.347087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.347198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.347327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.347355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.347473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.347562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.347587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.347695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.347806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.347833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.347949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.348058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.348083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.348171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.348252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.348278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.348402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.348514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.348541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.348659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.348766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.348792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.348900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.349009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.349034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.349147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.349247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.349288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.349410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.349552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.349578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.349692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.349805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.349833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.349926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.350027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.350055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.970 qpair failed and we were unable to recover it. 00:30:12.970 [2024-11-18 02:12:47.350193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.970 [2024-11-18 02:12:47.350276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.350302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.350397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.350519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.350561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.350691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.350824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.350850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.350931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.351042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.351068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.351174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.351287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.351322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.351431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.351591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.351620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.351788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.351902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.351927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.352037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.352199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.352228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.352361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.352466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.352491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.352593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.352704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.352730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.352845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.352986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.353011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.353117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.353229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.353254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.353374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.353464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.353490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.353581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.353692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.353723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.353846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.354015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.354040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.354167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.354306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.354339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.354452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.354532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.354558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.354651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.354787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.354813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.354930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.355007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.355033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.355120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.355224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.355249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.355385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.355552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.355581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.355690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.355799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.355824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.355967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.356050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.356075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.356192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.356299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.356350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.356463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.356552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.356578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.356699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.356788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.356812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.356896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.356978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.357003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.357084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.357199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.357225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.971 qpair failed and we were unable to recover it. 00:30:12.971 [2024-11-18 02:12:47.357336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.357427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.971 [2024-11-18 02:12:47.357453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.972 qpair failed and we were unable to recover it. 00:30:12.972 [2024-11-18 02:12:47.357570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.357685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.357710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.972 qpair failed and we were unable to recover it. 00:30:12.972 [2024-11-18 02:12:47.357820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.357936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.357961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.972 qpair failed and we were unable to recover it. 00:30:12.972 [2024-11-18 02:12:47.358071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.358152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.358177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.972 qpair failed and we were unable to recover it. 00:30:12.972 [2024-11-18 02:12:47.358266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.358389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.358415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.972 qpair failed and we were unable to recover it. 00:30:12.972 [2024-11-18 02:12:47.358530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.358643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.358668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.972 qpair failed and we were unable to recover it. 00:30:12.972 [2024-11-18 02:12:47.358779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.358901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.358926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:12.972 qpair failed and we were unable to recover it. 00:30:12.972 [2024-11-18 02:12:47.359007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:12.972 [2024-11-18 02:12:47.359116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.258 [2024-11-18 02:12:47.359158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.258 qpair failed and we were unable to recover it. 00:30:13.258 [2024-11-18 02:12:47.359279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.258 [2024-11-18 02:12:47.359387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.258 [2024-11-18 02:12:47.359413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.258 qpair failed and we were unable to recover it. 00:30:13.258 [2024-11-18 02:12:47.359565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.258 [2024-11-18 02:12:47.359703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.258 [2024-11-18 02:12:47.359728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.258 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.359837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.359937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.359966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.360094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.360188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.360214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.360351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.360469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.360494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.360610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.360760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.360785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.360927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.361012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.361038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.361168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.361262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.361292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.361439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.361549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.361575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.361718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.361831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.361855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.361937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.362074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.362099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.362224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.362374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.362405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.362541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.362653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.362679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.362798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.362879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.362905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.363085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.363189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.363215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.363298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.363420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.363446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.363541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.363681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.363708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.363822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.363929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.363955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.364058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.364171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.364197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.364319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.364431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.364457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.364531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.364648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.364676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.364787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.364902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.364929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.365046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.365136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.365163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.365278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.365398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.365424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.365539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.365650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.365676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.365813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.365929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.365955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.366073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.366170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.366196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.366320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.366411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.366437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.366550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.366638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.366664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.259 [2024-11-18 02:12:47.366742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.366884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.259 [2024-11-18 02:12:47.366909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.259 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.367022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.367110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.367137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.367251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.367360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.367388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.367504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.367620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.367646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.367760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.367843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.367868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.367979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.368069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.368094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.368234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.368325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.368352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.368472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.368592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.368619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.368732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.368822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.368848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.368955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.369107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.369132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.369246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.369356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.369383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.369471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.369582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.369608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.369749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.369834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.369859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.369998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.370107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.370132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.370227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.370340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.370368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.370488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.370603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.370629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.370743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.370859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.370885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.370994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.371108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.371135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.371214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.371336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.371362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.371477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.371586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.371613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.371754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.371861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.371887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.372000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.372110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.372137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.372256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.372372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.372399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.372510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.372592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.372617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.372707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.372818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.372843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.372954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.373067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.373092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.373185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.373328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.373354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.373466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.373541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.373571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.373697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.373788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.260 [2024-11-18 02:12:47.373814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.260 qpair failed and we were unable to recover it. 00:30:13.260 [2024-11-18 02:12:47.373956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.374070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.374095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.374203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.374282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.374315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.374401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.374548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.374574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.374689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.374767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.374793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.374880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.374963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.374988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.375102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.375213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.375238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.375349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.375458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.375484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.375625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.375707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.375732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.375812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.375949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.375978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.376097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.376211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.376237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.376328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.376435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.376460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.376542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.376650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.376676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.376785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.376925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.376950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.377034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.377168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.377196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.377333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.377445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.377471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.377559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.377677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.377702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.377795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.377962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.377989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.378119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.378208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.378250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.378386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.378505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.378535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.378679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.378788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.378816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.378972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.379076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.379102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.379218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.379341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.379367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.379458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.379541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.379566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.379647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.379783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.379809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.379895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.380011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.380036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.261 [2024-11-18 02:12:47.380169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.380293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.261 [2024-11-18 02:12:47.380332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.261 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.380472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.380582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.380607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.380696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.380779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.380803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.380938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.381064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.381109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.381251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.381340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.381367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.381482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.381622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.381647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.381731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.381908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.381933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.382073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.382187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.382213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.382300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.382423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.382448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.382527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.382689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.382717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.382872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.382967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.382992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.383109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.383250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.383275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.383389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.383502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.383527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.383669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.383805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.383831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.383958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.384092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.384117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.384257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.384345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.384372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.384455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.384540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.384566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.384684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.384772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.384796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.384936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.385037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.385061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.385143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.385233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.385258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.385344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.385472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.385501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.385594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.385725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.385752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.385895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.386001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.386026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.386117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.386260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.386286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.386426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.386512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.386541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.386672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.386797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.386822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.262 qpair failed and we were unable to recover it. 00:30:13.262 [2024-11-18 02:12:47.386953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.262 [2024-11-18 02:12:47.387078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.387105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.387265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.387407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.387434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.387575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.387714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.387739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.387820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.387928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.387954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.388042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.388164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.388190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.388300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.388450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.388476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.388561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.388656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.388681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.388839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.388965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.388995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.389109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.389224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.389250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.389337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.389418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.389443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.389578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.389736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.389765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.389901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.390028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.390054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.390192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.390298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.390331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.390458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.390573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.390598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.390710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.390828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.390853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.390936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.391067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.391098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.391227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.391364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.391390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.391503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.391621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.391646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.391761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.391849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.391890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.392024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.392193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.392217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.392308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.392452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.392477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.392594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.392711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.392736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.392824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.392944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.392970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.263 qpair failed and we were unable to recover it. 00:30:13.263 [2024-11-18 02:12:47.393083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.263 [2024-11-18 02:12:47.393197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.393222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.393368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.393482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.393508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.393663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.393805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.393833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.393999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.394116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.394142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.394228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.394322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.394348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.394496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.394636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.394661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.394751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.394859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.394884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.394970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.395094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.395119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.395252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.395350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.395379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.395537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.395652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.395677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.395831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.395919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.395945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.396064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.396149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.396176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.396322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.396431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.396456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.396563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.396690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.396718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.396814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.396942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.396981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.397096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.397211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.397237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.397322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.397462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.397502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.397593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.397709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.397735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.397820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.397910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.397935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.398055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.398141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.398169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.398263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.398376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.398402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.398515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.398604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.398630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.398727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.398810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.398834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.398946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.399023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.399048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.399164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.399275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.399300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.399459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.399547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.399572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.264 qpair failed and we were unable to recover it. 00:30:13.264 [2024-11-18 02:12:47.399687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.264 [2024-11-18 02:12:47.399778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.399805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.399889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.400024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.400049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.400162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.400319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.400345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.400434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.400557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.400582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.400691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.400800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.400826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.400940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.401066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.401094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.401241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.401366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.401396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.401562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.401703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.401728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.401813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.401912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.401938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.402055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.402172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.402198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.402321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.402439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.402466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.402576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.402687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.402713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.402827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.402941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.402986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.403091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.403200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.403226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.403347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.403439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.403465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.403591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.403710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.403739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.403873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.403991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.404017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.404136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.404307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.404344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.404497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.404639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.404664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.404776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.404886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.404911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.405031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.405115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.405141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.405257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.405341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.405367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.405481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.405571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.405597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.405678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.405811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.405840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.405969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.406066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.406094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.406228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.406341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.406368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.406487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.406640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.406668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.265 [2024-11-18 02:12:47.406830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.406954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.265 [2024-11-18 02:12:47.406981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.265 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.407140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.407230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.407256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.407382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.407514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.407543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.407675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.407786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.407813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.407924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.408029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.408055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.408197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.408326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.408357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.408512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.408609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.408638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.408797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.408919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.408946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.409053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.409163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.409189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.409279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.409367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.409393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.409509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.409654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.409679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.409761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.409875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.409900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.409989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.410098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.410124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.410231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.410339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.410366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.410482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.410570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.410596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.410714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.410826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.410852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.410969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.411079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.411105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.411216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.411337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.411364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.411505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.411600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.411627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.411746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.411856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.411883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.412001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.412079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.412105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.412219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.412334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.412359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.412471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.412581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.412606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.412720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.412802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.412827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.412938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.413028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.413053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.413171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.413283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.266 [2024-11-18 02:12:47.413308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.266 qpair failed and we were unable to recover it. 00:30:13.266 [2024-11-18 02:12:47.413430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.413568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.413593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.413723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.413815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.413843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.413996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.414112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.414136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.414274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.414436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.414466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.414559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.414653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.414682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.414828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.414967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.414993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.415104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.415247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.415296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.415436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.415537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.415564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.415695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.415783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.415808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.415899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.416014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.416039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.416125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.416272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.416297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.416388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.416476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.416501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.416617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.416750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.416779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.416944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.417056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.417081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.417193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.417342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.417368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.417454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.417568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.417596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.417712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.417802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.417836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.417974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.418085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.418111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.418201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.418364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.418393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.418492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.418614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.418642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.418773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.418887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.418912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.418991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.419128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.419153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.419244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.419360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.419387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.419501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.419615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.419640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.419753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.419868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.419894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.419984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.420125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.420152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.420265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.420364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.420396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.267 [2024-11-18 02:12:47.420534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.420677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.267 [2024-11-18 02:12:47.420702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.267 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.420818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.420935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.420962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.421053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.421171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.421197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.421287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.421380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.421405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.421519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.421625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.421650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.421762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.421874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.421899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.422011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.422120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.422146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.422261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.422358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.422386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.422529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.422671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.422697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.422836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.422922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.422955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.423071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.423179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.423205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.423287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.423421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.423448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.423538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.423613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.423638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.423720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.423800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.423827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.423909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.424029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.424055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.424171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.424281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.424306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.424453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.424563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.424589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.424733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.424874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.424900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.425007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.425148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.425174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.425286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.425369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.425395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.425490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.425573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.425597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.425691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.425833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.425860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.425974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.426060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.426086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.426200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.426308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.426342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.268 qpair failed and we were unable to recover it. 00:30:13.268 [2024-11-18 02:12:47.426460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.268 [2024-11-18 02:12:47.426568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.426594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.426708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.426847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.426873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.426983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.427065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.427091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.427178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.427344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.427371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.427478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.427616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.427642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.427753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.427891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.427917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.428061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.428173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.428199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.428308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.428426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.428453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.428537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.428648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.428673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.428809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.428896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.428938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.429081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.429187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.429214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.429325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.429409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.429434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.429548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.429631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.429656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.429735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.429848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.429874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.429982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.430094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.430119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.430261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.430349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.430395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.430556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.430678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.430706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.430809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.430923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.430948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.431036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.431120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.431145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.431256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.431387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.431418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.431548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.431686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.431712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.431802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.431909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.431934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.432044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.432185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.432214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.432323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.432464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.432490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.432597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.432687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.432712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.432802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.432941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.432966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.433053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.433165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.433191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.433266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.433391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.433421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.269 qpair failed and we were unable to recover it. 00:30:13.269 [2024-11-18 02:12:47.433542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.433712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.269 [2024-11-18 02:12:47.433737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.433851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.433931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.433956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.434076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.434163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.434189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.434274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.434389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.434416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.434525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.434638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.434664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.434756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.434866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.434907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.435027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.435116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.435141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.435277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.435362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.435389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.435529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.435621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.435646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.435782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.435900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.435927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.436047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.436133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.436159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.436245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.436332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.436358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.436522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.436636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.436664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.436786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.436897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.436921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.437035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.437143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.437168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.437290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.437452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.437481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.437615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.437757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.437782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.437915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.438010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.438035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.438162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.438275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.438300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.438426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.438544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.438569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.438653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.438744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.438769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.438856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.438976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.439001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.439108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.439187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.439213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.439298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.439419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.439445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.439554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.439666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.439693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.439773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.439886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.439911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.440044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.440193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.440221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.440327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.440461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.440487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.440579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.440655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.270 [2024-11-18 02:12:47.440680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.270 qpair failed and we were unable to recover it. 00:30:13.270 [2024-11-18 02:12:47.440800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.440906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.440932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.441023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.441135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.441161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.441276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.441397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.441423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.441536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.441693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.441722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.441877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.442000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.442044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.442125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.442216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.442242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.442386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.442476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.442502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.442615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.442778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.442806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.442921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.443034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.443059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.443220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.443335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.443365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.443496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.443630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.443655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.443741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.443859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.443884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.444024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.444146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.444173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.444258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.444386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.444430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.444521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.444609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.444635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.444724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.444850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.444875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.444960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.445046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.445072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.445154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.445293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.445325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.445441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.445576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.445605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.445735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.445833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.445861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.445996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.446083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.446108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.446196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.446316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.446343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.446491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.446606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.446632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.446747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.446861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.446886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.446967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.447083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.447109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.447195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.447349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.447380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.447516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.447630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.447655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.271 [2024-11-18 02:12:47.447746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.447895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.271 [2024-11-18 02:12:47.447937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.271 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.448074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.448157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.448183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.448270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.448389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.448415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.448507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.448668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.448697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.448818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.448957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.448982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.449102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.449216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.449241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.449351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.449492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.449518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.449634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.449767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.449795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.449905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.449989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.450015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.450156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.450315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.450341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.450424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.450560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.450585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.450670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.450791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.450816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.450907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.451028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.451053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.451200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.451346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.451371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.451515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.451593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.451618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.451703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.451819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.451844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.451988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.452098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.452123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.452208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.452321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.452347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.452432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.452541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.452566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.452687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.452763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.452788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.452903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.452988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.453014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.453127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.453207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.453234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.453355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.453478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.453504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.453588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.453674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.453699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.453806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.453919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.453944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.454031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.454116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.454142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.454281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.454434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.454462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.454544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.454655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.454681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.454766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.454907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.454951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.272 qpair failed and we were unable to recover it. 00:30:13.272 [2024-11-18 02:12:47.455087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.272 [2024-11-18 02:12:47.455200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.455225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.455335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.455450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.455476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.455560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.455678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.455705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.455820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.455896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.455926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.456040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.456158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.456184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.456323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.456445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.456475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.456601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.456718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.456744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.456834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.456920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.456945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.457069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.457159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.457188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.457349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.457485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.457511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.457628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.457758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.457784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.457899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.457987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.458012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.458096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.458210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.458236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.458352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.458515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.458548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.458672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.458765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.458793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.458958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.459050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.459076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.459163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.459288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.459349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.459462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.459553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.459577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.459723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.459836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.459861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.459974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.460088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.460113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.460255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.460378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.460404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.460527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.460673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.460699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.460812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.460953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.460978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.461094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.461207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.461238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.461336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.461429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.461454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.273 qpair failed and we were unable to recover it. 00:30:13.273 [2024-11-18 02:12:47.461566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.461711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.273 [2024-11-18 02:12:47.461736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.461869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.461975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.462001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.462145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.462248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.462273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.462444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.462562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.462591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.462749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.462878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.462907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.463012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.463097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.463124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.463239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.463387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.463418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.463517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.463605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.463635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.463768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.463861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.463892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.463984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.464068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.464094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.464206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.464293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.464325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.464416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.464534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.464559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.464673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.464780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.464805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.464892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.464972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.464997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.465111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.465249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.465274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.465418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.465533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.465558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.465721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.465825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.465850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.465933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.466070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.466096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.466213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.466299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.466332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.466453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.466622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.466650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.466788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.466906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.466930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.467043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.467182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.467208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.467345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.467428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.467453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.467594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.467708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.467735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.467854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.467963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.467989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.468117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.468207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.468232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.468358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.468470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.468495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.468584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.468669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.468694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.468814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.468926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.274 [2024-11-18 02:12:47.468953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.274 qpair failed and we were unable to recover it. 00:30:13.274 [2024-11-18 02:12:47.469037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.469120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.469145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.469262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.469378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.469408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.469499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.469651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.469680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.469817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.469933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.469958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.470117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.470214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.470255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.470347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.470460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.470486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.470604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.470718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.470743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.470876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.470979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.471020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.471130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.471219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.471244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.471338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.471458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.471483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.471635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.471751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.471793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.471903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.471991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.472016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.472094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.472240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.472265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.472414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.472527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.472552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.472668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.472775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.472800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.472888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.472994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.473019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.473132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.473264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.473293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.473424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.473551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.473579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.473713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.473851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.473876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.473959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.474096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.474122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.474222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.474339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.474366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.474460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.474569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.474594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.474704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.474793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.474818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.474902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.474981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.475007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.475101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.475210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.475236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.475386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.475480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.475506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.475587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.475666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.475693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.475805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.475910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.475936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.275 qpair failed and we were unable to recover it. 00:30:13.275 [2024-11-18 02:12:47.476050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.275 [2024-11-18 02:12:47.476163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.476189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.476304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.476422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.476448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.476532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.476648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.476674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.476746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.476835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.476862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.476959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.477074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.477099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.477244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.477357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.477383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.477504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.477586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.477612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.477754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.477843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.477869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.477983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.478066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.478093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.478219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.478338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.478365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.478479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.478628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.478654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.478728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.478815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.478843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.478937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.479048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.479075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.479213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.479336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.479364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.479505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.479615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.479642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.479783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.479866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.479892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.480011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.480087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.480112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.480220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.480325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.480352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.480440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.480553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.480579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.480723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.480866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.480893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.480982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.481127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.481153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.481264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.481350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.481376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.481497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.481577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.481603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.481718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.481827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.481854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.481936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.482047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.482072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.482190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.482304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.482335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.482450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.482536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.482562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.482681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.482792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.482819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.482934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.483043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.276 [2024-11-18 02:12:47.483069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.276 qpair failed and we were unable to recover it. 00:30:13.276 [2024-11-18 02:12:47.483186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.483295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.483330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.483449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.483562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.483588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.483731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.483816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.483841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.483968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.484116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.484150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.484287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.484437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.484465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.484551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.484639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.484666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.484812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.484893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.484920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.485074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.485188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.485214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.485336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.485450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.485478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.485569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.485658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.485684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.485795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.485912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.485939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.486049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.486132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.486157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.486268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.486386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.486412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.486525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.486658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.486685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.486829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.486943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.486970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.487085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.487171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.487197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.487280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.487416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.487443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.487528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.487605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.487631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.487774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.487885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.487912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.488024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.488130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.488156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.488247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.488333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.488360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.488504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.488591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.488618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.488704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.488846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.488872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.488987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.489099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.489125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.489203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.489280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.277 [2024-11-18 02:12:47.489306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.277 qpair failed and we were unable to recover it. 00:30:13.277 [2024-11-18 02:12:47.489439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.489550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.489576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.489684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.489770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.489796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.489882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.490028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.490053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.490140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.490287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.490324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.490464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.490553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.490579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.490689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.490775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.490801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.490914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.490989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.491015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.491128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.491216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.491243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.491330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.491449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.491475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.491556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.491673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.491700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.491841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.491959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.491985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.492126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.492237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.492263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.492351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.492496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.492522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.492635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.492752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.492778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.492897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.492981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.493007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.493089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.493179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.493206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.493315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.493405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.493432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.493514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.493600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.493626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.493740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.493849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.493880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.493991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.494107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.494134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.494251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.494394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.494421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.494506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.494620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.494645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.494734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.494821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.494847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.494966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.495076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.495102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.495216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.495330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.495357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.495465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.495572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.495598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.495690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.495773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.495803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.495892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.496034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.496060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.278 qpair failed and we were unable to recover it. 00:30:13.278 [2024-11-18 02:12:47.496180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.278 [2024-11-18 02:12:47.496266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.496296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.496417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.496503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.496529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.496610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.496723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.496749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.496891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.497006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.497032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.497142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.497253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.497280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.497408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.497520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.497546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.497633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.497776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.497802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.497882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.497972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.497999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.498090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.498204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.498231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.498372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.498456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.498481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.498571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.498653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.498684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.498793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.498899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.498925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.499040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.499154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.499180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.499294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.499416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.499442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.499561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.499646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.499673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.499755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.499897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.499924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.500042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.500149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.500175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.500264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.500357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.500384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.500497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.500641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.500667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.500775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.500891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.500917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.501029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.501143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.501174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.501291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.501408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.501435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.501551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.501638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.501664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.501807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.501949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.501975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.502114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.502229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.502257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.502394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.502560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.502604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.502695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.502806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.502832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.502915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.502998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.503026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.503145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.503261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.279 [2024-11-18 02:12:47.503287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.279 qpair failed and we were unable to recover it. 00:30:13.279 [2024-11-18 02:12:47.503390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.503526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.503555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.503706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.503789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.503815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.503969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.504063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.504089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.504206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.504347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.504374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.504488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.504621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.504650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.504773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.504943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.504985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.505138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.505260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.505291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.505428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.505538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.505565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.505702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.505821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.505850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.506006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.506123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.506152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.506279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.506419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.506445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.506605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.506701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.506730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.506854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.506993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.507023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.507158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.507280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.507318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.507453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.507563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.507606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.507752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.507883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.507911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.508004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.508086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.508114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.508234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.508376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.508402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.508514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.508604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.508630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.508770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.508860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.508903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.509002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.509153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.509181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.509277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.509428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.509454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.509567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.509706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.509736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.509824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.509923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.509951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.510137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.510295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.510330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.510468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.510586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.510611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.510695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.510812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.510841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.510945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.511062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.280 [2024-11-18 02:12:47.511104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.280 qpair failed and we were unable to recover it. 00:30:13.280 [2024-11-18 02:12:47.511237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.511363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.511389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.511498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.511657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.511685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.511789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.511927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.511955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.512050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.512204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.512232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.512374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.512455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.512481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.512623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.512738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.512763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.512933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.513048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.513076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.513203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.513327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.513371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.513490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.513601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.513627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.513760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.513891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.513919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.514011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.514126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.514172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.514286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.514407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.514433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.514551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.514704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.514733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.514821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.514944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.514987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.515076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.515171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.515196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.515356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.515451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.515479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.515602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.515732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.515761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.515868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.515949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.515975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.516117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.516191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.516217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.516332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.516450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.516476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.516556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.516637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.516664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.516818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.516943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.516971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.517057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.517151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.517178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.517343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.517462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.517487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.517574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.517657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.517682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.517785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.517919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.517945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.518028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.518118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.518143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.281 [2024-11-18 02:12:47.518248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.518334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.281 [2024-11-18 02:12:47.518360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.281 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.518484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.518628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.518654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.518798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.518882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.518907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.519022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.519149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.519177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.519293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.519451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.519495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.519643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.519759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.519784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.519892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.520023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.520051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.520214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.520335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.520364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.520477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.520586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.520611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.520686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.520825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.520851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.520984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.521110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.521138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.521237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.521378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.521404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.521538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.521655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.521683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.521814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.521921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.521947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.522027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.522168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.522194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.522327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.522453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.522481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.522593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.522755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.522783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.522932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.523017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.523042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.523171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.523298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.523338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.523464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.523555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.523584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.523749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.523891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.523933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.524056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.524206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.524234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.524375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.524522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.524547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.524634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.524713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.524739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.524852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.524983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.525010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.525110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.525228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.282 [2024-11-18 02:12:47.525270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.282 qpair failed and we were unable to recover it. 00:30:13.282 [2024-11-18 02:12:47.525418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.525543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.525569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.525700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.525803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.525829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.525973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.526100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.526129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.526261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.526398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.526425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.526592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.526716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.526742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.526852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.526961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.526986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.527095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.527206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.527231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.527322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.527434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.527459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.527569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.527652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.527677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.527768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.527876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.527902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.528030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.528121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.528150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.528273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.528408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.528438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.528574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.528656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.528682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.528805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.528925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.528954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.529102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.529217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.529242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.529382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.529467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.529493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.529648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.529776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.529801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.529889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.529982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.530007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.530119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.530262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.530287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.530424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.530580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.530609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.530700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.530818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.530843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.530981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.531097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.531123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.531252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.531404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.531447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.531569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.531655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.531697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.531838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.531949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.531974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.532086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.532228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.532257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.532376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.532525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.532554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.532685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.532801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.532826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.283 qpair failed and we were unable to recover it. 00:30:13.283 [2024-11-18 02:12:47.532906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.283 [2024-11-18 02:12:47.533019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.533044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.533199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.533286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.533320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.533428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.533506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.533531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.533646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.533775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.533808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.533963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.534071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.534114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.534200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.534341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.534368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.534496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.534654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.534682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.534775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.534876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.534901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.534986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.535096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.535121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.535248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.535342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.535385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.535504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.535620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.535645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.535761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.535839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.535864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.535947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.536057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.536086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.536185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.536300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.536335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.536476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.536591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.536617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.536785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.536872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.536898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.537009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.537123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.537149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.537256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.537337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.537364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.537507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.537592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.537633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.537723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.537809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.537837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.537997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.538106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.538131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.538235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.538323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.538352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.538488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.538637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.538661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.538772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.538911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.538936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.539072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.539194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.539222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.539336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.539428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.539457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.539584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.539725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.539750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.539851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.539984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.540009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.540167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.540291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.284 [2024-11-18 02:12:47.540341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-18 02:12:47.540457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.540544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.540569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.540699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.540791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.540819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.540972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.541100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.541125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.541235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.541381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.541408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.541543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.541663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.541691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.541803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.541922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.541965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.542137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.542254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.542279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.542391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.542472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.542497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.542631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.542720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.542749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.542921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.543058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.543099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.543192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.543321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.543350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.543483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.543563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.543589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.543705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.543795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.543820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.543931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.544016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.544041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.544158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.544250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.544278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.544394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.544510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.544536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.544672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.544765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.544793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.544915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.545031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.545059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.545223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.545298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.545330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.545410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.545522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.545547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.545679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.545778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.545806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.545930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.546067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.546093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.546197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.546278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.546306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.546462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.546550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.546576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.546721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.546834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.546859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.547018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.547146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.547179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.547342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.547493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.547522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.547622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.547737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.547763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.547900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.548016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.285 [2024-11-18 02:12:47.548042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-18 02:12:47.548124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.548219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.548247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.548371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.548477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.548503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.548586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.548718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.548746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.548859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.549026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.549051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.549134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.549248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.549273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.549395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.549510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.549535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.549626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.549778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.549811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.549947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.550089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.550115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.550230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.550340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.550366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.550450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.550562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.550587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.550736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.550821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.550847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.550943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.551038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.551065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.551154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.551242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.551270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.551420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.551567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.551593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.551680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.551769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.551795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.551880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.552032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.552061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.552173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.552256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.552283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.552432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.552546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.552573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.552750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.552879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.552904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.553019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.553166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.553191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.553306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.553462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.553488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.553603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.553743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.553772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.553907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.553990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.554015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.554143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.554265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.554307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.554424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.554536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.554561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.554644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.554782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.554808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.554916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.555002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.555027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-18 02:12:47.555157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.555325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.286 [2024-11-18 02:12:47.555366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.555461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.555545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.555571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.555693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.555798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.555827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.555956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.556070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.556096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.556184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.556270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.556296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.556394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.556478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.556504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.556600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.556768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.556797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.556929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.557044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.557069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.557210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.557325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.557360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.557438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.557552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.557578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.557698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.557814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.557840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.557943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.558026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.558054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.558154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.558247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.558275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.558451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.558556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.558582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.558699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.558777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.558802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.558882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.558969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.558995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.559084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.559171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.559196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.559284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.559412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.559437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.559526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.559659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.559687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.559795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.559943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.559969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.560088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.560168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.560201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.560284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.560440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.560467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.560591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.560683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.560708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.560795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.560901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.560926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.561019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.561092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.561117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.561241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.561355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.561381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.561455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.561537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.287 [2024-11-18 02:12:47.561562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.287 qpair failed and we were unable to recover it. 00:30:13.287 [2024-11-18 02:12:47.561680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.561777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.561805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.561936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.562043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.562069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.562177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.562299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.562417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.562533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.562671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.562701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.562788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.562886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.562911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.563016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.563122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.563147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.563255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.563351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.563378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.563485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.563565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.563590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.563696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.563784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.563812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.563933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.564040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.564065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.564201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.564282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.564308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.564420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.564551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.564585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.564670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.564777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.564802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.564910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.565024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.565049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.565196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.565324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.565354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.565508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.565598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.565626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.565764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.565852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.565877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.565990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.566069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.566094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.566201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.566283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.566333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.566455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.566568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.566593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.566709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.566818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.566846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.566988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.567071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.567095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.567177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.567288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.567323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.567440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.567523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.567548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.567636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.567721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.567747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.567831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.567912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.567937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.568049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.568158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.568184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.568318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.568417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.568442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.288 [2024-11-18 02:12:47.568556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.568695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.288 [2024-11-18 02:12:47.568721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.288 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.568827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.568947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.568974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.569069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.569168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.569211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.569353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.569446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.569471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.569578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.569676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.569704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.569803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.569919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.569962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.570046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.570189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.570215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.570307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.570426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.570452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.570537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.570628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.570653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.570808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.570898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.570923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.571026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.571157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.571184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.571328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.571436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.571462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.571550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.571626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.571651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.571788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.571878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.571907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.572007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.572085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.572127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.572243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.572331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.572358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.572440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.572538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.572564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.572645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.572751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.572777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.572887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.572997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.573023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.573133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.573244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.573271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.573411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.573512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.573541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.573676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.573759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.573785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.573892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.574003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.574028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.574140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.574221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.574250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.574412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.574497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.574522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.574615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.574719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.574745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.574829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.574961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.574995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.575103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.575178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.575203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.575321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.575403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.575429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.289 qpair failed and we were unable to recover it. 00:30:13.289 [2024-11-18 02:12:47.575514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.289 [2024-11-18 02:12:47.575613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.575641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.575745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.575824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.575850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.575930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.576059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.576085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.576170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.576277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.576303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.576454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.576533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.576558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.576669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.576786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.576812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.576894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.577000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.577043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.577147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.577234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.577260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.577364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.577462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.577490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.577589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.577693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.577722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.577857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.577967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.577993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.578079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.578162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.578187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.578301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.578398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.578423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.578506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.578645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.578671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.578752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.578903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.578946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.579029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.579133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.579159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.579247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.579367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.579393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.579478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.579589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.579617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.579744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.579878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.579907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.580021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.580161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.580186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.580284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.580464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.580490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.580605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.580690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.580733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.580843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.580925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.580951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.581064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.581141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.581166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.581267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.581401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.581430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.581563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.581639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.581664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.581748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.581826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.581867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.581989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.582105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.582134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.582249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.582360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.290 [2024-11-18 02:12:47.582387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.290 qpair failed and we were unable to recover it. 00:30:13.290 [2024-11-18 02:12:47.582502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.582581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.582608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.582725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.582861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.582890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.583003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.583115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.583142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.583254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.583376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.583419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.583542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.583673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.583703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.583814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.583897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.583922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.584011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.584120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.584163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.584250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.584336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.584374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.584483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.584591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.584617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.584691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.584779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.584804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.584890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.584992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.585018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.585100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.585184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.585210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.585288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.585408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.585434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.585552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.585671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.585699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.585826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.585973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.585998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.586154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.586241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.586266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.586387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.586505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.586531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.586650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.586736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.586761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.586843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.586921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.586947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.587032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.587116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.587147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.587263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.587386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.587413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.587552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.587670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.587698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.587817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.587921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.587949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.291 qpair failed and we were unable to recover it. 00:30:13.291 [2024-11-18 02:12:47.588092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.588177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.291 [2024-11-18 02:12:47.588205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.588297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.588432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.588458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.588557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.588644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.588669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.588821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.588939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.588964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.589053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.589205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.589230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.589341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.589471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.589500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.589615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.589696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.589721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.589820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.589949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.589977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.590124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.590245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.590273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.590420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.590492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.590518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.590607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.590717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.590742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.590846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.590933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.590961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.591120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.591231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.591257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.591394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.591513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.591556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.591651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.591819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.591844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.591937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.592055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.592081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.592234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.592354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.592380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.592522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.592613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.592638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.592714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.592798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.592823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.592930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.593011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.593036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.593144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.593276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.593305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.593419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.593562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.593595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.593710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.593850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.593875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.593990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.594120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.594148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.594275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.594378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.594404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.594491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.594639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.594664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.594747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.594835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.594860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.594989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.595104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.595130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.595215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.595337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.595363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.292 qpair failed and we were unable to recover it. 00:30:13.292 [2024-11-18 02:12:47.595485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.292 [2024-11-18 02:12:47.595593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.595621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.595728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.595872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.595898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.596010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.596132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.596160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.596239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.596334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.596379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.596454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.596561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.596594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.596739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.596825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.596852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.596966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.597117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.597145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.597281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.597402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.597428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.597519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.597623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.597649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.597725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.597836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.597862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.597975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.598089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.598115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.598206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.598321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.598347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.598430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.598515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.598541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.598677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.598774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.598803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.598955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.599046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.599074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.599200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.599349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.599395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.599509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.599606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.599631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.599759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.599846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.599876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.599967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.600091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.600121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.600244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.600327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.600355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.600473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.600557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.600585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.600673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.600807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.600835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.600963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.601053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.601078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.601167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.601265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.601293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.601451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.601566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.601594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.601762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.601872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.601897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.601986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.602123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.602149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.602221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.602317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.602343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.602458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.602577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.293 [2024-11-18 02:12:47.602610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.293 qpair failed and we were unable to recover it. 00:30:13.293 [2024-11-18 02:12:47.602700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.602852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.602881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.602988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.603123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.603148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.603306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.603445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.603474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.603601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.603706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.603734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.603846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.603933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.603959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.604084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.604220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.604245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.604400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.604516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.604542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.604662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.604774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.604799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.604885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.604996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.605022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.605161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.605269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.605294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.605422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.605511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.605536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.605628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.605784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.605827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.605939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.606027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.606053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.606201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.606309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.606343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.606482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.606569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.606595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.606752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.606884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.606913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.607026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.607109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.607152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.607263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.607347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.607373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.607457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.607572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.607599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.607763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.607851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.607879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.607991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.608101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.608127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.608240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.608324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.608352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.608476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.608579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.608607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.608731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.608856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.608884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.609016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.609110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.609139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.609269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.609412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.609439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.609525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.609663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.609688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.609768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.609902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.609943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.294 [2024-11-18 02:12:47.610067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.610154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.294 [2024-11-18 02:12:47.610179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.294 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.610299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.610412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.610437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.610566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.610658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.610687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.610809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.610900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.610928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.611060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.611150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.611193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.611325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.611443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.611468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.611578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.611662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.611687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.611799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.611935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.611963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.612060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.612188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.612217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.612353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.612439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.612464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.612574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.612656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.612681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.612818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.612921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.612947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.613059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.613168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.613193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.613302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.613394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.613420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.613505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.613624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.613649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.613746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.613877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.613905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.614028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.614135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.614161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.614274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.614394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.614420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.614504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.614620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.614646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.614829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.614969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.614994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.615149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.615250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.615275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.615372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.615463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.615489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.615598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.615702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.615732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.615840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.615981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.616007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.616087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.616171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.616197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.616317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.616396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.616421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.616507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.616582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.616607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.616772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.616897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.616938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.617082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.617165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.617190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.295 qpair failed and we were unable to recover it. 00:30:13.295 [2024-11-18 02:12:47.617320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.617403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.295 [2024-11-18 02:12:47.617428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.617535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.617671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.617697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.617839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.617978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.618004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.618122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.618227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.618253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.618374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.618460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.618487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.618595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.618681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.618722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.618812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.618936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.618961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.619043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.619158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.619186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.619323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.619436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.619461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.619550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.619644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.619669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.619783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.619873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.619899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.619989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.620071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.620098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.620178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.620283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.620308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.620494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.620571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.620597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.620745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.620877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.620906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.621056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.621141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.621169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.621294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.621420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.621445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.621578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.621701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.621728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.621844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.621925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.621953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.622051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.622143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.622169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.622331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.622446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.622473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.622639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.622737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.622763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.622844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.622985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.623010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.623089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.623181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.623206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.623283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.623403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.623428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.296 qpair failed and we were unable to recover it. 00:30:13.296 [2024-11-18 02:12:47.623512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.623653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.296 [2024-11-18 02:12:47.623678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.623792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.623875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.623900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.623978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.624083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.624109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.624195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.624272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.624297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.624384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.624467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.624492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.624588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.624703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.624732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.624855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.624979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.625021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.625140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.625282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.625308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.625403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.625518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.625543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.625654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.625742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.625768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.625890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.625969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.625997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.626133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.626218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.626244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.626359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.626470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.626495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.626579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.626664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.626689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.626770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.626881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.626907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.627022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.627132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.627157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.627266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.627366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.627406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.627505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.627601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.627644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.627745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.627860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.627886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.627967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.628053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.628082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.628165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.628277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.628304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.628409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.628523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.628549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.628638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.628729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.628756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.628884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.629003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.629029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.629121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.629230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.629255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.629351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.629431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.629457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.629540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.629629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.629654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.629742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.629878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.629904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.630022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.630101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.630127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.297 qpair failed and we were unable to recover it. 00:30:13.297 [2024-11-18 02:12:47.630214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.297 [2024-11-18 02:12:47.630365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.630393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.630495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.630588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.630616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.630727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.630840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.630865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.630965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.631067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.631094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.631189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.631335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.631362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.631473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.631627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.631652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.631764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.631852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.631878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.631996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.632128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.632156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.632319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.632443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.632489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.632578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.632685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.632711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.632800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.632887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.632912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.633026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.633107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.633132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.633214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.633324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.633351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.633432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.633519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.633545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.633684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.633767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.633792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.298 [2024-11-18 02:12:47.633877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.633949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.298 [2024-11-18 02:12:47.633975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.298 qpair failed and we were unable to recover it. 00:30:13.588 [2024-11-18 02:12:47.634060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.634142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.634167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.588 qpair failed and we were unable to recover it. 00:30:13.588 [2024-11-18 02:12:47.634334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.634415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.634441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.588 qpair failed and we were unable to recover it. 00:30:13.588 [2024-11-18 02:12:47.634531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.634648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.634674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.588 qpair failed and we were unable to recover it. 00:30:13.588 [2024-11-18 02:12:47.635543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.635664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.635694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.588 qpair failed and we were unable to recover it. 00:30:13.588 [2024-11-18 02:12:47.635849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.635960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.635985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.588 qpair failed and we were unable to recover it. 00:30:13.588 [2024-11-18 02:12:47.636130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.636252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.636280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.588 qpair failed and we were unable to recover it. 00:30:13.588 [2024-11-18 02:12:47.636386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.636494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.636520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.588 qpair failed and we were unable to recover it. 00:30:13.588 [2024-11-18 02:12:47.636627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.636711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.636736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.588 qpair failed and we were unable to recover it. 00:30:13.588 [2024-11-18 02:12:47.636850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.588 [2024-11-18 02:12:47.636929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.636954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.637069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.637194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.637222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.637354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.637491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.637517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.637631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.637745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.637770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.637909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.638025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.638053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.638151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.638235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.638277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.638372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.638481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.638506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.638620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.638741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.638785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.638867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.639003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.639047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.639171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.639341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.639371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.639525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.639633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.639657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.639772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.639884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.639909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.640031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.640141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.640183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.640276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.640407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.640435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.640539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.640681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.640706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.640812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.640925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.640949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.641039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.641172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.641200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.641324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.641458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.641490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.641625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.641738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.641762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.641874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.641965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.641994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.642091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.642243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.642272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.642408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.642503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.642530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.642693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.642779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.642805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.642918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.643052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.643081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.643205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.643298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.643335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.643470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.643550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.643575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.643687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.643832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.643857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.643969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.644067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.644098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.589 [2024-11-18 02:12:47.644255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.644354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.589 [2024-11-18 02:12:47.644384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.589 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.644505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.644666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.644692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.644774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.644916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.644941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.645031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.645140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.645166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.645249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.645387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.645414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.645547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.645639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.645667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.645806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.645938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.645963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.646119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.646246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.646274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.646409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.646531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.646559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.646649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.646806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.646833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.646944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.647057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.647083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.647162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.647335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.647380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.647483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.647586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.647615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.647738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.647874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.647901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.648022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.648120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.648155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.648296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.648418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.648453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.648565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.648710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.648735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.648822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.648940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.648964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.649055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.649197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.649225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.649372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.649510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.649545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.649686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.649825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.649852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.649948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.650036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.650079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.650236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.650396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.650435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.650550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.650653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.650679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.650767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.650871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.650895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.651037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.651128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.651162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.651303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.651453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.651503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.651648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.651769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.651798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.651943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.652045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.652093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.590 qpair failed and we were unable to recover it. 00:30:13.590 [2024-11-18 02:12:47.652199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.590 [2024-11-18 02:12:47.652305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.652349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.652489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.652585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.652626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.652715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.652798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.652827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.652926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.653042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.653073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.653220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.653318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.653346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.653459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.653553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.653582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.653692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.653794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.653823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.653953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.654096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.654131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.654228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.654370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.654402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.654490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.654580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.654610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.654732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.654820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.654849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.654995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.655115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.655144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.655235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.655369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.655400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.655527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.655613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.655643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.655721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.655812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.655839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.655929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.656014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.656039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.656153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.656241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.656290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.656414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.656507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.656537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.656681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.656826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.656853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.656980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.657103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.657134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.657222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.657333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.657360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.657456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.657540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.657570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.657673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.657787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.657820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.657927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.658059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.658088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.658191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.658351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.658388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.658504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.658606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.658644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.658804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.658925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.658957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.659095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.659224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.659256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.659378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.659506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.591 [2024-11-18 02:12:47.659539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.591 qpair failed and we were unable to recover it. 00:30:13.591 [2024-11-18 02:12:47.659694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.659816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.659843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.659997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.660083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.660109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.660252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.660384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.660417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.660548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.660650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.660682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.660821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.660938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.660965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.661052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.661171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.661196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.661321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.661431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.661459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.661592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.661710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.661741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.661862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.661982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.662012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.662103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.662224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.662250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.662347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.662449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.662479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.662621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.662721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.662754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.662895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.662982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.663011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.663162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.663274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.663301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.663411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.663524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.663553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.663665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.663788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.663819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.663964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.664053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.664081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.664200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.664344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.664385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.664538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.664684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.664711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.664830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.664911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.664941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.665038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.665180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.665206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.665351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.665483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.665513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.665646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.665766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.665795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.665950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.666066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.666101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.666250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.666412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.666439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.666574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.666691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.666721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.666872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.666981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.667013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.667153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.667237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.667263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.592 [2024-11-18 02:12:47.667417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.667532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.592 [2024-11-18 02:12:47.667559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.592 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.667693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.667803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.667837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.667969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.668098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.668128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.668265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.668379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.668424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.668570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.668689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.668718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.668815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.668959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.668985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.669101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.669224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.669258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.669415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.669575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.669609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.669746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.669862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.669888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.670015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.670140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.670170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.670329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.670451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.670481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.670595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.670714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.670741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.670888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.670996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.671022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.671112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.671196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.671224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.671354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.671502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.671532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.671672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.671771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.671812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.671963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.672064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.672093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.672213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.672339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.672378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.672483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.672633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.672663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.672803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.672954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.672984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.673149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.673239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.673265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.673403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.673490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.673518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.673617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.673746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.673772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.673938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.674079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.674105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.674197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.674309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.593 [2024-11-18 02:12:47.674347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.593 qpair failed and we were unable to recover it. 00:30:13.593 [2024-11-18 02:12:47.674444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.674567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.674593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.674700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.674787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.674813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.674895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.674972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.674998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.675122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.675208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.675235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.675385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.675472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.675507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.675650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.675772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.675825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.675939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.676075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.676109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.676266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.676392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.676419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.676535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.676631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.676657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.676744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.676853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.676879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.676995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.677114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.677140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.677228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.677306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.677341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.677453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.677540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.677565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.677654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.677742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.677767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.677884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.677994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.678018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.678156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.678268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.678292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.678397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.678477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.678501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.678615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.678705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.678731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.678871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.678959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.678984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.679070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.679177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.679202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.679286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.679413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.679438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.679535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.679618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.679642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.679756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.679872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.679898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.680005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.680114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.680140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.680250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.680341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.680368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.680476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.680562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.680617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.680750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.680870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.680895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.680978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.681057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.681083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.594 qpair failed and we were unable to recover it. 00:30:13.594 [2024-11-18 02:12:47.681201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.681274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.594 [2024-11-18 02:12:47.681299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.681408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.681494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.681518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.681615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.681725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.681750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.681865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.681961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.681986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.682070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.682153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.682178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.682254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.682376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.682401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.682514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.682613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.682638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.682753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.682846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.682881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.682994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.683112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.683137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.683222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.683309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.683344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.683460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.683569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.683612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.683758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.683881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.683906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.684019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.684097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.684122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.684240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.684332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.684362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.684455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.684534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.684559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.684644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.684783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.684807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.684941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.685062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.685090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.685204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.685293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.685349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.685484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.685580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.685608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.685707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.685788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.685813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.685932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.686043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.686068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.686177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.686253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.686278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.686394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.686475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.686500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.686606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.686686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.686712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.686827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.686943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.686986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.687101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.687180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.687205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.687322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.687432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.687458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.687536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.687615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.687641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.687725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.687857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.687885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.595 qpair failed and we were unable to recover it. 00:30:13.595 [2024-11-18 02:12:47.687982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.595 [2024-11-18 02:12:47.688101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.688128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.688268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.688408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.688434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.688547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.688639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.688664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.688774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.688886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.688911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.689009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.689131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.689156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.689293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.689394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.689419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.689506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.689593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.689618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.689694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.689809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.689834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.689946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.690035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.690059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.690141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.690246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.690272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.690412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.690496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.690522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.690621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.690760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.690786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.690866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.690949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.690973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.691060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.691204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.691229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.691396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.691512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.691554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.691666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.691822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.691869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.692003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.692101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.692132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.692244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.692380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.692409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.692520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.692614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.692643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.692740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.692829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.692860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.693012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.693104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.693131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.693250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.693378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.693409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.693503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.693604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.693635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.693752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.693872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.693901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.694015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.694146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.694179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.694323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.694473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.694502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.694628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.694722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.694750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.694881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.695003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.695031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.695167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.695295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.596 [2024-11-18 02:12:47.695341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.596 qpair failed and we were unable to recover it. 00:30:13.596 [2024-11-18 02:12:47.695483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.695588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.695615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.695714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.695809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.695836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.695931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.696010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.696056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.696215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.696344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.696392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.696513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.696633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.696660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.696748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.696869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.696901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.696996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.697149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.697180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.697321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.697464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.697493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.697582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.697725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.697757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.697882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.698001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.698028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.698148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.698229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.698255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.698347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.698431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.698456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.698571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.698709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.698734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.698817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.698904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.698930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.699046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.699178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.699206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.699327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.699423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.699449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.699574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.699713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.699740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.699849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.699932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.699957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.700046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.700160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.700185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.700262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.700346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.700371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.700482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.700608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.700633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.700759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.700872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.700896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.701023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.701118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.701146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.701269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.701388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.701414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.597 [2024-11-18 02:12:47.701524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.701622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.597 [2024-11-18 02:12:47.701647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.597 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.701734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.701806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.701831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.701936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.702072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.702104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.702223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.702332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.702358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.702441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.702521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.702546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.702658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.702746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.702771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.702943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.703029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.703054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.703173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.703283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.703308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.703436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.703525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.703550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.703633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.703748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.703773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.703861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.703966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.703991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.704106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.704248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.704276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.704432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.704518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.704544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.704667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.704775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.704800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.704886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.704987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.705012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.705105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.705215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.705240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.705333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.705443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.705470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.705578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.705684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.705710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.705813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.705956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.705983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.706102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.706189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.706217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.706383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.706469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.706494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.706611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.706750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.706776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.706888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.706999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.707024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.707117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.707227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.707271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.707399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.707536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.707562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.707681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.707797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.707823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.707900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.708001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.708044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.708135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.708219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.708244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.708402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.708517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.708542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.598 qpair failed and we were unable to recover it. 00:30:13.598 [2024-11-18 02:12:47.708632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.598 [2024-11-18 02:12:47.708735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.708760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.708871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.708979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.709020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.709123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.709269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.709297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.709419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.709560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.709587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.709700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.709791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.709816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.709907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.710049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.710093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.710182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.710296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.710334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.710466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.710584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.710610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.710714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.710824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.710849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.710974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.711126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.711151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.711276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.711435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.711462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.711576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.711661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.711687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.711804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.711943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.711968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.712055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.712179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.712221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.712334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.712435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.712461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.712612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.712758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.712784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.712900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.713016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.713041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.713130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.713243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.713270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.713458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.713567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.713592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.713673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.713786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.713811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.713924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.714031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.714056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.714151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.714280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.714305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.714424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.714513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.714538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.714649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.714758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.714785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.714894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.715005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.715034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.715168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.715264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.715306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.715431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.715519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.715544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.715682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.715805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.715830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.599 [2024-11-18 02:12:47.715972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.716078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.599 [2024-11-18 02:12:47.716104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.599 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.716192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.716303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.716340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.716431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.716521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.716547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.716655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.716735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.716775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.716904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.717002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.717027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.717146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.717229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.717254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.717372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.717489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.717521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.717637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.717787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.717815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.717950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.718061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.718086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.718198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.718318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.718344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.718427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.718506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.718531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.718668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.718789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.718818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.718980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.719093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.719118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.719250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.719352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.719395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.719512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.719598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.719624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.719711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.719820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.719864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.719965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.720051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.720075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.720220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.720340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.720366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.720451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.720571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.720612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.720735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.720851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.720880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.721017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.721132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.721157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.721286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.721401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.721428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.721561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.721676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.721701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.721806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.721881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.721906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.722018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.722131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.722156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.722268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.722422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.722450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.722592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.722729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.722754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.722873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.722983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.723008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.723099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.723209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.723235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.600 qpair failed and we were unable to recover it. 00:30:13.600 [2024-11-18 02:12:47.723324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.600 [2024-11-18 02:12:47.723416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.723441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.723542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.723658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.723686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.723853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.723952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.723977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.724093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.724210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.724235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.724338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.724459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.724485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.724579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.724709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.724738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.724828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.724949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.724991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.725134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.725216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.725241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.725357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.725455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.725481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.725619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.725710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.725736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.725866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.725985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.726013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.726123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.726259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.726285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.726375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.726480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.726506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.726615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.726696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.726720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.726830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.726909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.726934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.727042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.727155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.727180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.727290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.727437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.727462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.727579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.727689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.727715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.727809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.727947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.727975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.728091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.728197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.728222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.728305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.728462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.728487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.728602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.728713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.728738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.728812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.728918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.728942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.729031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.729118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.729143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.729262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.729417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.729446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.729565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.729707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.729731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.729825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.729985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.730014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.730131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.730244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.730269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.601 qpair failed and we were unable to recover it. 00:30:13.601 [2024-11-18 02:12:47.730361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.730455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.601 [2024-11-18 02:12:47.730484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.730568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.730674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.730701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.730828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.730921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.730948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.731072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.731183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.731208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.731374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.731507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.731532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.731646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.731743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.731772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.731902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.731974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.731998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.732080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.732160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.732187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.732302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.732414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.732442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.732570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.732671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.732699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.732864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.732973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.732999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.733126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.733236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.733261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.733402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.733542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.733568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.733660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.733763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.733792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.733904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.734026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.734068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.734151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.734288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.734321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.734406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.734517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.734542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.734684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.734771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.734799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.734925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.735017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.735046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.735178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.735320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.735346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.735461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.735551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.735577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.735670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.735747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.735771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.735856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.735934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.735960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.736073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.736186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.736211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.736354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.736471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.736500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.602 qpair failed and we were unable to recover it. 00:30:13.602 [2024-11-18 02:12:47.736599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.736735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.602 [2024-11-18 02:12:47.736761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.736869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.736940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.736965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.737079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.737156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.737182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.737290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.737377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.737403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.737496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.737573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.737599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.737683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.737788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.737812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.737934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.738042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.738072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.738198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.738289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.738327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.738420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.738569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.738597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.738725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.738853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.738898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.739058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.739221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.739247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.739418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.739570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.739623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.739731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.739920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.739950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.740082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.740168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.740194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.740280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.740415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.740459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.740592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.740732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.740763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.740874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.740993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.741019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.741163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.741275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.741301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.741402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.741507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.741533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.741640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.741717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.741750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.741840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.741946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.741972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.742093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.742203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.742230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.742338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.742424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.742454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.742570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.742690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.742722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.742842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.742928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.742954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.743032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.743128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.743156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.743269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.743377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.743404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.743496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.743604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.743631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.743730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.743851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.603 [2024-11-18 02:12:47.743879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.603 qpair failed and we were unable to recover it. 00:30:13.603 [2024-11-18 02:12:47.743997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.744092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.744119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.744202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.744285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.744317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.744414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.744530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.744557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.744646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.744757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.744784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.744892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.745008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.745035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.745132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.745244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.745271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.745377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.745455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.745481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.745565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.745688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.745714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.745822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.745937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.745963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.746043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.746166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.746193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.746308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.746400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.746427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.746569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.746682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.746709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.746801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.746892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.746918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.747041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.747167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.747194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.747305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.747412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.747438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.747585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.747667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.747693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.747789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.747912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.747939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.748035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.748150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.748182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.748272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.748383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.748410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.748520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.748644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.748672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.748787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.748898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.748925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.749013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.749127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.749155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.749262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.749380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.749409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.749498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.749620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.749647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.749761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.749906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.749932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.750044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.750154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.750180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.750263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.750374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.750401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.750494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.750606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.750636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.604 qpair failed and we were unable to recover it. 00:30:13.604 [2024-11-18 02:12:47.750755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.604 [2024-11-18 02:12:47.750848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.750874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.751005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.751082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.751109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.751224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.751334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.751372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.751461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.751541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.751568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.751667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.751780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.751806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.751900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.751987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.752014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.752131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.752240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.752266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.752363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.752456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.752482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.752591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.752704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.752732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.752819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.752902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.752934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.753084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.753166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.753192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.753317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.753451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.753496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.753619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.753705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.753731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.753816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.753925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.753952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.754063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.754199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.754225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.754321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.754433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.754459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.754568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.754665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.754692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.754808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.754924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.754950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.755033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.755120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.755146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.755268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.755367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.755398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.755512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.755628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.755656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.755747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.755835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.755861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.756007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.756127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.756154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.756249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.756340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.756377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.756463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.756552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.756579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.756692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.756808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.756834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.756949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.757087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.757114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.757253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.757371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.757398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.605 [2024-11-18 02:12:47.757518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.757626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.605 [2024-11-18 02:12:47.757653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.605 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.757740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.757858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.757885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.758000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.758116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.758141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.758224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.758331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.758358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.758444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.758557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.758584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.758704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.758800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.758831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.758919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.759028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.759060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.759158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.759241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.759267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.759381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.759498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.759526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.759654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.759736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.759765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.759874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.759993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.760020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.760132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.760273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.760299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.760424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.760506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.760534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.760642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.760761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.760789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.760906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.761014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.761039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.761152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.761230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.761255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.761379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.761496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.761520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.761665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.761758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.761790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.761918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.762009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.762051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.762143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.762279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.762305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.762451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.762538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.762567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.762689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.762815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.762842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.762932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.763011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.763038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.763141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.763268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.763298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.763451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.763567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.763609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.763738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.763904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.763932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.764082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.764207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.764235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.764348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.764492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.764518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.606 qpair failed and we were unable to recover it. 00:30:13.606 [2024-11-18 02:12:47.764656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.764775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.606 [2024-11-18 02:12:47.764804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.764981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.765106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.765134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.765260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.765403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.765430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.765517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.765594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.765619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.765738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.765842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.765870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.765982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.766077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.766105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.766203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.766323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.766349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.766489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.766573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.766598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.766710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.766822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.766849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.766975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.767070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.767098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.767239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.767335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.767379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.767493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.767615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.767641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.767745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.767869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.767898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.768070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.768193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.768221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.768344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.768480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.768505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.768619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.768751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.768778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.768920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.769083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.769110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.769331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.769461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.769486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.769646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.769782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.769807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.769966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.770097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.770125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.770263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.770395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.770420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.770564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.770667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.770691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.770781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.770880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.770908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.771022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.771142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.771170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.771276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.771413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.771443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.607 [2024-11-18 02:12:47.771554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.771640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.607 [2024-11-18 02:12:47.771665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.607 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.771748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.771852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.771877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.772015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.772122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.772150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.772270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.772395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.772421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.772578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.772708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.772735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.772821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.772965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.772992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.773118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.773265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.773293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.773436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.773512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.773556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.773661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.773805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.773830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.773912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.774056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.774084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.774206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.774334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.774378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.774466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.774553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.774585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.774743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.774895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.774923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.775049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.775147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.775174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.775261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.775389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.775414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.775527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.775670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.775695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.775776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.775880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.775905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.775982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.776118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.776143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.776230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.776359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.776385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.776502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.776627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.776656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.776800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.776879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.776904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.776993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.777126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.777154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.777246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.777386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.777415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.777555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.777652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.777680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.777821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.777908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.777933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.778018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.778098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.778123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.778256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.778381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.778407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.778492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.778607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.778634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.608 [2024-11-18 02:12:47.778754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.778892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.608 [2024-11-18 02:12:47.778918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.608 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.779006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.779087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.779113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.779214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.779355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.779400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.779531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.779659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.779687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.779795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.779907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.779933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.780095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.780187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.780215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.780323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.780467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.780492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.780604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.780732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.780757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.780895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.781010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.781037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.781121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.781244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.781269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.781424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.782199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.782233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.782382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.782499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.782524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.782615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.782702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.782727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.782839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.782925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.782950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.783073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.783160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.783186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.783339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.783480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.783508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.783629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.783742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.783766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.783896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.783996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.784025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.784137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.784254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.784279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.784397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.784481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.784506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.784588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.784699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.784723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.784804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.784918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.784945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.785028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.785117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.785147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.785262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.785374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.785400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.785490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.785603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.785628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.785739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.785873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.785899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.786014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.786456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.786504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.786664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.786749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.786778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.786946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.787083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.787108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.609 qpair failed and we were unable to recover it. 00:30:13.609 [2024-11-18 02:12:47.787220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.787345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.609 [2024-11-18 02:12:47.787373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.787456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.787534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.787560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.787664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.787798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.787826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.787926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.788041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.788070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.788176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.788265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.788290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.788447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.788531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.788556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.788666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.788760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.788785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.788870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.788946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.788970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.789077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.789190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.789214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.789354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.789432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.789457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.789543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.789670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.789698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.789857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.789969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.789993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.790138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.790242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.790268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.790366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.790448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.790473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.790562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.790640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.790665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.790775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.790858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.790882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.791000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.791106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.791131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.791246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.791383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.791409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.791492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.791632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.791658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.791805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.791889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.791915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.792008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.792095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.792121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.792207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.792318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.792363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.792480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.792571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.792600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.792720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.792836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.792861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.792950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.793120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.793146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.793269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.793405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.793435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.793531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.793639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.793665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.793753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.793863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.793888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.610 qpair failed and we were unable to recover it. 00:30:13.610 [2024-11-18 02:12:47.793977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.610 [2024-11-18 02:12:47.794081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.794106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.794248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.794384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.794411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.794530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.794646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.794672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.794756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.794842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.794868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.794985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.795067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.795092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.795184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.795273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.795299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.795448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.795603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.795631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.795757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.795866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.795891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.796010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.796119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.796144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.796230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.796340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.796366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.796508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.796612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.796637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.796762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.796900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.796925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.797032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.797142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.797167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.797284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.797409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.797435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.797516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.797603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.797645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.797774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.797889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.797914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.797995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.798084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.798109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.798248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.798358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.798386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.798498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.798627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.798655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.798817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.798931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.798955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.799044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.799180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.799205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.799294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.799413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.799438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.799577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.799664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.799693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.799817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.799901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.799927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.800059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.800160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.800186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.611 qpair failed and we were unable to recover it. 00:30:13.611 [2024-11-18 02:12:47.800298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.611 [2024-11-18 02:12:47.800414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.800440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.800525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.800638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.800667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.800779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.800866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.800891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.801009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.801096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.801122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.801236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.801346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.801373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.801491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.801577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.801603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.801749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.801887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.801912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.801997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.802088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.802113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.802228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.802358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.802384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.802476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.802554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.802578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.802690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.802805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.802831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.802948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.803033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.803058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.803138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.803214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.803239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.803352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.803460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.803486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.803603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.803712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.803738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.803822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.803928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.803954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.804076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.804159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.804185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.804296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.804381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.804406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.804521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.804602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.804627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.804741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.804880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.804905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.805065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.805161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.805202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.805281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.805397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.805423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.805568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.805680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.805705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.805788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.805925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.805951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.806061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.806174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.806200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.806287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.806475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.806502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.806621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.806701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.806725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.806817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.806930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.806955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.612 qpair failed and we were unable to recover it. 00:30:13.612 [2024-11-18 02:12:47.807071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.612 [2024-11-18 02:12:47.807162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.807189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.807308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.807458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.807483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.807598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.807732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.807757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.807870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.807983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.808008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.808137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.808248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.808275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.808376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.808507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.808535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.808674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.808785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.808810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.808968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.809096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.809122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.809225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.809309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.809343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.809420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.809500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.809526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.809608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.809689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.809715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.809856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.809987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.810016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.810170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.810257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.810286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.810420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.810536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.810564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.810667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.810787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.810813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.810902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.811010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.811051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.811164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.811286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.811350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.811469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.811599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.811626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.811764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.811846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.811871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.811983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.812077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.812103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.812188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.812274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.812298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.812401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.812559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.812586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.812682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.812773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.812798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.812913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.813006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.813031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.813142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.813223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.813253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.813381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.813507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.813535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.813678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.813791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.813816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.813951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.814078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.814106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.613 [2024-11-18 02:12:47.814278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.814375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.613 [2024-11-18 02:12:47.814400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.613 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.814498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.814618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.814643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.814793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.814905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.814931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.815044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.815145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.815174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.815297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.815414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.815439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.815538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.815655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.815697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.815830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.815965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.815989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.816082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.816164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.816189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.816292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.816439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.816465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.816558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.816682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.816707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.816790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.816925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.816949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.817049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.817190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.817214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.817301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.817433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.817458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.817540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.817651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.817677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.817813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.817895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.817921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.817999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.818135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.818160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.818255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.818373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.818399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.818526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.818693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.818719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.818829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.818969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.818994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.819071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.819204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.819232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.819336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.819438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.819466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.819567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.819713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.819756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.819874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.819982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.820008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.820156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.820270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.820296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.820440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.820595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.820638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.820750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.820888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.820913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.821020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.821106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.821131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.821259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.821384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.821427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.614 [2024-11-18 02:12:47.821508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.821656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.614 [2024-11-18 02:12:47.821680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.614 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.821788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.821867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.821893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.822009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.822122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.822149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.822226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.822336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.822363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.822501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.822592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.822617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.822728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.822800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.822825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.822936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.823073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.823098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.823187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.823291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.823325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.823446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.823556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.823581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.823669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.823764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.823808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.823910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.823996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.824021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.824177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.824275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.824304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.824506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.824622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.824647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.824761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.824864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.824892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.825085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.825203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.825230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.825323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.825478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.825503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.825597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.825685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.825710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.825819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.825904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.825929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.826014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.826126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.826151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.826232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.826320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.826351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.826451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.826541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.826567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.826657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.826766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.826791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.826872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.826985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.827009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.827085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.827223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.827251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.827371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.827484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.827509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.827616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.827732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.827757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.827872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.827960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.827984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.828125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.828253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.828281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.828417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.828527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.615 [2024-11-18 02:12:47.828552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.615 qpair failed and we were unable to recover it. 00:30:13.615 [2024-11-18 02:12:47.828659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.828745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.828777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.828938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.829082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.829107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.829218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.829323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.829349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.829443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.829527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.829551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.829634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.829743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.829768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.829904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.829990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.830016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.830102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.830210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.830235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.830350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.830433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.830458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.830605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.830726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.830754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.830878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.830999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.831024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.831184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.831338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.831375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.831471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.831551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.831577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.831688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.831801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.831827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.831909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.832013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.832037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.832118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.832229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.832271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.832426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.832573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.832602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.832716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.832865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.832894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.833001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.833084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.833110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.833191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.833270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.833295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.833451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.833583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.833608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.833722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.833859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.833884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.834033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.834170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.834211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.834360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.834497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.834522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.834671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.834780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.834805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.616 [2024-11-18 02:12:47.834905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.835042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.616 [2024-11-18 02:12:47.835069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.616 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.835151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.835261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.835286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.835413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.835516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.835541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.835666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.835794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.835819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.835914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.836002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.836028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.836144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.836257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.836281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.836440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.836551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.836603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.836707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.836836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.836880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.836999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.837117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.837143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.837248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.837385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.837411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.837495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.837570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.837595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.837677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.837758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.837783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.837922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.838035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.838063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.838165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.838268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.838293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.838409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.838530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.838555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.838669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.838814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.838839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.838930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.839096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.839126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.839285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.839455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.839500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.839626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.839752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.839777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.839901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.839994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.840023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.840146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.840284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.840316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.840439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.840538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.840563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.840675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.840760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.840785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.840945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.841064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.841106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.841220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.841377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.841406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.841537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.841672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.841698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.841810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.841936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.841964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.842052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.842143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.842172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.617 [2024-11-18 02:12:47.842279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.842395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.617 [2024-11-18 02:12:47.842424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.617 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.842549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.842638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.842662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.842819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.842944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.842972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.843060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.843177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.843222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.843302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.843466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.843493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.843588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.843729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.843754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.843916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.844039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.844083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.844172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.844322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.844348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.844457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.844529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.844554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.844669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.844774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.844799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.844934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.845091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.845117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.845264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.845383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.845409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.845525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.845641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.845667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.845785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.845929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.845955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.846038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.846152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.846178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.846263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.846414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.846440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.846550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.846699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.846727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.846856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.846969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.846994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.847109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.847190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.847214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.847325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.847414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.847458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.847553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.847640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.847669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.847781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.847895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.847920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.848037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.848148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.848174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.848255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.848390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.848419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.848566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.848698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.848724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.848844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.848982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.849008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.849124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.849203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.849229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.849341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.849502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.849528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.849645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.849751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.618 [2024-11-18 02:12:47.849776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.618 qpair failed and we were unable to recover it. 00:30:13.618 [2024-11-18 02:12:47.849889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.849978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.850002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.850146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.850256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.850282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.850423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.850538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.850562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.850675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.850765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.850791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.850908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.851014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.851038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.851123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.851251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.851293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.851415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.851500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.851524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.851618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.851700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.851726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.851873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.851980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.852006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.852165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.852288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.852343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.852473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.852624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.852652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.852777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.852901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.852943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.853049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.853128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.853153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.853294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.853399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.853424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.853540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.853671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.853699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.853791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.853914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.853941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.854089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.854205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.854229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.854332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.854436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.854461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.854589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.854671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.854696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.854835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.854914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.854938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.855053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.855141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.855166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.855278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.855395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.855424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.855515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.855643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.855672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.855793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.855958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.855983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.856096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.856180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.856205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.856295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.856452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.856477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.856563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.856692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.856720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.856807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.856932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.856960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.619 [2024-11-18 02:12:47.857067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.857137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.619 [2024-11-18 02:12:47.857162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.619 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.857247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.857364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.857391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.857479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.857629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.857657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.857742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.857861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.857890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.858017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.858102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.858128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.858268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.858393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.858420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.858505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.858613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.858638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.858755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.858904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.858932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.859040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.859180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.859206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.859354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.859514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.859539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.859619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.859743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.859786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.859897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.859984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.860009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.860088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.860198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.860224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.860326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.860410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.860435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.860553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.860698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.860726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.860851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.860967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.861010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.861123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.861199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.861224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.861302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.861448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.861475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.861556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.861662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.861690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.861813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.861933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.861960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.862074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.862183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.862208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.862317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.862398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.862425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.862514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.862679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.862703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.862842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.862943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.862971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.863105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.863186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.863211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.863344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.863435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.863460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.863544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.863694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.863722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.863821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.863943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.863970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.864101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.864209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.864233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.620 qpair failed and we were unable to recover it. 00:30:13.620 [2024-11-18 02:12:47.864347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.620 [2024-11-18 02:12:47.864524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.864550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.864661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.864817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.864845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.864938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.865089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.865130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.865241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.865373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.865399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.865536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.865641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.865667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.865746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.865893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.865919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.866003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.866117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.866143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.866258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.866364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.866390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.866558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.866706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.866734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.866829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.866951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.866980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.867107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.867232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.867257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.867374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.867459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.867484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.867603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.867706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.867749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.867889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.867977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.868005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.868093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.868204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.868245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.868356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.868476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.868505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.868623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.868744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.868787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.868929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.869067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.869096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.869191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.869333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.869364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.869448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.869583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.869608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.869731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.869830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.869873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.869983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.870136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.870165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.870262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.870373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.870400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.870502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.870593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.870617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.870774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.870895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.870923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.621 qpair failed and we were unable to recover it. 00:30:13.621 [2024-11-18 02:12:47.871044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.621 [2024-11-18 02:12:47.871164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.871196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.871345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.871479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.871525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.871628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.871710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.871736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.871850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.871971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.872000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.872094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.872179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.872208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.872324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.872488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.872513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.872655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.872764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.872789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.872904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.873033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.873061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.873197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.873315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.873341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.873442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.873610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.873635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.873743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.873825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.873851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.873969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.874046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.874071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.874193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.874324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.874355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.874446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.874608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.874636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.874740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.874819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.874843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.874953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.875043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.875071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.875173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.875334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.875386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.875510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.875639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.875667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.875798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.875932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.875957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.876127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.876287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.876320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.876414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.876524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.876550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.876635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.876743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.876768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.876891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.876972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.876997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.877109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.877191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.877215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.877330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.877496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.877520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.877662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.877758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.877785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.877951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.878037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.878062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.878181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.878268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.878293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.878417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.878532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.622 [2024-11-18 02:12:47.878558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.622 qpair failed and we were unable to recover it. 00:30:13.622 [2024-11-18 02:12:47.878660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.878772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.878799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.878882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.879022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.879047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.879125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.879239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.879265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.879401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.879511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.879536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.879650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.879812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.879840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.879967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.880103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.880129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.880214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.880305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.880338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.880419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.880530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.880555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.880694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.880792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.880817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.880934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.881069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.881095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.881206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.881292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.881324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.881435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.881518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.881543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.881625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.881696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.881724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.881835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.881918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.881943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.882056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.882170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.882195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.882343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.882468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.882497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.882613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.882767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.882791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.882902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.883009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.883035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.883210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.883326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.883353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.883490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.883633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.883662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.883754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.883873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.883901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.884001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.884116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.884141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.884226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.884338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.884371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.884522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.884617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.884645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.884767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.884893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.884918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.884996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.885108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.885134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.885263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.885394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.885423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.885567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.885679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.885705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.623 [2024-11-18 02:12:47.885816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.885954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.623 [2024-11-18 02:12:47.885980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.623 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.886092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.886201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.886226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.886337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.886449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.886492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.886657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.886770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.886797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.886919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.887037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.887063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.887160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.887269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.887295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.887425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.887539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.887583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.887725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.887837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.887861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.887951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.888063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.888093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.888224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.888367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.888393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.888493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.888616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.888656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.888771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.888902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.888930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.889046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.889153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.889178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.889299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.889416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.889441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.889571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.889693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.889720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.889840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.889967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.889994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.890116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.890278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.890305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.890451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.890589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.890615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.890726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.890837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.890865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.890983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.891099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.891127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.891240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.891389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.891419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.891550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.891639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.891665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.891819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.891958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.891984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.892091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.892175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.892200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.892340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.892477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.892503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.892640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.892720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.892745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.892897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.893054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.893078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.893191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.893270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.893320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.893449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.893548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.893572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.624 qpair failed and we were unable to recover it. 00:30:13.624 [2024-11-18 02:12:47.893694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.624 [2024-11-18 02:12:47.893795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.893819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.893933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.894089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.894129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.894245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.894330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.894355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.894444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.894556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.894581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.894658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.894769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.894796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.894963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.895089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.895116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.895229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.895361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.895403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.895482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.895618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.895643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.895757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.895853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.895880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.896009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.896129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.896156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.896237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.896340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.896383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.896501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.896648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.896676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.896843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.896964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.896991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.897106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.897190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.897232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.897324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.897461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.897485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.897614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.897707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.897734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.897870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.897986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.898014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.898096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.898190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.898215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.898304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.898445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.898472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.898625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.898714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.898741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.898858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.898968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.898993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.899083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.899192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.899232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.899359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.899450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.899479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.899655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.899804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.899828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.899950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.900066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.900091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.625 qpair failed and we were unable to recover it. 00:30:13.625 [2024-11-18 02:12:47.900182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.625 [2024-11-18 02:12:47.900322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.900347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.900430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.900535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.900563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.900686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.900776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.900804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.900936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.901047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.901072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.901212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.901300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.901336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.901459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.901562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.901589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.901692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.901775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.901799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.901937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.902024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.902049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.902174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.902307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.902338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.902445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.902573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.902600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.902711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.902823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.902847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.902958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.903062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.903086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.903202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.903340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.903366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.903441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.903556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.903580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.903689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.903829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.903855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.903966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.904075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.904099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.904238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.904365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.904394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.904524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.904605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.904633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.904752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.904900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.904941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.905056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.905143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.905167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.905274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.905402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.905431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.905522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.905619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.905647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.905741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.905824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.905851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.906007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.906097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.906123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.906241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.906355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.906381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.906487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.906595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.906621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.906728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.906808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.906835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.906989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.907108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.907134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.626 [2024-11-18 02:12:47.907238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.907323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.626 [2024-11-18 02:12:47.907350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.626 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.907478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.907630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.907671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.907785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.907907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.907936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.908074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.908149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.908175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.908296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.908427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.908455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.908577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.908684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.908708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.908869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.908985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.909012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.909128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.909260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.909284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.909382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.909469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.909494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.909608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.909696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.909722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.909831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.909951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.909978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.910109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.910247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.910271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.910408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.910526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.910551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.910672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.910767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.910794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.910886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.910981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.911010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.911122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.911235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.911259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.911362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.911488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.911530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.911609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.911722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.911747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.911834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.911969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.912011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.912149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.912289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.912320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.912457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.912615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.912640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.912755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.912869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.912895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.913010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.913114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.913141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.913270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.913362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.913388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.913477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.913610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.913652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.913780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.913867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.913907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.914023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.914143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.914171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.914279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.914372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.914398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.914531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.914646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.914671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.627 qpair failed and we were unable to recover it. 00:30:13.627 [2024-11-18 02:12:47.914747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.627 [2024-11-18 02:12:47.914864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.914888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.914998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.915127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.915155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.915286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.915427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.915453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.915547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.915658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.915701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.915803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.915923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.915951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.916073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.916193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.916219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.916306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.916426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.916451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.916609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.916705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.916730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.916840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.916981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.917010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.917093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.917219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.917247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.917358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.917495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.917520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.917645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.917801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.917829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.917930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.918058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.918086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.918202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.918333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.918361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.918469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.918558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.918583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.918675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.918790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.918815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.918959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.919076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.919120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.919231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.919396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.919426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.919560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.919666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.919692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.919795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.919902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.919927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.920071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.920203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.920231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.920351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.920445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.920473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.920633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.920750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.920776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.920857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.920964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.920990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.921142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.921222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.921248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.921407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.921559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.921600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.921718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.921802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.921827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.921957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.922045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.922087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.922224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.922301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.628 [2024-11-18 02:12:47.922333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.628 qpair failed and we were unable to recover it. 00:30:13.628 [2024-11-18 02:12:47.922469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.922593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.922621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.922758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.922863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.922888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.922999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.923104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.923132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.923224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.923332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.923358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.923441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.923547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.923577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.923737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.923848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.923873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.923954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.924099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.924124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.924263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.924370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.924403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.924492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.924598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.924623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.924708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.924817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.924842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.924928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.925030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.925055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.925131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.925270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.925295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.925438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.925585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.925626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.925757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.925894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.925920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.926058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.926180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.926209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.926328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.926466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.926491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.926574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.926653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.926679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.926828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.926917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.926946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.927055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.927160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.927203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.927302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.927469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.927498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.927622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.927758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.927783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.927897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.927985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.928010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.928121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.928249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.928276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.928428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.928507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.928532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.928731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.928869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.928912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.929074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.929185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.929209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.929291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.929387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.929412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.929525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.929670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.929695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.629 [2024-11-18 02:12:47.929859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.929976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.629 [2024-11-18 02:12:47.930004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.629 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.930135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.930262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.930288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.930406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.930524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.930550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.930662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.930739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.930763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.930870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.930989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.931018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.931133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.931271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.931296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.931427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.931558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.931587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.931708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.931912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.931940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.932100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.932245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.932286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.932435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.932550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.932576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.932718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.932854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.932880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.932967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.933076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.933120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.933269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.933396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.933438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.933551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.933661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.933686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.933830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.933940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.933982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.934069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.934178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.934202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.934335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.934459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.934486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.934623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.934732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.934757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.934918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.935033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.935078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.935190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.935299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.935341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.935427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.935580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.935608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.935773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.935911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.935935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.936068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.936166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.936194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.936346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.936435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.936460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.936539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.936654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.936680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.936771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.936884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.630 [2024-11-18 02:12:47.936910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.630 qpair failed and we were unable to recover it. 00:30:13.630 [2024-11-18 02:12:47.937030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.937194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.937220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.937361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.937469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.937497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.937642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.937768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.937793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.937903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.938019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.938044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.938129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.938270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.938295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.938391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.938531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.938558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.938679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.938808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.938836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.938995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.939085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.939110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.939199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.939276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.939300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.939395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.939505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.939529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.939615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.939773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.939801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.939915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.940055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.940080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.940228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.940342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.940370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.940500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.940606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.940646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.940775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.940922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.940954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.941089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.941226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.941251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.941337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.941445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.941470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.941581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.941724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.941772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.941893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.941991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.942019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.942175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.942260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.942285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.942410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.942516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.942541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.942617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.942729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.942754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.942825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.942915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.942940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.943056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.943157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.943181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.943325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.943436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.943464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.943567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.943649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.943673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.943772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.943894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.943921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.944055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.944144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.944169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.631 [2024-11-18 02:12:47.944304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.944404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.631 [2024-11-18 02:12:47.944432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.631 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.944554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.944681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.944708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.944829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.944937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.944964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.945098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.945234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.945259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.945392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.945481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.945509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.945607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.945696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.945723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.945837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.945964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.945989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.946135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.946241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.946266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.946388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.946505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.946530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.946658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.946781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.946808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.946904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.947019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.947046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.947216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.947332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.947357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.947443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.947533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.947557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.947670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.947793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.947821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.947911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.948041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.948066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.948181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.948285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.948318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.948427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.948543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.948569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.948708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.948833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.948872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.948979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.949084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.949109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.949197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.949343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.949369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.949532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.949670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.949696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.949824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.949918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.949947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.950044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.950188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.950216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.950327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.950465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.950491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.950597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.950731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.950756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.950867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.950953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.950979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.951058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.951207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.951232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.951307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.951407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.951434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.951587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.951736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.951765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.632 qpair failed and we were unable to recover it. 00:30:13.632 [2024-11-18 02:12:47.951908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.632 [2024-11-18 02:12:47.952022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.952047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.952132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.952281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.952316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.952433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.952525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.952550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.952633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.952777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.952802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.952941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.953070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.953098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.953192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.953291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.953327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.953435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.953544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.953569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.953662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.953802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.953831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.953994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.954111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.954140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.954277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.954443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.954468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.954584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.954694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.954719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.954846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.954982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.955006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.955095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.955201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.955226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.955352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.955505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.955534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.955666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.955757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.955783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.955864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.955945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.955969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.956121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.956205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.956234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.956353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.956472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.956502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.956660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.956774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.956799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.956903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.957016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.957042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.957169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.957322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.957364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.957460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.957537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.957580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.957714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.957795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.957820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.957899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.958033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.958062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.958156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.958269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.958317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.958402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.958515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.958541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.958628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.958714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.958739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.958821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.958934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.958959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.959112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.959258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.959283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.959416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.959503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.959532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.633 qpair failed and we were unable to recover it. 00:30:13.633 [2024-11-18 02:12:47.959648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.633 [2024-11-18 02:12:47.959790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.634 [2024-11-18 02:12:47.959816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.634 qpair failed and we were unable to recover it. 00:30:13.634 [2024-11-18 02:12:47.959929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.960048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.960078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.925 qpair failed and we were unable to recover it. 00:30:13.925 [2024-11-18 02:12:47.960234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.960384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.960414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.925 qpair failed and we were unable to recover it. 00:30:13.925 [2024-11-18 02:12:47.960530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.960621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.960648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.925 qpair failed and we were unable to recover it. 00:30:13.925 [2024-11-18 02:12:47.960746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.960870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.960896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.925 qpair failed and we were unable to recover it. 00:30:13.925 [2024-11-18 02:12:47.961028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.961130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.961156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.925 qpair failed and we were unable to recover it. 00:30:13.925 [2024-11-18 02:12:47.961270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.961368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.961395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.925 qpair failed and we were unable to recover it. 00:30:13.925 [2024-11-18 02:12:47.961475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.961558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.961583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.925 qpair failed and we were unable to recover it. 00:30:13.925 [2024-11-18 02:12:47.961729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.961811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.961836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.925 qpair failed and we were unable to recover it. 00:30:13.925 [2024-11-18 02:12:47.961993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.962119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.962147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.925 qpair failed and we were unable to recover it. 00:30:13.925 [2024-11-18 02:12:47.962282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.962430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.962456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.925 qpair failed and we were unable to recover it. 00:30:13.925 [2024-11-18 02:12:47.962586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.962672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.962700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.925 qpair failed and we were unable to recover it. 00:30:13.925 [2024-11-18 02:12:47.962837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.962951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.925 [2024-11-18 02:12:47.962976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.925 qpair failed and we were unable to recover it. 00:30:13.925 [2024-11-18 02:12:47.963141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.963231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.963259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.963346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.963474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.963502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.963630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.963740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.963768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.963875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.963988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.964014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.964104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.964215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.964240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.964353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.964489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.964518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.964637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.964789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.964818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.964949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.965034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.965059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.965148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.965259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.965285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.965405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.965516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.965544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.965660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.965789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.965816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.965956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.966093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.966117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.966285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.966459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.966486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.966590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.966702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.966727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.966817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.966918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.966946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.967081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.967159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.967183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.967332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.967471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.967501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.967588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.967739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.967767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.967917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.968064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.968090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.968227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.968338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.968364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.968473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.968611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.968636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.968769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.968891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.968918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.969074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.969193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.969218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.969301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.969399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.969423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.969511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.969597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.969622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.969730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.969891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.969919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.970012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.970108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.970156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.970300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.970419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.970445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.926 qpair failed and we were unable to recover it. 00:30:13.926 [2024-11-18 02:12:47.970556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.970677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.926 [2024-11-18 02:12:47.970704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.970831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.970954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.970981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.971095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.971239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.971266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.971397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.971489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.971514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.971642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.971785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.971810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.971892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.971980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.972006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.972121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.972275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.972303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.972425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.972513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.972538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.972625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.972718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.972746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.972900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.973021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.973048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.973174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.973260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.973288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.973428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.973510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.973535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.973637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.973762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.973791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.973877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.973976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.974005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.974125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.974238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.974266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.974374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.974484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.974510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.974643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.974726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.974755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.974905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.974991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.975015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.975126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.975241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.975270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.975430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.975506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.975532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.975632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.975747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.975776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.975926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.976023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.976049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.976185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.976347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.976374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.976483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.976590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.976616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.976749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.976881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.976906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.977022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.977146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.977174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.977302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.977402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.977430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.977570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.977709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.977734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.977890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.978050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.978076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.927 qpair failed and we were unable to recover it. 00:30:13.927 [2024-11-18 02:12:47.978215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.927 [2024-11-18 02:12:47.978320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.978349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.978469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.978560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.978589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.978719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.978811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.978837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.978941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.979068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.979094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.979206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.979299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.979367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.979482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.979610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.979637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.979771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.979914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.979939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.980102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.980227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.980255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.980358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.980486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.980513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.980638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.980761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.980789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.980957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.981040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.981064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.981149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.981259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.981285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.981432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.981535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.981563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.981687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.981776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.981820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.981927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.982036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.982060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.982187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.982273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.982301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.982395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.982491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.982518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.982603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.982688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.982715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.982820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.982904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.982928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.983045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.983177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.983204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.983299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.983400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.983435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.983566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.983685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.983727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.983811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.983896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.983922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.984033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.984164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.984191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.984331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.984447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.984471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.984608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.984722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.984749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.984873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.985012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.985036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.985130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.985242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.985282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.928 qpair failed and we were unable to recover it. 00:30:13.928 [2024-11-18 02:12:47.985386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.928 [2024-11-18 02:12:47.985497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.985521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.985607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.985708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.985750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.985892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.985997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.986022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.986126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.986213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.986240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.986391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.986526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.986550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.986659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.986783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.986810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.986971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.987079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.987103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.987185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.987296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.987367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.987503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.987629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.987657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.987808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.987909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.987933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.988039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.988141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.988165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.988291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.988410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.988438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.988560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.988655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.988682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.988818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.988942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.988966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.989107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.989195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.989219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.989305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.989425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.989451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.989589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.989722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.989746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.989854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.989939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.989963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.990105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.990184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.990208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.990323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.990401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.990426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.990567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.990690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.990717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.990843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.990993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.991017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.991104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.991187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.991212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.991296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.991462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.991491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.991583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.991707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.991735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.991900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.992016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.992041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.992163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.992287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.992318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.992478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.992564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.992592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.992713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.992838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.992865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.929 qpair failed and we were unable to recover it. 00:30:13.929 [2024-11-18 02:12:47.992990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.929 [2024-11-18 02:12:47.993111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.993139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.993264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.993371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.993396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.993534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.993674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.993699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.993827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.993950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.993977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.994120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.994233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.994257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.994367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.994448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.994474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.994630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.994786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.994812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.994972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.995132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.995156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.995281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.995443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.995469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.995553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.995656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.995680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.995808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.995921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.995947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.996095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.996208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.996232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.996323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.996462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.996487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.996578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.996686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.996710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.996842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.996994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.997040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.997150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.997279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.997306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.997463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.997585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.997631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.997736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.997850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.997875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.997986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.998101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.998126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.998235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.998343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.998369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.998465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.998574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.998601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.998733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.998813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.998839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.998929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.999032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.999059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.930 [2024-11-18 02:12:47.999181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.999267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.930 [2024-11-18 02:12:47.999294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.930 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:47.999384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:47.999507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:47.999534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:47.999637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:47.999749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:47.999775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:47.999907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.000027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.000055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.000218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.000326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.000355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.000448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.000603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.000628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.000711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.000791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.000816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.000894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.000974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.000998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.001085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.001194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.001220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.001361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.001453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.001480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.001642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.001717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.001742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.001870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.001995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.002020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.002138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.002272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.002321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.002431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.002512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.002537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.002629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.002735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.002760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.002892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.003044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.003072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.003221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.003366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.003395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.003518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.003667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.003694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.003849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.003961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.003986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.004120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.004220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.004244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.004330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.004466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.004490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.004577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.004742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.004783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.004873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.004981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.005006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.005186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.005273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.005299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.005394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.005530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.005557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.005718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.005863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.005888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.005977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.006083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.006109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.006193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.006362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.006391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.006520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.006602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.931 [2024-11-18 02:12:48.006629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.931 qpair failed and we were unable to recover it. 00:30:13.931 [2024-11-18 02:12:48.006718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.006870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.006898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.007007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.007157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.007182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.007345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.007468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.007496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.007638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.007757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.007782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.007904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.008000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.008025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.008136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.008242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.008268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.008388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.008528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.008553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.008640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.008763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.008792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.008888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.008969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.009011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.009128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.009207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.009232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.009344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.009453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.009496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.009655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.009798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.009823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.009971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.010090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.010118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.010230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.010304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.010339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.010454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.010625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.010652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.010850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.011009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.011034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.011150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.011275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.011303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.011523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.011630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.011655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.011808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.011893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.011922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.012048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.012180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.012205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.012287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.012401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.012427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.012540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.012654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.012679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.012816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.012966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.012993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.013131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.013270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.013295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.013404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.013563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.013588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.013704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.013808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.013833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.013985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.014076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.014104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.014190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.014319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.014348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.932 [2024-11-18 02:12:48.014463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.014583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.932 [2024-11-18 02:12:48.014625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.932 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.014734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.014876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.014901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.015035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.015186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.015213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.015370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.015509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.015534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.015663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.015759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.015787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.015890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.015976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.016002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.016148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.016262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.016290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.016402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.016519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.016561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.016677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.016762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.016789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.016906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.017013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.017039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.017144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.017265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.017307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.017409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.017521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.017565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.017685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.017781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.017809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.017913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.018001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.018026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.018184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.018306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.018341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.018477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.018613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.018638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.018803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.018927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.018954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.019059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.019198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.019223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.019352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.019465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.019493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.019617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.019736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.019764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.019868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.019953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.019980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.020140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.020220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.020244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.020423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.020507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.020534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.020608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.020680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.020705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.020821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.020924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.020950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.021037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.021150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.021174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.021251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.021349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.021374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.021490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.021623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.021651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.021747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.021865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.021892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.933 qpair failed and we were unable to recover it. 00:30:13.933 [2024-11-18 02:12:48.022029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.933 [2024-11-18 02:12:48.022111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.022136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.022264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.022365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.022393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.022511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.022640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.022664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.022812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.022963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.022990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.023099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.023184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.023208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.023329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.023472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.023499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.023622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.023734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.023761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.023890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.024039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.024074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.024210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.024326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.024352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.024436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.024518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.024542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.024667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.024801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.024829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.024930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.025085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.025111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.025251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.025362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.025388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.025576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.025661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.025686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.025822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.025940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.025968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.026137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.026251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.026275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.026374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.026460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.026484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.026569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.026695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.026727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.026817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.026940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.026967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.027065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.027216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.027243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.027372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.027458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.027483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.027592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.027755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.027782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.027919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.028001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.028027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.028152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.028234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.028275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.028447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.028540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.028565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.934 qpair failed and we were unable to recover it. 00:30:13.934 [2024-11-18 02:12:48.028649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.934 [2024-11-18 02:12:48.028757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.028782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.028903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.028996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.029025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.029112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.029204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.029231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.029340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.029460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.029484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.029564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.029726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.029753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.029876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.030035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.030064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.030182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.030306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.030341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.030489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.030601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.030626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.030713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.030828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.030854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.030964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.031061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.031089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.031192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.031287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.031332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.031439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.031521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.031546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.031661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.031762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.031789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.031948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.032073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.032116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.032207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.032363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.032391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.032538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.032682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.032706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.032869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.032998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.033023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.033138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.033270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.033298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.033426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.033544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.033572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.033700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.033807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.033834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.033968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.034091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.034118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.034253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.034367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.034393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.034474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.034621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.034648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.034781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.034897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.034922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.035049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.035144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.035172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.035302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.035454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.035497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.035601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.035712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.035736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.035839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.035947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.035972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.036057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.036224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.935 [2024-11-18 02:12:48.036251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.935 qpair failed and we were unable to recover it. 00:30:13.935 [2024-11-18 02:12:48.036354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.036472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.036499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.036593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.036709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.036737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.036897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.037009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.037034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.037141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.037231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.037258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.037399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.037527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.037555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.037645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.037774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.037798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.037890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.037973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.037997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.038106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.038234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.038259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.038378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.038465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.038508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.038633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.038751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.038778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.038934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.039044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.039069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.039175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.039276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.039303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.039416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.039538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.039565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.039659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.039738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.039765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.039905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.039999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.040028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.040206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.040322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.040348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.040443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.040577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.040604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.040723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.040847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.040876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.041014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.041095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.041119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.041244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.041344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.041385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.041502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.041663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.041690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.041818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.041990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.042015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.042155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.042268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.042293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.042462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.042556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.042583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.042701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.042821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.042849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.042975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.043124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.043148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.043235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.043333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.043360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.043475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.043611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.043639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.936 qpair failed and we were unable to recover it. 00:30:13.936 [2024-11-18 02:12:48.043735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.043852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.936 [2024-11-18 02:12:48.043880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.043975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.044072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.044100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.044232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.044344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.044369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.044494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.044609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.044635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.044757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.044844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.044871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.044998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.045116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.045144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.045273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.045362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.045387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.045548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.045673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.045716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.045822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.045916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.045941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.046045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.046168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.046195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.046341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.046432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.046457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.046567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.046695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.046722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.046824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.046941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.046969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.047122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.047247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.047276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.047426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.047505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.047530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.047646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.047736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.047764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.047888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.047988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.048016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.048117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.048212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.048239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.048348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.048432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.048457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.048539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.048649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.048674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.048845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.048937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.048965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.049089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.049209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.049238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.049349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.049462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.049488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.049640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.049738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.049768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.049888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.050008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.050036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.050131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.050224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.050252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.050358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.050469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.050495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.050652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.050750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.050778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.937 qpair failed and we were unable to recover it. 00:30:13.937 [2024-11-18 02:12:48.050899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.051024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.937 [2024-11-18 02:12:48.051052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.051177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.051296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.051331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.051427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.051564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.051590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.051676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.051785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.051828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.051951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.052030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.052058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.052152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.052291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.052324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.052436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.052543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.052569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.052678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.052766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.052793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.052913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.053036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.053064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.053155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.053271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.053303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.053414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.053519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.053544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.053659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.053823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.053865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.053973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.054109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.054135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.054297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.054429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.054458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.054572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.054707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.054733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.054822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.054926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.054955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.055097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.055177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.055202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.055335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.055441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.055470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.055603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.055687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.055712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.055824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.055936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.055960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.056052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.056133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.056158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.056247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.056367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.056397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.056524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.056639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.056664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.056778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.056866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.056891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.057051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.057178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.057206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.057327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.057442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.057467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.057546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.057651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.057675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.057755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.057878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.057903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.938 [2024-11-18 02:12:48.058035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.058170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.938 [2024-11-18 02:12:48.058195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.938 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.058309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.058407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.058433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.058550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.058661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.058687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.058800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.058913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.058939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.059015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.059146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.059175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.059297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.059406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.059435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.059565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.059680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.059706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.059787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.059899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.059925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.060074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.060180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.060206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.060325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.060462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.060505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.060611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.060725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.060751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.060864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.060941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.060968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.061131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.061250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.061278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.061407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.061531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.061560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.061676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.061790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.061817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.061901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.062016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.062042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.062129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.062239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.062265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.062339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.062421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.062446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.062587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.062701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.062726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.062853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.062937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.062962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.063073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.063232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.063258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.063397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.063482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.063507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.063620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.063703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.063728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.063846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.063925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.063951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.064063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.064177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.064204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.939 qpair failed and we were unable to recover it. 00:30:13.939 [2024-11-18 02:12:48.064306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.939 [2024-11-18 02:12:48.064434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.064462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.064597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.064683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.064708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.064792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.064898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.064927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.065023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.065150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.065179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.065344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.065455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.065481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.065599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.065707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.065732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.065845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.065919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.065944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.066061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.066162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.066196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.066323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.066484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.066510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.066597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.066737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.066763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.066839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.066940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.066969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.067051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.067146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.067173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.067302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.067452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.067480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.067605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.067746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.067771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.067850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.067932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.067956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.068097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.068207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.068233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.068341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.068453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.068478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.068586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.068666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.068696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.068808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.068916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.068941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.069078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.069186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.069215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.069341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.069440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.069470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.069581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.069688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.069713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.069795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.069879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.069904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.070018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.070151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.070179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.070299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.070441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.070467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.070582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.070667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.070692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.070833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.070909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.070934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.071036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.071120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.071147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.071254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.071383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.940 [2024-11-18 02:12:48.071412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.940 qpair failed and we were unable to recover it. 00:30:13.940 [2024-11-18 02:12:48.071518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.071597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.071622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.071738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.071865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.071893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.071989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.072089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.072113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.072226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.072304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.072337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.072450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.072531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.072557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.072656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.072766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.072794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.072911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.073010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.073035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.073157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.073244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.073269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.073413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.073494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.073520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.073614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.073768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.073796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.073890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.073975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.074003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.074131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.074250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.074278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.074423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.074501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.074526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.074644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.074784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.074808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.074897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.075018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.075043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.075179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.075260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.075285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.075370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.075485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.075512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.075654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.075738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.075763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.075883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.075989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.076014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.076094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.076185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.076211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.076342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.076425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.076450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.076585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.076678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.076706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.076859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.076952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.076980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.077104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.077229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.077255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.077373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.077486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.077513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.077600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.077690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.077715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.077800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.077975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.078000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.078115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.078222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.941 [2024-11-18 02:12:48.078247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.941 qpair failed and we were unable to recover it. 00:30:13.941 [2024-11-18 02:12:48.078334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.078470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.078496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.078584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.078681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.078710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.078807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.078904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.078945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.079054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.079164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.079189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.079319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.079429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.079454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.079543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.079622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.079647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.079761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.079890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.079919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.080046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.080174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.080202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.080326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.080455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.080480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.080592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.080673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.080698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.080812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.080954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.080981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.081067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.081185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.081218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.081349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.081462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.081487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.081565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.081673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.081698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.081790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.081900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.081941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.082045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.082128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.082157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.082281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.082364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.082390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.082462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.082574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.082599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.082712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.082797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.082838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.082966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.083086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.083114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.083215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.083324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.083358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.083456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.083543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.083567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.083658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.083749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.083775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.083850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.083931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.083957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.084076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.084190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.084216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.084348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.084472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.084501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.084625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.084733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.084759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.084869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.084996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.085024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.942 qpair failed and we were unable to recover it. 00:30:13.942 [2024-11-18 02:12:48.085181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.085267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.942 [2024-11-18 02:12:48.085292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.085379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.085493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.085519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.085627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.085708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.085752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.085850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.085937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.085964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.086080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.086170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.086194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.086316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.086401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.086425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.086540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.086635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.086677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.086790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.086903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.086927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.087011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.087148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.087173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.087351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.087433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.087458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.087576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.087689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.087715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.087846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.087970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.087998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.088130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.088248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.088274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.088367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.088475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.088500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.088608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.088715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.088740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.088827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.088944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.088972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.089125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.089242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.089267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.089425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.089550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.089578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.089677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.089778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.089803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.089920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.090008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.090034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.090147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.090284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.090319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.090462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.090623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.090651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.090790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.090906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.090933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.091088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.091224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.091250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.091344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.091454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.091480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.091604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.091724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.091754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.091878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.091971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.092000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.092130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.092228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.092270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.943 [2024-11-18 02:12:48.092400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.092507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.943 [2024-11-18 02:12:48.092533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.943 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.092639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.092783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.092825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.092938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.093015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.093040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.093133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.093274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.093302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.093439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.093549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.093575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.093729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.093838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.093864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.094003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.094159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.094189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.094267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.094407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.094437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.094590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.094703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.094751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.094867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.094954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.094982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.095083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.095218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.095243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.095404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.095526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.095555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.095690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.095769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.095794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.095934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.096011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.096036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.096117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.096189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.096214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.096292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.096402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.096428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.096538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.096647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.096673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.096794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.096897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.096923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.097002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.097111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.097137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.097274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.097397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.097424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.097563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.097638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.097664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.097757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.097895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.097921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.098026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.098140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.098166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.098277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.098423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.098452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.098586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.098707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.098733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.944 [2024-11-18 02:12:48.098821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.098907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.944 [2024-11-18 02:12:48.098934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.944 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.099042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.099153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.099177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.099298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.099423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.099448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.099535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.099637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.099662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.099790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.099928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.099953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.100047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.100159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.100183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.100270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.100365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.100392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.100495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.100600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.100625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.100735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.100869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.100896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.100979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.101059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.101084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.101162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.101289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.101346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.101482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.101597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.101622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.101725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.101821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.101850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.101966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.102055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.102083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.102170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.102253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.102278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.102370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.102519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.102546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.102666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.102775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.102802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.102890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.102968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.102994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.103109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.103190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.103216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.103400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.103540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.103566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.103705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.103857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.103885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.104008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.104133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.104162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.104261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.104388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.104430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.104518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.104608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.104635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.104775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.104861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.104887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.105002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.105141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.105166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.105263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.105388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.105416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.105495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.105589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.105614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.105727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.105812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.105838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.945 qpair failed and we were unable to recover it. 00:30:13.945 [2024-11-18 02:12:48.105925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.945 [2024-11-18 02:12:48.106032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.106058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.106169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.106304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.106336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.106412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.106497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.106522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.106611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.106722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.106748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.106829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.106949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.106975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.107095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.107181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.107209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.107323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.107413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.107440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.107555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.107738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.107764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.107876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.108015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.108043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.108146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.108280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.108305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.108403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.108545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.108570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.108700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.108800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.108825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.108941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.109049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.109074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.109153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.109270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.109297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.109455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.109572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.109598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.109685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.109814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.109843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.109928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.110016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.110045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.110142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.110248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.110277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.110386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.110468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.110494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.110601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.110700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.110725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.110862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.110947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.110974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.111105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.111215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.111242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.111354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.111466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.111492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.111572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.111663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.111691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.111850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.111983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.112011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.112104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.112199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.112227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.112333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.112445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.112471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.112578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.112690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.112716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.946 qpair failed and we were unable to recover it. 00:30:13.946 [2024-11-18 02:12:48.112805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.112888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.946 [2024-11-18 02:12:48.112913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.113019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.113102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.113127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.113213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.113321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.113347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.113424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.113559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.113585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.113692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.113800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.113826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.113912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.114064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.114097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.114196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.114326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.114353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.114464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.114549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.114576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.114730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.114876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.114902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.115045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.115159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.115184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.115328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.115416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.115442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.115518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.115675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.115703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.115860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.115975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.116004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.116155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.116304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.116338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.116479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.116567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.116592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.116732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.116844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.116876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.117026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.117110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.117136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.117261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.117374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.117417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.117533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.117614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.117642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.117754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.117884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.117913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.118007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.118099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.118126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.118235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.118323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.118350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.118498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.118577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.118603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.118733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.118854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.118883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.118985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.119072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.119100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.119198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.119325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.119360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.119491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.119604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.119630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.119758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.119883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.119912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.120032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.120126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.947 [2024-11-18 02:12:48.120156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.947 qpair failed and we were unable to recover it. 00:30:13.947 [2024-11-18 02:12:48.120284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.120387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.120418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.120544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.120648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.120674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.120781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.120897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.120923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.121036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.121118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.121145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.121225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.121337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.121364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.121456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.121543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.121570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.121693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.121816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.121849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.121947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.122066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.122094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.122193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.122307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.122342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.122479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.122588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.122613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.122702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.122788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.122813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.122932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.123021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.123048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.123133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.123214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.123240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.123333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.123444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.123470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.123553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.123695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.123721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.123861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.123969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.124010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.124106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.124229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.124271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.124373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.124484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.124509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.124631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.124749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.124777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.124900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.125016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.125044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.125202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.125342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.125372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.125488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.125601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.125627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.125711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.125814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.125840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.125949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.126035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.126060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.948 qpair failed and we were unable to recover it. 00:30:13.948 [2024-11-18 02:12:48.126140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.126226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.948 [2024-11-18 02:12:48.126252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.126361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.126472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.126498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.126577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.126712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.126741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.126866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.126967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.126996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.127116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.127200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.127230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.127345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.127460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.127486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.127611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.127699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.127725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.127819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.127907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.127935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.128106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.128228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.128256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.128367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.128507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.128533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.128645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.128783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.128812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.128939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.129039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.129065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.129174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.129262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.129287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.129389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.129464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.129489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.129631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.129719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.129747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.129834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.129921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.129950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.130059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.130134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.130160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.130246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.130357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.130383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.130502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.130579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.130604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.130711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.130846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.130876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.130995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.131111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.131139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.131280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.131400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.131426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.131582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.131707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.131736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.131835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.131929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.131960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.132055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.132143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.132171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.132301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.132421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.132447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.132561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.132684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.132710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.132821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.132939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.132982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.133089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.133215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.949 [2024-11-18 02:12:48.133241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.949 qpair failed and we were unable to recover it. 00:30:13.949 [2024-11-18 02:12:48.133350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.133460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.133486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.133565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.133675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.133701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.133808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.133889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.133915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.134027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.134140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.134166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.134254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.134337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.134363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.134471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.134551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.134576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.134658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.134737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.134763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.134869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.134974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.134999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.135085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.135163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.135189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.135301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.135417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.135446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.135532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.135624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.135654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.135756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.135867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.135892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.136004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.136112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.136137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.136290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.136381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.136411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.136537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.136658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.136686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.136778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.136895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.136923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.137027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.137133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.137159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.137249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.137336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.137363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.137440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.137513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.137538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.137648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.137730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.137756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.137844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.137936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.137962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.138076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.138150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.138175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.138320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.138484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.138510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.138647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.138769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.138794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.138885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.138993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.139019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.139135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.139235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.139265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.139419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.139547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.139575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.139695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.139836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.139862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.950 qpair failed and we were unable to recover it. 00:30:13.950 [2024-11-18 02:12:48.139987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.950 [2024-11-18 02:12:48.140078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.140103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.140215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.140346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.140377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.140471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.140590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.140616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.140726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.140847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.140872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.141015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.141129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.141154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.141264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.141371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.141397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.141485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.141621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.141650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.141744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.141862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.141892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.142045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.142149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.142175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.142256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.142387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.142417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.142541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.142663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.142692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.142792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.142881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.142910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.143041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.143154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.143180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.143292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.143440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.143466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.143553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.143631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.143656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.143796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.143911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.143937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.144086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.144178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.144204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.144318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.144423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.144452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.144573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.144657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.144685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.144801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.144919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.144948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.145102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.145193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.145219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.145298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.145463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.145493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.145611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.145733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.145762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.145855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.145956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.145982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.146122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.146207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.146233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.146371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.146509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.146538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.146620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.146745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.146775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.146883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.147013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.147039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.951 qpair failed and we were unable to recover it. 00:30:13.951 [2024-11-18 02:12:48.147119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.147206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.951 [2024-11-18 02:12:48.147232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.147322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.147432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.147458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.147572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.147663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.147688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.147770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.147855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.147880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.147958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.148070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.148095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.148224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.148316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.148359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.148503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.148621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.148647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.148743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.148824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.148853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.148994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.149095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.149121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.149236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.149365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.149394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.149489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.149611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.149639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.149727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.149831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.149857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.149976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.150113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.150139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.150219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.150327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.150357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.150474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.150629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.150655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.150738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.150823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.150849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.150939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.151023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.151050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.151163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.151300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.151332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.151471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.151571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.151600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.151703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.151809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.151835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.151946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.152062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.152087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.152172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.152286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.152318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.152454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.152546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.152576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.152674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.152799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.152827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.152930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.153014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.153039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.153157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.153286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.153331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.153484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.153573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.153601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.153720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.153814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.153843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.952 qpair failed and we were unable to recover it. 00:30:13.952 [2024-11-18 02:12:48.153942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.154055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.952 [2024-11-18 02:12:48.154085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.154222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.154355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.154385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.154510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.154629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.154658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.154751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.154870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.154898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.155051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.155164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.155189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.155362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.155502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.155527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.155610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.155750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.155778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.155876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.155992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.156021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.156154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.156235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.156261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.156404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.156530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.156559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.156702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.156788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.156819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.156957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.157041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.157067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.157184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.157266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.157292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.157468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.157581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.157610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.157766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.157895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.157923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.158034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.158142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.158166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.158277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.158393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.158420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.158532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.158623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.158650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.158790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.158882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.158911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.159072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.159189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.159217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.159345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.159436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.159465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.159592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.159679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.159708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.953 [2024-11-18 02:12:48.159852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.159944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.953 [2024-11-18 02:12:48.159969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.953 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.160053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.160139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.160165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.160292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.160406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.160432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.160519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.160655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.160681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.160770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.160879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.160905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.161055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.161145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.161174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.161278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.161444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.161471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.161623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.161753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.161778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.161890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.161971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.162002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.162115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.162198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.162225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.162316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.162426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.162452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.162589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.162673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.162698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.162808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.162959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.162987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.163077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.163172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.163200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.163303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.163422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.163448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.163555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.163727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.163756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.163848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.163980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.164005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.164096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.164209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.164235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.164317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.164435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.164461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.164546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.164686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.164712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.164848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.164982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.165008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.165115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.165228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.165254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.165342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.165458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.165484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.165611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.165752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.165780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.165897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.166051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.166079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.166196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.166325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.166368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.166454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.166565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.166591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.166677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.166815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.166844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.166972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.167112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.167137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.954 qpair failed and we were unable to recover it. 00:30:13.954 [2024-11-18 02:12:48.167231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.954 [2024-11-18 02:12:48.167337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.167365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.167443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.167556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.167583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.167667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.167750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.167776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.167895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.167975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.168002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.168118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.168219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.168248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.168386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.168501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.168526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.168663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.168785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.168814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.168964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.169083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.169112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.169209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.169343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.169386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.169509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.169590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.169616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.169729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.169814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.169841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.169938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.170085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.170113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.170263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.170395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.170424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.170550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.170656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.170681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.170772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.170887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.170917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.171030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.171118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.171143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.171254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.171329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.171356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.171473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.171591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.171617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.171721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.171800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.171827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.171941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.172054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.172080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.172168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.172256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.172281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.172365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.172483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.172508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.172595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.172704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.172729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.172841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.172914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.172940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.173022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.173144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.173173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.173283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.173403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.173429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.173573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.173657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.173683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.173799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.173908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.173935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.955 qpair failed and we were unable to recover it. 00:30:13.955 [2024-11-18 02:12:48.174017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.174150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.955 [2024-11-18 02:12:48.174180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.174323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.174408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.174433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.174555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.174666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.174691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.174777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.174885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.174910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.175024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.175131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.175157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.175238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.175350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.175377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.175454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.175533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.175559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.175647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.175749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.175775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.175884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.176000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.176027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.176172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.176254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.176280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.176394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.176545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.176573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.176662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.176782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.176811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.176903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.177019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.177063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.177200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.177332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.177359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.177473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.177601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.177630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.177737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.177845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.177870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.177982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.178098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.178125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.178208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.178299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.178331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.178442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.178556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.178581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.178660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.178794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.178820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.178940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.179052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.179077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.179195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.179302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.179336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.179434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.179546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.179574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.179663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.179765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.179790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.179905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.180046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.180070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.180149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.180288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.180321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.180413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.180525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.180551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.180664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.180766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.180792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.180869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.180950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.956 [2024-11-18 02:12:48.180976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.956 qpair failed and we were unable to recover it. 00:30:13.956 [2024-11-18 02:12:48.181054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.181135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.181160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.181272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.181393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.181420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.181508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.181625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.181652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.181735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.181844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.181869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.181987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.182077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.182105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.182208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.182299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.182335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.182433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.182541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.182568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.182656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.182778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.182804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.182946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.183056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.183082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.183164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.183276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.183302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.183426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.183532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.183557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.183640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.183753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.183778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.183857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.183972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.183997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.184109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.184226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.184252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.184366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.184504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.184530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.184627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.184761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.184788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.184876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.184962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.184987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.185067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.185149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.185174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.185281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.185411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.185438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.185548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.185655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.185681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.185760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.185873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.185899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.186010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.186120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.186146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.186287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.186377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.186405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.186495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.186585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.186612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.186728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.186811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.186837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.186911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.187055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.187081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.187191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.187272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.187297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.187419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.187508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.187534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.957 qpair failed and we were unable to recover it. 00:30:13.957 [2024-11-18 02:12:48.187614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.957 [2024-11-18 02:12:48.187724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.187749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.187856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.187967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.187992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.188105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.188191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.188217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.188320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.188427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.188453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.188562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.188699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.188725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.188833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.188928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.188960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.189071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.189184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.189210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.189391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.189473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.189499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.189612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.189721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.189747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.189858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.189944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.189970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.190052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.190170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.190195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.190316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.190407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.190433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.190517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.190626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.190652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.190726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.190834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.190859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.190942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.191020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.191046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.191155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.191268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.191298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.191426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.191542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.191567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.191675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.191780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.191806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.191885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.191978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.192005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.192088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.192228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.192253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.192337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.192422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.192447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.192562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.192648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.192674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.192817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.192952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.192980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.193077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.193196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.193224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.193354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.193433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.958 [2024-11-18 02:12:48.193458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.958 qpair failed and we were unable to recover it. 00:30:13.958 [2024-11-18 02:12:48.193535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.193624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.193654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.193736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.193822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.193847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.193961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.194081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.194109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.194239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.194327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.194354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.194467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.194553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.194579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.194691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.194772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.194796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.194909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.195025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.195050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.195166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.195270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.195294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.195388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.195498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.195524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.195665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.195741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.195767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.195884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.195991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.196017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.196112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.196222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.196248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.196360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.196500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.196526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.196637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.196759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.196788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.196922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.197034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.197059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.197171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.197283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.197319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.197435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.197522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.197548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.197634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.197745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.197770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.197851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.197991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.198016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.198128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.198214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.198239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.198324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.198439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.198464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.198561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.198682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.198709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.198872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.199022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.199050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.199182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.199295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.199327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.199406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.199487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.199514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.199626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.199700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.199724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.199837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.199923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.199948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.200037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.200123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.200148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.959 qpair failed and we were unable to recover it. 00:30:13.959 [2024-11-18 02:12:48.200260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.200342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.959 [2024-11-18 02:12:48.200367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.200447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.200558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.200584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.200735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.200855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.200883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.201015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.201158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.201184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.201317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.201457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.201482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.201588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.201677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.201702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.201787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.201938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.201964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.202046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.202128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.202154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.202304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.202399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.202424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.202539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.202674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.202702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.202804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.202909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.202934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.203019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.203133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.203159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.203286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.203391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.203418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.203507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.203593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.203619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.203727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.203838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.203865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.203943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.204048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.204074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.204164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.204264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.204294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.204460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.204546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.204572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.204651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.204732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.204757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.204831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.204934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.204960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.205073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.205180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.205205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.205291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.205409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.205435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.205518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.205601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.205627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.205704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.205814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.205844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.205932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.206039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.206065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.206172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.206249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.206275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.206391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.206498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.206524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.206613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.206722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.206748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.960 [2024-11-18 02:12:48.206830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.206903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.960 [2024-11-18 02:12:48.206929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.960 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.207077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.207207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.207235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.207333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.207432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.207458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.207530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.207613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.207638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.207743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.207819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.207844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.207959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.208069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.208095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.208231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.208363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.208390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.208504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.208586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.208611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.208691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.208778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.208803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.208928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.209077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.209105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.209253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.209392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.209418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.209508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.209598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.209623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.209710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.209800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.209825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.209901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.210038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.210063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.210191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.210275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.210303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.210411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.210515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.210541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.210660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.210763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.210791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.210895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.210980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.211008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.211179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.211252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.211277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.211394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.211510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.211535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.211645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.211780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.211822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.211917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.211997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.212023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.212137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.212249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.212275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.212372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.212487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.212513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.212593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.212678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.212703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.212809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.212886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.212912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.213030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.213149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.213174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.213262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.213377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.213404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.213481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.213594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.961 [2024-11-18 02:12:48.213620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.961 qpair failed and we were unable to recover it. 00:30:13.961 [2024-11-18 02:12:48.213712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.213803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.213832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.213937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.214060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.214088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.214220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.214326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.214352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.214462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.214544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.214570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.214747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.214863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.214892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.215012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.215101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.215130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.215235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.215321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.215348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.215423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.215566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.215592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.215670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.215774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.215799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.215907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.215996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.216037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.216184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.216267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.216292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.216381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.216532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.216558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.216694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.216796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.216824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.216910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.217027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.217056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.217184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.217302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.217353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.217516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.217675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.217701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.217790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.217905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.217931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.218018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.218090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.218120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.218200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.218287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.218320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.218434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.218547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.218573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.218654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.218818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.218846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.218961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.219077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.219121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.219234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.219323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.219349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.219509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.219668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.219693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.219801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.219914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.962 [2024-11-18 02:12:48.219942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.962 qpair failed and we were unable to recover it. 00:30:13.962 [2024-11-18 02:12:48.220031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.220130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.220159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.220284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.220404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.220430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.220542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.220702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.220735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.220834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.220955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.220983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.221131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.221303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.221335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.221424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.221563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.221588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.221671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.221795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.221820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.221923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.222045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.222073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.222230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.222347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.222374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.222507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.222649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.222675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.222788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.222904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.222930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.223044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.223121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.223146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.223228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.223317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.223343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.223456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.223539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.223565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.223640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.223748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.223774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.223885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.224050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.224078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.224241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.224361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.224406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.224518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.224600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.224626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.224733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.224847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.224872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.224963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.225052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.225077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.225157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.225268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.225293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.225410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.225549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.225575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.225684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.225791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.225816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.225931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.226052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.226078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.226193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.226317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.226344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.226457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.226570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.226596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.226683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.226792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.226818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.226907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.227017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.227042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.963 qpair failed and we were unable to recover it. 00:30:13.963 [2024-11-18 02:12:48.227174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.963 [2024-11-18 02:12:48.227315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.227341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.227435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.227524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.227551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.227658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.227752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.227781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.227872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.228000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.228025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.228138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.228217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.228243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.228395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.228517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.228543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.228623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.228761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.228787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.228884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.228979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.229004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.229089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.229194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.229220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.229306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.229395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.229422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.229541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.229621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.229646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.229752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.229861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.229887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.229992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.230101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.230127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.230221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.230384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.230410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.230492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.230578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.230603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.230747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.230884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.230911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.231033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.231142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.231170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.231253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.231388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.231414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.231494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.231575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.231601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.231687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.231834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.231859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.231989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.232110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.232139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.232243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.232324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.232351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.232429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.232535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.232561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.232668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.232803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.232829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.232941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.233068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.233098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.233260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.233351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.233381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.233512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.233665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.233690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.233803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.233924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.233953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.234100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.234220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.964 [2024-11-18 02:12:48.234248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.964 qpair failed and we were unable to recover it. 00:30:13.964 [2024-11-18 02:12:48.234382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.234475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.234500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.234588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.234674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.234699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.234859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.234988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.235015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.235137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.235247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.235276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.235411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.235495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.235520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.235661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.235740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.235781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.235933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.236080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.236109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.236233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.236358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.236384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.236505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.236621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.236646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.236776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.236871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.236896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.236987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.237078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.237122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.237206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.237306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.237357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.237444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.237528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.237554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.237658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.237821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.237863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.237996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.238083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.238110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.238221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.238337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.238381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.238516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.238637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.238662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.238825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.238945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.238973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.239102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.239215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.239243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.239338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.239439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.239465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.239573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.239684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.239709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.239794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.239904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.239949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.240075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.240155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.240183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.240316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.240434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.240462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.240582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.240695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.240721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.240821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.240944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.240972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.241062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.241181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.241210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.241368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.241483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.241509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.965 qpair failed and we were unable to recover it. 00:30:13.965 [2024-11-18 02:12:48.241621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.965 [2024-11-18 02:12:48.241757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.241783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.241866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.241974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.242002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.242120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.242237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.242266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.242401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.242570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.242596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.242674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.242785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.242811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.242883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.243010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.243052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.243156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.243280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.243308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.243441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.243560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.243588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.243691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.243812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.243837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.243916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.244034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.244077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.244219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.244354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.244381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.244492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.244570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.244595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.244703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.244840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.244865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.244976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.245112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.245138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.245282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.245388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.245416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.245541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.245641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.245666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.245784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.245898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.245923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.246029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.246117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.246146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.246292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.246399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.246424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.246501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.246605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.246634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.246715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.246799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.246824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.246908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.247045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.247071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.247186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.247286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.247316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.247424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.247506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.247531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.247621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.247737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.247762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.247889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.248002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.248030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.248149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.248236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.248264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.248402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.248518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.248544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.966 [2024-11-18 02:12:48.248624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.248731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.966 [2024-11-18 02:12:48.248757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.966 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.248897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.249016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.249041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.249163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.249337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.249367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.249489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.249580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.249609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.249718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.249825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.249850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.249977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.250068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.250097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.250218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.250344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.250373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.250502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.250630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.250657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.250789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.250868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.250893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.250981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.251073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.251098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.251214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.251317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.251347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.251465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.251560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.251588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.251728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.251801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.251826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.251910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.251994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.252019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.252126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.252204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.252230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.252381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.252519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.252544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.252656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.252762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.252787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.252949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.253035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.253063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.253161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.253306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.253340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.253468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.253627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.253652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.253767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.253847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.253873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.253977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.254088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.254116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.254235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.254321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.254350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.254441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.254592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.254634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.254712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.254821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.254846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.967 [2024-11-18 02:12:48.254970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.255089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.967 [2024-11-18 02:12:48.255117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.967 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.255218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.255352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.255378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.255500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.255628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.255672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.255810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.255953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.255995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.256107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.256234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.256275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.256387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.256478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.256504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.256615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.256708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.256751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.256869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.256956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.256981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.257061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.257202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.257230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.257367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.257453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.257478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.257560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.257667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.257692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.257840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.257973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.257999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.258128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.258263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.258288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.258392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.258550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.258579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.258710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.258827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.258856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.258978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.259051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.259077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.259185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.259270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.259320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.259421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.259540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.259588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.259708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.259825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.259851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.259962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.260069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.260095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.260186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.260325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.260352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.260435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.260548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.260575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.260664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.260752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.260777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.260860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.260937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.260963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.261071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.261146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.261171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.261287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.261444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.261474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.261564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.261685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.261714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.261847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.261962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.261988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.262072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.262147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.262173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.968 qpair failed and we were unable to recover it. 00:30:13.968 [2024-11-18 02:12:48.262346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.968 [2024-11-18 02:12:48.262454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.262479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.262556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.262695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.262737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.262853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.262969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.262994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.263121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.263211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.263239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.263329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.263427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.263456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.263604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.263727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.263753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.263864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.263950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.263976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.264090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.264198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.264224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.264407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.264525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.264551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.264695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.264844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.264887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.264996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.265074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.265100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.265215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.265372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.265398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.265505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.265666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.265694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.265793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.265894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.265937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.266041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.266120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.266146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.266272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.266401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.266430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.266514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.266603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.266632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.266715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.266809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.266838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.266932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.267021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.267047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.267159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.267324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.267357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.267523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.267657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.267686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.267808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.267924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.267968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.268083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.268172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.268198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.268328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.268432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.268458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.268572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.268661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.268687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.268773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.268905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.268935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.269073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.269212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.269238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.269346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.269478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.269505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.269603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.269720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.269746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.269859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.270006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.270031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.270173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.270287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.270337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.969 qpair failed and we were unable to recover it. 00:30:13.969 [2024-11-18 02:12:48.270452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.969 [2024-11-18 02:12:48.270574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.270599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.270722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.270842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.270871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.271020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.271136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.271164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.271298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.271440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.271466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.271542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.271647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.271676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.271761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.271918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.271944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.272018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.272121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.272150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.272258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.272374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.272401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.272483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.272578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.272620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.272708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.272823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.272851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.273013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.273124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.273153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.273251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.273391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.273418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.273516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.273627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.273652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.273731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.273837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.273862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.273957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.274086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.274114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.274209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.274347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.274374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.274467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.274557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.274582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.274673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.274767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.274795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.274924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.275030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.275056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.275168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.275275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.275305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.275444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.275554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.275580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.275717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.275811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.275839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.275971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.276122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.276164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.276304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.276396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.276422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.276535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.276646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.276673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.276799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.276925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.276954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.277053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.277207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.277232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.277358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.277474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.277500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.277655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.277786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.277814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.277939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.278081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.278107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.970 [2024-11-18 02:12:48.278194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.278307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.970 [2024-11-18 02:12:48.278339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.970 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.278431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.278537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.278562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.278655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.278734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.278763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.278853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.278939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.278969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.279100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.279217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.279246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.279367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.279507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.279533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.279662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.279742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.279770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.279892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.279982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.280011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.280099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.280260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.280285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.280435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.280552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.280577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.280683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.280803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.280832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.280958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.281071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.281099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.281225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.281352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.281395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.281510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.281620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.281645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.281786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.281872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.281897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.282019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.282106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.282131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.282209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.282288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.282328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.282416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.282528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.282552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.282675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.282805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.282839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.282943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.283100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.283129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.283248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.283399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.283428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.283554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.283698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.283723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.283892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.283989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.284018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.284213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.284293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.284324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.284434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.284528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.284554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.284665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.284778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.284804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.284917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.285014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.285043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.285167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.285325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.285355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.971 [2024-11-18 02:12:48.285478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.285638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.971 [2024-11-18 02:12:48.285668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.971 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.285782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.285896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.285921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.286027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.286138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.286165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.286248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.286348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.286376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.286491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.286621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.286661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.286770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.286883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.286910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.287046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.287201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.287229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.287328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.287429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.287455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.287569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.287699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.287727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.287865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.288013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.288039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.288169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.288326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.288357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.288513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.288628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.288657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.288785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.288887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.288916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.289013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.289129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.289154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.289264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.289457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.289490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.289617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.289717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.289759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.289946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.290107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.290135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.290269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.290374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.290400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.290502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.290663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.290689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.290805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.290879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.290904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.291011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.291087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.972 [2024-11-18 02:12:48.291117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.972 qpair failed and we were unable to recover it. 00:30:13.972 [2024-11-18 02:12:48.291233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.291330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.291369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.291521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.291610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.291640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.291779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.291895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.291921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.292071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.292203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.292228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.292341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.292463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.292489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.292568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.292696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.292726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.292846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.292944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.292972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.293069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.293188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.293214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.293331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.293449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.293474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.293590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.293695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.293720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.293841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.293945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.293974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.294064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.294171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.294197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.294308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.294467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.294492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.294663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.294751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.294780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:13.973 [2024-11-18 02:12:48.294897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.294981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.973 [2024-11-18 02:12:48.295008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:13.973 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.295100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.295222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.295251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.295368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.295486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.295512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.295591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.295702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.295728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.295868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.295970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.295999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.296156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.296295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.296330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.296479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.296589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.296614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.296729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.296878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.296906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.297003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.297094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.297125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.297245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.297362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.297389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.297488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.297602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.297628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.297733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.297850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.297883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.298036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.298159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.298188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.298340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.298472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.298501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.298671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.298795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.298821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.298964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.299083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.299113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.299236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.299371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.264 [2024-11-18 02:12:48.299400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.264 qpair failed and we were unable to recover it. 00:30:14.264 [2024-11-18 02:12:48.299528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.299657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.299686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.299830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.299913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.299940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.300048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.300204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.300231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.300345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.300479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.300508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.300670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.300803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.300831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.300949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.301097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.301123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.301252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.301404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.301431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.301547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.301697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.301725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.301877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.301970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.301998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.302117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.302204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.302230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.302370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.302503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.302531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.302622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.302720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.302748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.302910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.303024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.303051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.303187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.303276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.303302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.303442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.303544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.303572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.303663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.303811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.303838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.303935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.304085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.304114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.304307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.304472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.304501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.304654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.304744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.304787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.304881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.304973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.304998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.305085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.305200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.305226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.305342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.305430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.305455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.305568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.305710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.305736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.305872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.305968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.305997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.265 [2024-11-18 02:12:48.306194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.306304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.265 [2024-11-18 02:12:48.306339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.265 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.306449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.306561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.306588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.306779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.306930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.306959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.307059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.307156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.307184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.307283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.307418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.307447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.307590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.307676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.307701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.307781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.307908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.307937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.308057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.308160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.308186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.308325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.308428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.308458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.308569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.308677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.308703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.308841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.308980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.309005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.309120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.309206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.309232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.309323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.309434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.309463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.309563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.309677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.309702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.309846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.310003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.310031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.310131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.310254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.310282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.310425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.310577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.310606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.310772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.310857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.310882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.310991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.311074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.311100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.311186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.311264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.311290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.311492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.311593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.311622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.311758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.311900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.311926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.312036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.312158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.266 [2024-11-18 02:12:48.312186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.266 qpair failed and we were unable to recover it. 00:30:14.266 [2024-11-18 02:12:48.312286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.312391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.312435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.312553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.312640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.312666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.312782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.312867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.312894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.313004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.313119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.313144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.313230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.313368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.313414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.313555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.313759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.313788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.313913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.314031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.314057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.314179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.314261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.314287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.314384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.314518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.314548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.314648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.314841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.314867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.314985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.315098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.315124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.315210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.315341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.315371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.315511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.315618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.315643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.315755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.315944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.315969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.316086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.316228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.316254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.316359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.316467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.316496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.316625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.316725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.316752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.316834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.316953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.316982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.317088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.317170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.317196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.317330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.317470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.317495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.317582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.317697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.317722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.317810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.317948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.317975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.267 [2024-11-18 02:12:48.318085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.318183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.267 [2024-11-18 02:12:48.318209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.267 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.318342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.318466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.318495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.318645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.318748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.318776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.318867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.318988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.319017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.319155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.319266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.319292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.319416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.319580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.319609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.319738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.319832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.319861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.319961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.320129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.320155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.320244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.320360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.320387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.320499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.320637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.320666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.320788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.320883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.320912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.321018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.321130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.321157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.321271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.321386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.321413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.321549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.321666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.321692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.321818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.321949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.321977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.322071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.322199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.322227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.322362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.322496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.322523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.322657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.322791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.322817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.322921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.323001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.323027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.323101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.323219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.323244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.323339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.323455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.323481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.323571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.323692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.323717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.323805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.323981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.324006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.324080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.324165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.324192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.268 [2024-11-18 02:12:48.324331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.324418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.268 [2024-11-18 02:12:48.324444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.268 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.324525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.324666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.324691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.324771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.324888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.324914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.325094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.325181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.325208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.325327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.325520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.325547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.325654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.325848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.325876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.325970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.326066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.326099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.326193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.326392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.326423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.326558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.326670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.326696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.326803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.326944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.326969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.327157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.327263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.327289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.327418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.327532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.327557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.327702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.327787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.327813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.327895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.327975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.328002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.328118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.328203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.328231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.328427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.328585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.328614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.328749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.328893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.328923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.329075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.329263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.329289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.329465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.329585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.329616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.329739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.329891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.329920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.330078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.330161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.330188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.269 qpair failed and we were unable to recover it. 00:30:14.269 [2024-11-18 02:12:48.330378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.269 [2024-11-18 02:12:48.330539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.330568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.330696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.330826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.330851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.331039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.331153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.331178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.331299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.331392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.331419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.331565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.331648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.331674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.331787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.331916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.331963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.332100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.332207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.332252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.332378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.332520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.332546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.332681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.332801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.332845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.332958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.333065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.333091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.333171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.333284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.333317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.333462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.333609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.333651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.333750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.333865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.333893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.334017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.334141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.334169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.334294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.334419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.334449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.334556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.334694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.334723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.334836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.335029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.335055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.335144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.335237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.335265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.335369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.335521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.335549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.335713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.335796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.335822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.335905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.336008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.336035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.336147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.336254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.336283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.336420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.336550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.336578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.336680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.336819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.336845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.336986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.337068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.337111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.337237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.337447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.337474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.337581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.337670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.337699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.270 qpair failed and we were unable to recover it. 00:30:14.270 [2024-11-18 02:12:48.337804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.337912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.270 [2024-11-18 02:12:48.337938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.338073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.338213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.338238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.338352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.338461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.338487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.338615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.338735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.338760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.338847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.338990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.339015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.339141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.339260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.339305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.339427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.339617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.339642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.339729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.339851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.339877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.339962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.340072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.340098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.340217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.340336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.340380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.340511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.340615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.340641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.340731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.340871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.340915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.341049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.341162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.341188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.341294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.341457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.341486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.341578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.341700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.341730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.341856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.341976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.342003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.342131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.342266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.342292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.342475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.342616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.342644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.342827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.342941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.342966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.343059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.343156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.343185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.343321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.343430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.343456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.343576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.343687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.343730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.343820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.343931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.343959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.271 qpair failed and we were unable to recover it. 00:30:14.271 [2024-11-18 02:12:48.344059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.271 [2024-11-18 02:12:48.344171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.344200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.344334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.344446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.344472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.344585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.344698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.344724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.344828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.344906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.344932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.345011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.345143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.345186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.345271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.345385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.345411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.345529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.345608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.345634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.345770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.345878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.345903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.345989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.346098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.346128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.346269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.346419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.346446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.346557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.346684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.346709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.346818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.346931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.346957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.347065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.347198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.347223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.347337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.347416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.347441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.347553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.347633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.347660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.347782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.347909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.347938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.348042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.348177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.348203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.348322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.348404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.348430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.348546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.348661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.348688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.348784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.348921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.348950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.349034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.349137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.349165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.349271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.349389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.349415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.349525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.349602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.349627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.349714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.349785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.349810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.349926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.350015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.350041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.350155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.350280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.350306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.272 qpair failed and we were unable to recover it. 00:30:14.272 [2024-11-18 02:12:48.350454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.350569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.272 [2024-11-18 02:12:48.350595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.350725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.350813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.350842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.350969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.351054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.351082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.351226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.351331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.351358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.351436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.351552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.351577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.351702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.351809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.351834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.351976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.352060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.352086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.352196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.352307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.352338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.352428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.352567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.352592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.352700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.352833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.352861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.352954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.353074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.353107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.353259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.353373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.353401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.353488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.353577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.353602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.353688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.353811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.353837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.353962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.354086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.354114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.354245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.354355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.354382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.354493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.354611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.354637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.354776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.354876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.354905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.355060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.355174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.355199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.355304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.355452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.355478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.355590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.355667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.355711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.355800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.355955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.355984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.356099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.356233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.273 [2024-11-18 02:12:48.356259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.273 qpair failed and we were unable to recover it. 00:30:14.273 [2024-11-18 02:12:48.356401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.356480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.356505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.356640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.356734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.356762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.356866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.356954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.356982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.357068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.357191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.357219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.357349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.357431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.357457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.357562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.357671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.357699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.357792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.357914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.357942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.358064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.358154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.358183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.358287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.358384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.358410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.358491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.358563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.358588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.358673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.358745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.358771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.358884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.358960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.358985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.359107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.359214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.359239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.359355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.359492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.359517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.359624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.359729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.359754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.359837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.359944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.359970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.360082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.360197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.360223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.360317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.360429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.360455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.360549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.360663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.360689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.360780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.360865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.360890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.360976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.361096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.361122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.361230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.361382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.361411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.361530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.361634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.361659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.274 qpair failed and we were unable to recover it. 00:30:14.274 [2024-11-18 02:12:48.361740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.361827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.274 [2024-11-18 02:12:48.361852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.361963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.362078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.362104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.362221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.362352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.362381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.362537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.362628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.362657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.362783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.362866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.362895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.362997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.363108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.363133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.363237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.363343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.363370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.363450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.363524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.363549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.363639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.363751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.363777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.363851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.363960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.363987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.364098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.364238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.364264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.364346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.364460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.364489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.364631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.364742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.364768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.364879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.365017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.365043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.365135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.365257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.365282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.365401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.365513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.365543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.365653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.365802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.365831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.365961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.366105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.366131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.366255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.366346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.366373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.366499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.366621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.366650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.366773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.366913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.275 [2024-11-18 02:12:48.366939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.275 qpair failed and we were unable to recover it. 00:30:14.275 [2024-11-18 02:12:48.367045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.367151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.367177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.367338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.367499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.367527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.367630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.367756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.367784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.367881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.367977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.368019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.368122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.368231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.368261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.368389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.368480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.368523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.368606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.368690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.368716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.368822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.368955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.368981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.369094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.369233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.369259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.369440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.369583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.369609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.369770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.369920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.369948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.370076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.370159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.370187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.370296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.370443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.370469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.370599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.370766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.370795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.370894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.370989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.371016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.371133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.371271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.371297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.371389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.371472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.371497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.371686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.371874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.371902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.372007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.372100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.372141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.372249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.372367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.372397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.372492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.372597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.372622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.372738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.372864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.372892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.372996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.373114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.373143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.373277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.373399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.373425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.373535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.373644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.373670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.276 qpair failed and we were unable to recover it. 00:30:14.276 [2024-11-18 02:12:48.373797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.276 [2024-11-18 02:12:48.373891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.373919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.374049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.374196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.374222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.374350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.374474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.374503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.374638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.374779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.374805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.374907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.375100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.375128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.375230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.375378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.375407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.375505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.375605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.375633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.375755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.375839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.375865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.375977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.376083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.376125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.376214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.376360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.376389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.376504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.376644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.376669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.376780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.376862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.376887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.377041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.377153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.377181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.377267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.377361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.377390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.377475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.377597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.377626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.377758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.377839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.377865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.378017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.378119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.378145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.378301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.378504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.378533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.378627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.378742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.378771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.378899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.379011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.379037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.379209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.379330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.379356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.379463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.379590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.379618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.277 qpair failed and we were unable to recover it. 00:30:14.277 [2024-11-18 02:12:48.379769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.379899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.277 [2024-11-18 02:12:48.379927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.380089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.380199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.380224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.380330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.380446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.380474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.380616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.380762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.380791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.380930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.381039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.381064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.381175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.381286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.381318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.381434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.381572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.381600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.381721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.381842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.381870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.381987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.382098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.382134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.382269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.382444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.382486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.382587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.382684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.382710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.382854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.383030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.383055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.383162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.383246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.383289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.383396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.383537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.383562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.383688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.383775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.383803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.383953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.384057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.384082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.384186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.384268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.384293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.384415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.384490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.384516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.384706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.384802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.384831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.384954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.385067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.385095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.385255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.385369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.385395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.385502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.385591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.385616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.385746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.385895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.385924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.386021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.386184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.386210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.386291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.386370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.278 [2024-11-18 02:12:48.386396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.278 qpair failed and we were unable to recover it. 00:30:14.278 [2024-11-18 02:12:48.386510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.386585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.386610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.386733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.386859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.386888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.387036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.387181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.387207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.387322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.387448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.387476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.387592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.387730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.387755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.387893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.387986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.388014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.388135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.388253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.388282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.388405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.388529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.388558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.388685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.388808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.388833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.388915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.389053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.389093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.389248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.389371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.389400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.389516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.389646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.389671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.389806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.389888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.389914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.390050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.390144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.390186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.390302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.390459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.390488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.390594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.390708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.390736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.390867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.390946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.390972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.391076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.391186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.391229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.391351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.391482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.391525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.391637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.391750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.391776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.391891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.391971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.391996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.392135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.392223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.392248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.392334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.392439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.392463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.392586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.392683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.392709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.279 qpair failed and we were unable to recover it. 00:30:14.279 [2024-11-18 02:12:48.392836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.279 [2024-11-18 02:12:48.392979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.393002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.393136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.393251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.393278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.393445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.393562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.393586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.393662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.393792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.393819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.393951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.394059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.394083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.394193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.394321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.394349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.394470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.394586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.394613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.394730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.394876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.394915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.395001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.395078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.395102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.395212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.395294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.395327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.395446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.395528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.395576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.395702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.395816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.395844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.396001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.396111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.396136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.396262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.396353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.396383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.396531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.396623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.396651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.396784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.396907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.396936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.397098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.397211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.397236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.397350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.397464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.397508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.397607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.397726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.397768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.397858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.397944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.397970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.398060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.398165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.398191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.280 qpair failed and we were unable to recover it. 00:30:14.280 [2024-11-18 02:12:48.398304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.280 [2024-11-18 02:12:48.398453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.398478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.398567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.398724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.398752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.398840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.398962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.398991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.399122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.399234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.399260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.399379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.399457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.399483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.399573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.399652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.399678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.399786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.399890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.399915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.400007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.400112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.400137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.400249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.400362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.400389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.400527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.400609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.400634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.400759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.400899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.400924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.401031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.401143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.401168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.401309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.401398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.401424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.401510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.401629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.401654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.401769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.401871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.401897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.401987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.402098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.402123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.402223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.402341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.402370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.402460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.402656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.402684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.402820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.402962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.402987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.403079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.403187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.403214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.403344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.403477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.403504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.403629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.403745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.403774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.403899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.403989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.404017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.404174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.404280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.404306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.404423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.404534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.404561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.404671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.404796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.404838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.281 qpair failed and we were unable to recover it. 00:30:14.281 [2024-11-18 02:12:48.404952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.281 [2024-11-18 02:12:48.405041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.405082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.405272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.405406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.405432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.405515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.405599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.405624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.405702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.405859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.405887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.405986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.406115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.406144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.406276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.406390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.406417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.406542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.406623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.406649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.406729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.406852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.406878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.407000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.407153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.407178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.407321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.407431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.407456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.407559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.407649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.407677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.407794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.407918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.407960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.408043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.408131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.408156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.408240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.408349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.408375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.408491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.408603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.408634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.408741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.408858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.408887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.409002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.409075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.409100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.409240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.409344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.409370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.409481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.409604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.409646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.409732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.409833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.409861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.409988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.410071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.410114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.410229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.410370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.410397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.410490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.410573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.410597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.410679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.410774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.410802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.410920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.411010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.411044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.282 [2024-11-18 02:12:48.411153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.411291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.282 [2024-11-18 02:12:48.411323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.282 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.411464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.411593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.411621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.411704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.411813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.411839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.411944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.412032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.412057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.412161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.412275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.412301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.412422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.412507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.412532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.412651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.412781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.412809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.412921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.413011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.413039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.413168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.413275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.413300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.413415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.413496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.413539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.413693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.413810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.413835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.413965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.414092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.414118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.414230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.414341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.414367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.414478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.414591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.414617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.414723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.414795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.414820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.414902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.415005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.415030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.415120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.415233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.415258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.415340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.415424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.415449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.415526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.415663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.415688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.415798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.415927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.415955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.416070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.416184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.416210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.416332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.416458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.416486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.416632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.416782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.416807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.416939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.417085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.417113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.417200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.417330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.417357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.417467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.417554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.417583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.283 qpair failed and we were unable to recover it. 00:30:14.283 [2024-11-18 02:12:48.417671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.283 [2024-11-18 02:12:48.417798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.417826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.417916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.418047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.418073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.418184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.418296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.418328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.418435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.418513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.418538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.418652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.418769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.418797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.418938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.419060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.419085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.419220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.419332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.419359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.419471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.419566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.419594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.419711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.419808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.419836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.419964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.420111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.420139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.420268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.420377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.420404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.420536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.420658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.420686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.420835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.420954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.420982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.421102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.421251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.421280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.421415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.421567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.421593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.421697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.421839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.421865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.421941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.422098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.422126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.422214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.422314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.422357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.422496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.422582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.422607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.422736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.422862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.422887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.422967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.423056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.423083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.423206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.423329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.423355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.423461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.423583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.423608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.423734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.423891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.423916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.424013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.424111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.424144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.424239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.424367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.424411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.284 qpair failed and we were unable to recover it. 00:30:14.284 [2024-11-18 02:12:48.424534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.284 [2024-11-18 02:12:48.424648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.424674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.424810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.424972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.424997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.425120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.425231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.425257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.425363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.425447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.425472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.425576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.425660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.425685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.425817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.425984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.426009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.426127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.426260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.426288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.426421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.426503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.426528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.426608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.426757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.426782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.426914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.427021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.427046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.427152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.427227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.427252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.427342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.427423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.427448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.427530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.427669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.427694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.427827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.427978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.428006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.428107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.428220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.428248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.428348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.428445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.428486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.428592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.428701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.428726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.428851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.428961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.429007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.429161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.429240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.285 [2024-11-18 02:12:48.429266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.285 qpair failed and we were unable to recover it. 00:30:14.285 [2024-11-18 02:12:48.429367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.429477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.429502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.429591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.429732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.429757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.429864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.429986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.430028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.430118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.430270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.430298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.430441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.430567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.430599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.430737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.430821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.430846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.430935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.431091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.431119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.431271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.431407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.431433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.431548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.431698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.431727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.431811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.431921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.431946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.432068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.432181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.432223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.432339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.432495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.432523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.432676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.432797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.432825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.432933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.433046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.433072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.433202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.433366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.433393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.433476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.433631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.433659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.433782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.433910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.433938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.434102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.434225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.434251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.434361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.434486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.434514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.434659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.434744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.434769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.434864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.434991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.435019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.286 [2024-11-18 02:12:48.435126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.435235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.286 [2024-11-18 02:12:48.435260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.286 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.435338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.435422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.435448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.435537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.435660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.435689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.435807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.435925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.435953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.436088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.436172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.436197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.436301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.436405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.436434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.436531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.436657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.436697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.436780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.436892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.436917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.436997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.437100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.437125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.437205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.437292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.437329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.437457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.437594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.437620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.437732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.437843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.437867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.437981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.438092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.438116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.438196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.438357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.438385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.438489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.438611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.438638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.438723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.438872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.438898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.439022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.439139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.439165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.439264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.439425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.439449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.439560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.439721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.439748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.439833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.439910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.439937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.440084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.440244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.440271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.440421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.440508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.440532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.440614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.440696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.440722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.440804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.440946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.440971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.287 qpair failed and we were unable to recover it. 00:30:14.287 [2024-11-18 02:12:48.441049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.441152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.287 [2024-11-18 02:12:48.441177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.441256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.441365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.441392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.441496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.441609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.441635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.441717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.441833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.441859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.441971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.442105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.442130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.442243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.442354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.442381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.442476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.442558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.442584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.442674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.442762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.442787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.442903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.442984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.443009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.443089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.443196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.443220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.443303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.443451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.443477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.443566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.443723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.443751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.443862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.443979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.444005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.444088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.444252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.444280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.444409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.444528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.444572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.444698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.444831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.444857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.444974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.445087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.445112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.445185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.445299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.445330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.445477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.445590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.445617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.445738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.445872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.445898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.446011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.446154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.446180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.446335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.446483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.446511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.446623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.446735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.446760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.446866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.446965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.446990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.288 [2024-11-18 02:12:48.447132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.447241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.288 [2024-11-18 02:12:48.447266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.288 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.447396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.447474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.447500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.447586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.447706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.447731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.447810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.447914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.447940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.448050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.448173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.448198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.448285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.448407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.448432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.448557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.448656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.448685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.448807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.448925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.448953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.449087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.449236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.449261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.449351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.449435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.449461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.449569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.449654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.449679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.449818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.449929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.449954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.450102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.450211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.450241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.450355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.450504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.450532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.450636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.450758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.450785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.450924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.451037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.451062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.451200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.451320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.451346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.451453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.451587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.451613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.451722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.451829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.451854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.451997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.452102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.452128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.452268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.452377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.452404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.452515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.452654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.452679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.452852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.452999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.453032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.453125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.453249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.453274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.289 [2024-11-18 02:12:48.453398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.453514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.289 [2024-11-18 02:12:48.453539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.289 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.453729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.453804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.453830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.453965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.454105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.454130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.454207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.454318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.454347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.454450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.454531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.454556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.454653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.454784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.454812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.454908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.455037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.455066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.455209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.455296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.455328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.455424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.455501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.455526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.455641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.455759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.455784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.455940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.456071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.456099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.456210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.456293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.456335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.456419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.456500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.456525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.456602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.456676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.456701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.456814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.456921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.456946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.457041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.457155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.457183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.457322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.457435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.457461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.457553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.457630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.457656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.457770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.457884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.457910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.457991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.458077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.458103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.458217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.458332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.458359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.458474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.458555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.458580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.458686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.458798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.458823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.458979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.459118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.459143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.459256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.459360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.459386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.290 [2024-11-18 02:12:48.459505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.459650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.290 [2024-11-18 02:12:48.459676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.290 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.459792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.459904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.459930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.460070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.460196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.460225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.460328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.460417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.460443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.460571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.460691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.460720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.460810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.460893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.460921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.461018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.461147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.461175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.461345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.461479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.461505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.461659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.461831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.461857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.461974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.462085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.462112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.462198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.462316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.462345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.462459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.462583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.462611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.462737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.462889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.462917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.463015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.463137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.463165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.463250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.463384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.463413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.463554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.463662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.463687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.463821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.463928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.463954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.464089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.464183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.464211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.464374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.464471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.464497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.464582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.464690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.464715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.464847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.464987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.291 [2024-11-18 02:12:48.465013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.291 qpair failed and we were unable to recover it. 00:30:14.291 [2024-11-18 02:12:48.465155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.465264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.465289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.465392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.465516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.465544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.465657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.465767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.465792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.465878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.466035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.466068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.466205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.466334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.466360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.466492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.466612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.466641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.466776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.466882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.466907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.467013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.467093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.467137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.467235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.467369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.467395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.467476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.467608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.467636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.467832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.467946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.467988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.468114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.468259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.468287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.468436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.468534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.468562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.468683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.468797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.468825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.468926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.469041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.469067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.469198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.469287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.469323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.469442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.469637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.469665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.469814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.470017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.470042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.470249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.470379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.470405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.470522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.470610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.470652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.470786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.470871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.470897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.471011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.471148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.471176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.471341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.471423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.471448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.471549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.471699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.471727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.292 qpair failed and we were unable to recover it. 00:30:14.292 [2024-11-18 02:12:48.471827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.292 [2024-11-18 02:12:48.471949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.471977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.472146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.472335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.472361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.472475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.472564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.472589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.472697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.472835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.472861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.472976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.473082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.473108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.473243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.473349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.473378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.473484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.473624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.473649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.473802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.473939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.473965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.474076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.474208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.474233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.474425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.474633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.474661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.474791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.474902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.474927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.475047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.475203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.475228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.475351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.475440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.475483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.475605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.475695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.475723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.475878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.476012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.476038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.476129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.476278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.476306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.476399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.476495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.476523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.476672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.476820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.476848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.477040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.477189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.477213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.477321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.477415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.477444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.477541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.477710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.477739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.477859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.477979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.478008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.478112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.478238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.478264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.478422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.478562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.478587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.478719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.478839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.478867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.478964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.479121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.479147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.293 qpair failed and we were unable to recover it. 00:30:14.293 [2024-11-18 02:12:48.479226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.293 [2024-11-18 02:12:48.479336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.479363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.479501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.479652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.479680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.479794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.479887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.479917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.480112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.480222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.480250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.480411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.480531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.480561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.480643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.480772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.480800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.480927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.481024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.481053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.481217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.481297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.481328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.481415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.481498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.481523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.481599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.481735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.481761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.481949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.482060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.482088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.482214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.482335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.482377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.482489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.482608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.482633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.482711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.482794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.482819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.482936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.483074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.483102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.483257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.483379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.483408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.483516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.483639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.483664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.483753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.483885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.483913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.484020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.484137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.484165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.484333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.484440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.484465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.484545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.484651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.484677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.484751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.484864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.484890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.485043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.485161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.485189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.485331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.485449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.485474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.485557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.485640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.294 [2024-11-18 02:12:48.485665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.294 qpair failed and we were unable to recover it. 00:30:14.294 [2024-11-18 02:12:48.485777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.485890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.485932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.486052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.486144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.486172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.486264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.486372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.486398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.486516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.486600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.486626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.486740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.486819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.486845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.486975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.487111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.487139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.487249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.487361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.487387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.487502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.487615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.487640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.487765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.487856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.487881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.487991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.488098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.488126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.488274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.488414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.488441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.488551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.488656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.488681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.488807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.488939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.488964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.489044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.489156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.489196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.489318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.489443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.489487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.489567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.489653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.489678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.489757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.489916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.489945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.490105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.490207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.490233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.490339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.490452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.490477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.490560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.490644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.490669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.490749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.490919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.490947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.491042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.491135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.491163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.295 [2024-11-18 02:12:48.491253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.491401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.295 [2024-11-18 02:12:48.491427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.295 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.491551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.491639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.491664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.491783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.491911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.491940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.492025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.492176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.492205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.492294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.492387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.492413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.492602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.492762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.492791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.492910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.493004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.493032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.493152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.493242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.493270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.493400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.493497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.493531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.493666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.493755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.493780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.493859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.493970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.493995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.494088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.494211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.494239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.494389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.494480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.494509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.494667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.494754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.494780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.494895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.495026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.495054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.495138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.495220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.495248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.495398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.495527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.495552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.495634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.495777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.495803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.495960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.496095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.496120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.496267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.496410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.496436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.496521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.496632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.496675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.496791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.496931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.296 [2024-11-18 02:12:48.496957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.296 qpair failed and we were unable to recover it. 00:30:14.296 [2024-11-18 02:12:48.497113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.497235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.497263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.497419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.497570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.497595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.497727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.497861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.497887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.498000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.498088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.498113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.498240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.498443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.498470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.498603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.498697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.498741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.498882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.498997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.499022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.499214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.499323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.499372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.499496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.499645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.499673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.499792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.499921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.499949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.500083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.500178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.500220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.500338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.500432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.500457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.500576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.500704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.500730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.500807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.500916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.500941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.501045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.501152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.501180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.501340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.501454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.501480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.501617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.501720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.501745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.501890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.502085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.502113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.502265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.502395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.502437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.502624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.502731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.502776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.502868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.502981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.503010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.503142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.503234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.503258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.503349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.503434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.503460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.297 [2024-11-18 02:12:48.503573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.503684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.297 [2024-11-18 02:12:48.503709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.297 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.503863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.503984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.504012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.504207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.504305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.504340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.504454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.504528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.504552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.504635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.504728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.504754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.504900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.504977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.505002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.505081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.505214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.505257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.505376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.505480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.505505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.505589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.505725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.505750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.505838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.505908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.505932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.506015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.506122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.506147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.506291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.506396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.506425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.506522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.506633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.506659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.506743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.506826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.506851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.506940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.507021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.507050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.507162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.507269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.507318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.507458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.507551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.507576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.507693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.507778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.507804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.507934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.508089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.508131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.508271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.508427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.508453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.508567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.508650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.508676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.508792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.508916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.508944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.509044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.509143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.509171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.509271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.509412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.509439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.509586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.509701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.509731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.509865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.509983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.510011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.510100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.510188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.510216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.510324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.510414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.510439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.298 qpair failed and we were unable to recover it. 00:30:14.298 [2024-11-18 02:12:48.510549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.510668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.298 [2024-11-18 02:12:48.510693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.510768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.510868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.510893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.511059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.511211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.511238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.511359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.511530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.511556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.511669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.511783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.511808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.511899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.511973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.511999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.512113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.512222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.512247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.512357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.512437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.512462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.512580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.512716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.512741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.512853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.512968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.512993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.513087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.513180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.513209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.513384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.513472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.513498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.513578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.513681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.513707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.513786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.513873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.513901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.513995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.514131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.514156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.514260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.514393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.514419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.514528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.514639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.514664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.514799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.514883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.514911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.515005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.515118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.515159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.515305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.515447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.515472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.515585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.515698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.515724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.515829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.515904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.515929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.516039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.516125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.516150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.516277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.516379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.516408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.516510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.516596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.516622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.516717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.516868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.516896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.299 qpair failed and we were unable to recover it. 00:30:14.299 [2024-11-18 02:12:48.516993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.299 [2024-11-18 02:12:48.517106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.517134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.517276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.517423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.517449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.517589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.517696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.517720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.517859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.517987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.518012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.518091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.518262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.518287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.518400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.518476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.518501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.518589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.518701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.518725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.518813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.518917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.518943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.519096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.519212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.519241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.519384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.519494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.519519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.519633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.519769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.519794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.519901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.520034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.520060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.520219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.520323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.520352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.520451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.520547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.520576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.520739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.520878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.520904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.521034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.521129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.521157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.521345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.521459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.521484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.521613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.521695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.521723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.521861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.521978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.522003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.522103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.522257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.522283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.522419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.522581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.522606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.522719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.522832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.522862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.522997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.523076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.523101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.523211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.523376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.523403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.523546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.523643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.523671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.300 qpair failed and we were unable to recover it. 00:30:14.300 [2024-11-18 02:12:48.523756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.523877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.300 [2024-11-18 02:12:48.523905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.524011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.524117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.524141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.524274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.524379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.524408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.524539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.524699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.524724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.524805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.524919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.524962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.525095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.525171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.525197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.525286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.525426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.525455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.525558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.525681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.525709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.525833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.525959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.525987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.526089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.526196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.526221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.526373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.526487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.526512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.526650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.526766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.526794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.526915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.527042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.527067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.527226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.527342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.527368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.527488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.527597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.527641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.527775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.527853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.527877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.527988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.528116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.528144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.528267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.528383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.528408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.528519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.528626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.528651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.528730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.528873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.528898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.529011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.529147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.529173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.529286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.529424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.529450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.529532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.529666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.529693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.529778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.529905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.529933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.530081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.530187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.530212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.301 qpair failed and we were unable to recover it. 00:30:14.301 [2024-11-18 02:12:48.530322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.530428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.301 [2024-11-18 02:12:48.530453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.530547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.530649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.530690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.530777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.530891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.530931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.531055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.531174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.531201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.531338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.531454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.531479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.531568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.531651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.531676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.531780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.531897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.531937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.532093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.532180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.532208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.532331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.532447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.532473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.532577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.532735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.532761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.532902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.533063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.533091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.533219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.533320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.533362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.533475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.533588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.533614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.533747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.533865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.533893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.534023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.534148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.534176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.534327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.534429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.534454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.534597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.534720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.534745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.534828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.534934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.534959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.535034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.535142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.535167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.302 qpair failed and we were unable to recover it. 00:30:14.302 [2024-11-18 02:12:48.535252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.302 [2024-11-18 02:12:48.535340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.535366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.535475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.535586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.535610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.535691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.535817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.535845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.535963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.536113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.536146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.536264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.536364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.536409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.536491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.536570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.536596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.536713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.536844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.536872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.536989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.537109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.537151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.537291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.537434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.537460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.537578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.537716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.537741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.537839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.538003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.538028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.538169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.538289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.538322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.538421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.538542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.538569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.538710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.538825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.538850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.538995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.539090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.539119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.539235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.539331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.539374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.539519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.539647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.539675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.539780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.539922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.539947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.540098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.540201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.540227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.540384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.540517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.540542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.540662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.540789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.540817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.540929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.541006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.541032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.541174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.541280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.541308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.303 qpair failed and we were unable to recover it. 00:30:14.303 [2024-11-18 02:12:48.541444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.541569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.303 [2024-11-18 02:12:48.541597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.541736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.541847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.541873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.541956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.542097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.542122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.542220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.542306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.542339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.542454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.542586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.542611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.542721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.542805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.542830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.542906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.543019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.543044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.543153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.543224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.543250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.543360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.543463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.543491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.543603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.543722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.543765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.543882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.544017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.544042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.544208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.544363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.544390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.544548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.544644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.544673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.544796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.544875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.544903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.545008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.545109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.545137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.545237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.545384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.545410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.545494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.545641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.545682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.545765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.545875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.545900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.545990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.546078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.546103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.546214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.546341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.546385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.546503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.546583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.546608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.546750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.546864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.546888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.547003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.547079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.547104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.547177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.547285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.304 [2024-11-18 02:12:48.547317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.304 qpair failed and we were unable to recover it. 00:30:14.304 [2024-11-18 02:12:48.547461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.547583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.547611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.547759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.547846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.547874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.548033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.548168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.548193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.548338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.548464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.548489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.548587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.548744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.548773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.548869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.549014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.549041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.549154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.549239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.549265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.549419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.549544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.549577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.549703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.549852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.549880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.549976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.550065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.550108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.550245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.550357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.550383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.550521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.550641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.550670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.550774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.550867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.550897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.551046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.551201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.551230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.551379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.551467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.551492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.551644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.551750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.551776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.551862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.551997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.552025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.552158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.552272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.552302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.552430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.552543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.552569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.552665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.552780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.552808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.552904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.553026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.553052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.553154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.553345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.553372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.553481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.553591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.553617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.553696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.553809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.553834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.553908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.554016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.554043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.305 qpair failed and we were unable to recover it. 00:30:14.305 [2024-11-18 02:12:48.554155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.554273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.305 [2024-11-18 02:12:48.554300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.554433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.554549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.554575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.554685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.554766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.554791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.554886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.554995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.555023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.555152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.555243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.555271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.555381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.555469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.555494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.555606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.555694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.555720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.555795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.555873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.555899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.555984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.556098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.556140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.556244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.556354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.556380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.556521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.556645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.556673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.556797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.556916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.556944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.557068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.557214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.557242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.557391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.557531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.557556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.557669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.557790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.557819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.557937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.558058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.558087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.558182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.558271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.558299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.558430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.558503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.558528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.558635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.558739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.558764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.558880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.559016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.559046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.559135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.559285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.559319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.559428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.559540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.559566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.559652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.559766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.559792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.559903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.560010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.560036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.560116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.560220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.560245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.560323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.560426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.560452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.306 qpair failed and we were unable to recover it. 00:30:14.306 [2024-11-18 02:12:48.560541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.306 [2024-11-18 02:12:48.560677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.560705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.560870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.560981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.561006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.561141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.561230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.561258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.561393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.561497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.561522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.561595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.561746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.561772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.561909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.562035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.562063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.562213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.562334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.562363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.562496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.562581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.562607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.562692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.562801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.562827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.562936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.563007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.563032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.563111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.563221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.563246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.563354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.563436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.563461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.563597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.563690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.563719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.563815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.563912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.563939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.564050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.564160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.564186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.564267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.564380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.564406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.564486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.564611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.564637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.564774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.564896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.564944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.565020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.565127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.565152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.565263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.565343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.565369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.565485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.565590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.565632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.565768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.565907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.565932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.307 qpair failed and we were unable to recover it. 00:30:14.307 [2024-11-18 02:12:48.566018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.307 [2024-11-18 02:12:48.566131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.566156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.566233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.566337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.566364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.566481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.566568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.566593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.566716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.566839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.566867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.566989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.567103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.567132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.567257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.567343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.567369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.567481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.567569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.567595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.567727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.567818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.567863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.567947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.568055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.568080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.568188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.568266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.568290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.568405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.568513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.568538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.568659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.568770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.568796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.568879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.568982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.569007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.569119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.569197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.569221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.569301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.569393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.569418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.569535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.569667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.569697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.569821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.569971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.570000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.570161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.570240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.570266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.570387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.570495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.570521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.570608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.570754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.570781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.570874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.570960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.570985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.571092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.571205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.571230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.571336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.571431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.571475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.571564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.571674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.571699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.308 qpair failed and we were unable to recover it. 00:30:14.308 [2024-11-18 02:12:48.571807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.308 [2024-11-18 02:12:48.571970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.571999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.572088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.572178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.572207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.572291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.572421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.572447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.572554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.572663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.572689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.572776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.572898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.572923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.573008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.573152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.573178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.573287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.573412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.573441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.573574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.573689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.573714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.573799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.573953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.573978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.574084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.574192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.574217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.574338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.574461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.574489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.574614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.574734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.574762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.574860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.574988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.575013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.575126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.575201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.575227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.575336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.575421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.575446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.575554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.575662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.575687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.575801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.575912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.575938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.576047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.576128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.576155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.576264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.576391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.576420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.576516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.576630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.576658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.576777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.576899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.576927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.577022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.577126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.577150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.577265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.577355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.577385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.577498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.577577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.577602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.577694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.577859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.577885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.309 qpair failed and we were unable to recover it. 00:30:14.309 [2024-11-18 02:12:48.577972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.309 [2024-11-18 02:12:48.578109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.578134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.578284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.578427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.578454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.578530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.578604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.578628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.578761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.578863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.578888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.578985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.579063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.579087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.579194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.579298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.579346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.579442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.579556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.579585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.579736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.579860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.579905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.579995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.580078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.580104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.580242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.580379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.580405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.580564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.580721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.580765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.580873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.580981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.581007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.581149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.581234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.581260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.581381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.581473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.581498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.581645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.581770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.581798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.581957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.582092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.582118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.582231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.582376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.582402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.582536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.582657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.582685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.582853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.583003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.583032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.583116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.583252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.583280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.583415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.583501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.583527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.583634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.583710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.583735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.583843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.583931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.583956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.584048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.584120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.584145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.584289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.584384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.584410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.584491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.584612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.584637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.584748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.584826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.584851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.310 qpair failed and we were unable to recover it. 00:30:14.310 [2024-11-18 02:12:48.584932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.310 [2024-11-18 02:12:48.585044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.585071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.585158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.585245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.585270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.585389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.585474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.585499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.585580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.585687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.585713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.585855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.585965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.586007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.586141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.586257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.586283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.586377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.586491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.586516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.586626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.586709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.586734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.586807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.586920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.586945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.587084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.587161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.587186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.587287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.587419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.587447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.587569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.587702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.587730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.587898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.588013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.588038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.588150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.588231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.588257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.588376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.588458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.588484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.588598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.588704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.588728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.588853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.588930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.588955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.589092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.589175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.589199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.589336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.589461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.589489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.589572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.589665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.589693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.589777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.589935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.589963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.590112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.590226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.590255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.590377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.590490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.590515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.590625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.590736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.590761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.590878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.590990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.591016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.591136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.591222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.591249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.591340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.591423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.591447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.311 qpair failed and we were unable to recover it. 00:30:14.311 [2024-11-18 02:12:48.591556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.591673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.311 [2024-11-18 02:12:48.591698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.591807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.591953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.591981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.592103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.592212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.592237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.592328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.592464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.592491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.592589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.592704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.592731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.592858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.592950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.592978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.593105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.593216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.593241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.593336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.593446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.593472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.593555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.593638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.593663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.593798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.593946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.593974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.594135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.594239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.594265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.594450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.594557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.594582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.594671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.594752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.594778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.594918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.594999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.595025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.595138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.595273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.595298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.595395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.595484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.595510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.595618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.595707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.595733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.595853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.595958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.595984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.596087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.596200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.596225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.596340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.596423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.596448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.596565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.596717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.596745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.596908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.596986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.597011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.597121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.597226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.597252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.597330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.597416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.597441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.597557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.597633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.597658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.597779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.597884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.597909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.312 qpair failed and we were unable to recover it. 00:30:14.312 [2024-11-18 02:12:48.598001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.312 [2024-11-18 02:12:48.598109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.598134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.598244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.598353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.598379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.598488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.598578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.598602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.598681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.598787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.598812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.598952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.599027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.599052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.599134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.599215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.599239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.599322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.599437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.599462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.599568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.599653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.599679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.599785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.599865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.599890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.599995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.600080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.600106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.600184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.600269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.600318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.600448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.600540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.600581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.600689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.600766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.600791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.600872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.600949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.600975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.601091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.601168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.601194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.601329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.601496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.601524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.601650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.601734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.601760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.601848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.601986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.602011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.602118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.602230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.602274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.602373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.602474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.602507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.602635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.602744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.602770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.602882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.603045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.603073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.603191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.603285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.603320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.603435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.603535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.603563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.603671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.603758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.603783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.603864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.603945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.603970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.604043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.604165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.604194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.604294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.604415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.604441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.604548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.604657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.604683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.604793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.604875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.604904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.605046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.605126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.605167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.313 qpair failed and we were unable to recover it. 00:30:14.313 [2024-11-18 02:12:48.605279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.605412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.313 [2024-11-18 02:12:48.605441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.605553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.605664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.605689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.605769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.605884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.605909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.606013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.606097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.606138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.606226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.606340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.606371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.606478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.606557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.606582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.606700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.606789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.606815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.606897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.606983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.607008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.607116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.607193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.607219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.607302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.607418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.607444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.607561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.607670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.607696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.607803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.607920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.607963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.608070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.608210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.608236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.608349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.608431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.608456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.608568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.608680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.608706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.608813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.608932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.608957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.609078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.609240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.609266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.609358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.609472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.609498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.609607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.609686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.609712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.609829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.609925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.609953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.610065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.610203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.610228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.610322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.610400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.610426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.610506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.610583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.610608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.610715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.610798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.610824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.610912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.611024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.611051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.611167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.611282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.611309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.611427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.611532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.611557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.611647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.611757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.611783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.611865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.611975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.612001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.612110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.612224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.612249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.612382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.612510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.612539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.314 qpair failed and we were unable to recover it. 00:30:14.314 [2024-11-18 02:12:48.612639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.314 [2024-11-18 02:12:48.612764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.612790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.612874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.612981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.613006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.613112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.613220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.613245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.613359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.613436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.613462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.613540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.613612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.613638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.613754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.613865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.613890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.613998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.614077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.614103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.614184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.614256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.614281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.614398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.614488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.614514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.614604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.614677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.614703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.614784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.614925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.614950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.615036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.615138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.615164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.615284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.615402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.615428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.615507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.615588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.615613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.615716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.615831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.615856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.615940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.616060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.616088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.616181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.616264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.616291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.616393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.616474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.616502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.616610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.616717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.616749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.616826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.616909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.616934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.617062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.617176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.617203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.617289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.617426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.617455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.617555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.617692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.617717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.617805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.617908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.617949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.618030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.618102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.618126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.618239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.618327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.618353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.618439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.618547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.618572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.618655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.618763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.618787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.618874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.618980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.619007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.619129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.619212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.619238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.619351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.619460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.619485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.619595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.619710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.619735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.315 qpair failed and we were unable to recover it. 00:30:14.315 [2024-11-18 02:12:48.619821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.619927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.315 [2024-11-18 02:12:48.619951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.620060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.620164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.620189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.620266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.620406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.620432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.620547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.620624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.620649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.620734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.620861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.620889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.621019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.621138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.621166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.621274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.621383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.621409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.621491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.621603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.621629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.621721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.621883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.621911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.622039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.622156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.622184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.622278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.622396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.622423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.622567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.622670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.622695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.622776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.622908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.622936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.623063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.623156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.623184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.623322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.623434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.623459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.623551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.623667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.623696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.623815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.623931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.623959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.624113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.624230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.624258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.624421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.624504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.624529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.624603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.624677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.624702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.624872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.624965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.624992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.625078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.625192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.625220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.625399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.625509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.625534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.625681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.625801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.625826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.625987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.626099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.626127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.626279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.626374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.626403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.316 [2024-11-18 02:12:48.626506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.626619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.316 [2024-11-18 02:12:48.626644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.316 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.626726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.626806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.626831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.626943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.627031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.627072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.627194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.627321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.627350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.627448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.627564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.627588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.627723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.627857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.627882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.627964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.628049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.628073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.628186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.628297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.628329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.628417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.628530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.628556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.628638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.628721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.628746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.628861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.628975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.629000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.629164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.629281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.629329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.629477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.629562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.629587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.629728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.629879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.629906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.630006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.630126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.630154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.630244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.630341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.630369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.630468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.630547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.630571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.630652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.630736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.630760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.630899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.630983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.631028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.631145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.631244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.631270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.631359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.631470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.631497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.631588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.631727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.631756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.631885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.632004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.632033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.317 [2024-11-18 02:12:48.632189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.632304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.317 [2024-11-18 02:12:48.632338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.317 qpair failed and we were unable to recover it. 00:30:14.318 [2024-11-18 02:12:48.632491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.632603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.632627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.318 qpair failed and we were unable to recover it. 00:30:14.318 [2024-11-18 02:12:48.632797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.632921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.632948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.318 qpair failed and we were unable to recover it. 00:30:14.318 [2024-11-18 02:12:48.633077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.633200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.633227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.318 qpair failed and we were unable to recover it. 00:30:14.318 [2024-11-18 02:12:48.633319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.633436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.633479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.318 qpair failed and we were unable to recover it. 00:30:14.318 [2024-11-18 02:12:48.633574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.633658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.633683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.318 qpair failed and we were unable to recover it. 00:30:14.318 [2024-11-18 02:12:48.633800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.633921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.633962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.318 qpair failed and we were unable to recover it. 00:30:14.318 [2024-11-18 02:12:48.634101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.634211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.318 [2024-11-18 02:12:48.634254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.318 qpair failed and we were unable to recover it. 00:30:14.318 [2024-11-18 02:12:48.634381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.603 [2024-11-18 02:12:48.634478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.603 [2024-11-18 02:12:48.634506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.603 qpair failed and we were unable to recover it. 00:30:14.603 [2024-11-18 02:12:48.634643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.603 [2024-11-18 02:12:48.634729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.603 [2024-11-18 02:12:48.634754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.603 qpair failed and we were unable to recover it. 00:30:14.603 [2024-11-18 02:12:48.634845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.603 [2024-11-18 02:12:48.634943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.603 [2024-11-18 02:12:48.634971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.603 qpair failed and we were unable to recover it. 00:30:14.603 [2024-11-18 02:12:48.635068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.603 [2024-11-18 02:12:48.635215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.603 [2024-11-18 02:12:48.635243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.635338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.635455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.635484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.635590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.635676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.635701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.635839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.635950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.635976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.636061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.636139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.636164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.636246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.636371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.636398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.636503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.636614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.636638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.636741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.636875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.636900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.637006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.637117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.637142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.637336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.637425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.637453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.637554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.637667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.637691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.637777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.637858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.637882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.637966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.638078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.638103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.638240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.638337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.638364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.638444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.638582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.638608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.638717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.638791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.638816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.638952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.639088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.639114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.639205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.639320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.639345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.639430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.639506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.639532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.639612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.639700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.639725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.639816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.639951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.639979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.640109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.640194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.640220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.640357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.640469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.640495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.640580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.640687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.640712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.640789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.640870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.640895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.641002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.641093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.641122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.641248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.641337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.641363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.641444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.641558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.641583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.641695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.641848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.641878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.641989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.642115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.642143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.642240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.642353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.642380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.642520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.642679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.642707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.604 [2024-11-18 02:12:48.642828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.642921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.604 [2024-11-18 02:12:48.642963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.604 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.643075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.643158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.643185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.643273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.643367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.643393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.643509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.643582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.643607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.643711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.643828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.643853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.643984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.644101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.644130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.644262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.644349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.644380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.644454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.644590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.644615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.644699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.644880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.644906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.645021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.645101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.645143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.645267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.645390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.645417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.645492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.645634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.645659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.645795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.645916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.645944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.646095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.646259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.646284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.646408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.646519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.646545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.646620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.646755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.646780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.646851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.646966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.646991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.647108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.647248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.647272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.647366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.647477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.647502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.647617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.647706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.647730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.647856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.647972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.647999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.648114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.648237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.648266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.648385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.648459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.648484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.648599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.648697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.648726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.648883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.649022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.649047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.649129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.649261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.649289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.649450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.649556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.649581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.649663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.649802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.649845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.649951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.650058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.650084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.605 qpair failed and we were unable to recover it. 00:30:14.605 [2024-11-18 02:12:48.650189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.605 [2024-11-18 02:12:48.650298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.650335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.650447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.650550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.650575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.650667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.650800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.650828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.650925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.651071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.651099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.651234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.651354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.651398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.651514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.651665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.651690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.651790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.651904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.651932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.652056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.652214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.652243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.652373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.652468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.652511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.652652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.652758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.652783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.652865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.652944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.652970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.653049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.653163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.653204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.653355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.653453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.653481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.653609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.653688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.653713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.653817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.653928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.653971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.654061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.654179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.654221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.654340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.654450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.654493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.654591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.654673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.654698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.654783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.654907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.654950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.655068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.655216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.655256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.655369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.655453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.655495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.655663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.655775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.655800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.655935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.656086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.656114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.656239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.656334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.656364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.656481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.656602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.656630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.656758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.656840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.656865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.657025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.657107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.657135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.657276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.657419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.657446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.606 [2024-11-18 02:12:48.657552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.657701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.606 [2024-11-18 02:12:48.657734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.606 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.657871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.657949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.657974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.658115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.658214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.658242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.658367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.658484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.658513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.658663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.658784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.658812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.658913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.659025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.659050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.659131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.659220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.659245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.659353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.659485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.659513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.659664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.659750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.659778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.659915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.660052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.660078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.660233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.660322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.660352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.660480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.660637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.660663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.660781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.660946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.660971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.661110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.661219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.661244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.661325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.661441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.661467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.661576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.661661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.661688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.661810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.661961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.661989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.662126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.662205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.662231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.662345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.662419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.662445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.662574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.662698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.662740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.662825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.662935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.662961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.663077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.663186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.663212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.663324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.663451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.663479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.663567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.663697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.663722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.663841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.663974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.664002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.664140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.664253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.664278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.664366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.664442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.664467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.664572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.664674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.664698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.664806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.664911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.664936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.607 qpair failed and we were unable to recover it. 00:30:14.607 [2024-11-18 02:12:48.665030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.607 [2024-11-18 02:12:48.665141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.665166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.665345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.665459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.665484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.665622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.665773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.665814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.665954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.666107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.666135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.666264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.666375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.666401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.666507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.666629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.666654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.666737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.666872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.666913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.667029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.667143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.667170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.667281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.667432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.667458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.667581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.667673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.667701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.667817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.667979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.668005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.668142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.668274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.668302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.668431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.668557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.668583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.668661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.668798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.668826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.668928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.669013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.669041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.669120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.669222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.669263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.669398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.669511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.669535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.669647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.669763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.669787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.669870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.669974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.669999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.670106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.670183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.670209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.670296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.670383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.670408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.670498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.670610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.670635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.670714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.670822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.670852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.670956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.671067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.671096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.608 qpair failed and we were unable to recover it. 00:30:14.608 [2024-11-18 02:12:48.671231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.608 [2024-11-18 02:12:48.671372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.671398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.671515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.671638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.671666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.671759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.671891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.671919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.672063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.672145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.672173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.672344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.672455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.672480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.672630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.672725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.672753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.672912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.672993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.673018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.673144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.673257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.673286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.673405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.673493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.673520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.673638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.673720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.673746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.673826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.673971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.674013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.674132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.674247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.674275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.674437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.674538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.674563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.674646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.674787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.674813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.674952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.675038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.675068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.675199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.675282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.675317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.675453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.675543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.675569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.675655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.675770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.675795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.675919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.676013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.676041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.676179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.676253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.676278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.676436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.676517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.676542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.676656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.676776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.676805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.676901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.677002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.677028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.677107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.677231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.677259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.677375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.677489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.677514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.677631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.677795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.677823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.677945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.678050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.678075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.678149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.678251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.678276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.678364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.678471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.609 [2024-11-18 02:12:48.678497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.609 qpair failed and we were unable to recover it. 00:30:14.609 [2024-11-18 02:12:48.678631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.678722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.678750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.678877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.679000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.679029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.679116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.679233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.679261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.679353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.679483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.679507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.679595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.679704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.679728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.679817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.679976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.680004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.680173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.680279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.680304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.680427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.680532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.680557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.680673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.680754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.680779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.680858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.680972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.680996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.681125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.681263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.681289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.681394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.681493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.681522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.681645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.681811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.681856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.681985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.682136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.682181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.682295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.682455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.682482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.682651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.682797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.682840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.682955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.683068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.683095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.683179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.683297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.683331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.683417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.683529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.683556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.683674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.683759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.683785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.683898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.683980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.684006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.684124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.684238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.684264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.684359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.684502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.684529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.684603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.684715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.684741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.684881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.684965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.684992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.685068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.685153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.685178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.685321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.685406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.685434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.685546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.685662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.610 [2024-11-18 02:12:48.685688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.610 qpair failed and we were unable to recover it. 00:30:14.610 [2024-11-18 02:12:48.685770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.685883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.685911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.686035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.686153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.686179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.686274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.686367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.686402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.686485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.686565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.686592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.686676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.686760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.686787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.686926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.687016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.687042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.687122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.687241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.687267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.687385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.687475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.687502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.687616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.687732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.687758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.687899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.687973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.687999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.688151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.688264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.688289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.688407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.688531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.688575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.688658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.688764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.688795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.688921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.689025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.689051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.689193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.689335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.689362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.689505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.689640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.689667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.689779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.689920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.689946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.690051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.690136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.690163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.690281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.690421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.690448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.690564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.690703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.690730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.690843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.690956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.690982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.691066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.691178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.691204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.691287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.691382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.691413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.691556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.691670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.691696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.691775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.691863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.691890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.691971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.692061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.692086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.692176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.692289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.692319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.692460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.692578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.692603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.611 qpair failed and we were unable to recover it. 00:30:14.611 [2024-11-18 02:12:48.692716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.611 [2024-11-18 02:12:48.692858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.692884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.693002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.693079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.693105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.693220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.693332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.693360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.693473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.693580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.693606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.693689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.693828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.693858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.693998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.694106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.694132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.694249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.694389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.694433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.694548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.694694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.694719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.694835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.694916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.694942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.695059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.695138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.695163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.695253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.695346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.695372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.695485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.695596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.695623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.695705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.695818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.695845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.695934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.696015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.696041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.696122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.696207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.696233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.696350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.696492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.696518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.696631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.696742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.696768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.696920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.697040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.697066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.697212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.697328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.697354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.697472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.697550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.697575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.697690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.697796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.697823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.697939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.698026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.698053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.698163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.698271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.698297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.698398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.698490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.698518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.698655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.698799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.698825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.698944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.699049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.699075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.612 qpair failed and we were unable to recover it. 00:30:14.612 [2024-11-18 02:12:48.699215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.612 [2024-11-18 02:12:48.699337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.699365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.699469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.699580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.699607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.699691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.699807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.699834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.699948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.700063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.700088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.700199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.700282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.700309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.700401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.700484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.700510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.700590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.700673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.700699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.700787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.700862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.700888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.700975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.701056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.701082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.701175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.701344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.701371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.701464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.701585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.701611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.701724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.701864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.701890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.701970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.702112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.702139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.702229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.702318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.702346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.702466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.702556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.702582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.702697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.702800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.702826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.702972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.703061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.703087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.703197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.703276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.703303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.703391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.703505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.703531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.703620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.703701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.703728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.703812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.703907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.703933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.704072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.704153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.704180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.704324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.704437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.704463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.704547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.704662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.704689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.704772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.704882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.704908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.704985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.705128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.705154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.705269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.705398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.705426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.613 [2024-11-18 02:12:48.705521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.705634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.613 [2024-11-18 02:12:48.705661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.613 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.705750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.705863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.705889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.706036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.706160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.706185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.706302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.706420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.706447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.706566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.706648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.706676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.706760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.706872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.706898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.707022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.707101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.707127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.707214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.707328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.707363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.707484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.707590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.707616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.707731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.707821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.707847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.707960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.708098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.708124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.708236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.708350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.708376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.708500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.708618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.708644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.708785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.708922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.708948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.709068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.709174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.709200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.709283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.709374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.709401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.709502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.709639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.709667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.709758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.709877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.709903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.710042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.710156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.710182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.710297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.710447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.710473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.710589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.710735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.710761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.710875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.710962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.710988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.711110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.711189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.711215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.711332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.711450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.711476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.711593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.711703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.711729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.711819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.711906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.711933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.712057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.712131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.712157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.712273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.712398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.712425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.712536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.712648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.712675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.614 qpair failed and we were unable to recover it. 00:30:14.614 [2024-11-18 02:12:48.712790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.614 [2024-11-18 02:12:48.712931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.712958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.713066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.713142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.713171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.713260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.713375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.713404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.713499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.713616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.713642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.713757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.713867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.713893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.713978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.714058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.714084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.714179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.714266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.714293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.714442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.714546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.714572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.714659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.714741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.714768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.714855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.714990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.715016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.715128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.715241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.715267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.715415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.715500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.715528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.715622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.715736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.715761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.715856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.715948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.715976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.716097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.716217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.716244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.716335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.716446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.716473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.716592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.716700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.716727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.716836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.716943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.716969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.717076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.717179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.717205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.717344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.717463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.717489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.717598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.717681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.717707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.717820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.717933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.717960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.718099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.718241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.718267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.718352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.718433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.718461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.718582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.718691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.718717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.718835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.718962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.718988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.719098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.719190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.719216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.719333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.719425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.719451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.615 [2024-11-18 02:12:48.719562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.719700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.615 [2024-11-18 02:12:48.719727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.615 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.719807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.719951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.719978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.720082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.720189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.720226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.720315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.720404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.720430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.720550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.720667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.720693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.720781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.720871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.720898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.721042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.721156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.721183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.721274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.721405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.721432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.721516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.721640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.721668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.721782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.721937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.721963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.722103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.722221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.722255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.722384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.722468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.722494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.722583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.722663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.722689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.722817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.722935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.722961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.723086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.723170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.723196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.723343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.723464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.723490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.723603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.723684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.723709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.723788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.723931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.723957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.724042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.724128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.724154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.724245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.724390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.724417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.724530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.724628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.724655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.724779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.724895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.724921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.725070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.725179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.725206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.725290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.725843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.725873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.725990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.726098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.726125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.726246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.726348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.726380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.726465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.726542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.726569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.726685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.726796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.726824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.616 [2024-11-18 02:12:48.726919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.727021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.616 [2024-11-18 02:12:48.727047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.616 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.727137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.727217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.727243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.727363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.727449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.727476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.727584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.727738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.727763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.727873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.727983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.728009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.728128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.728215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.728241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.728351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.728441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.728467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.728554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.728652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.728682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.728780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.728868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.728894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.728978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.729096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.729122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.729261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.729367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.729395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.729483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.729636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.729664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.729785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.729892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.729918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.730033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.730125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.730152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.730264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.730386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.730414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.730535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.730672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.730698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.730790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.730873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.730899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.730985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.731091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.731122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.731237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.731363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.731389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.731472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.731553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.731580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.731660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.731750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.731776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.731913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.732034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.732060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.732180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.732289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.732321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.732414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.732530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.732555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.732678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.732777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.732803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.732900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.732989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.733014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.617 qpair failed and we were unable to recover it. 00:30:14.617 [2024-11-18 02:12:48.733101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.617 [2024-11-18 02:12:48.733222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.733248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.733352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.733467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.733503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.733590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.733704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.733730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.733840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.733941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.733967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.734045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.734152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.734178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.734294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.734377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.734404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.734525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.734617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.734643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.734733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.734839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.734865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.735664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.735816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.735843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.735964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.736080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.736107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.736202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.736333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.736360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.736453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.736548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.736574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.736672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.736789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.736816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.736929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.737047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.737073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.737182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.737298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.737356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.737444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.737567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.737593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.737697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.737811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.737836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.737956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.738071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.738097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.738186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.738269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.738297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.738387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.738481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.738507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.738596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.738709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.738736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.738875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.738959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.738986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.739111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.739230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.739256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.739390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.739482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.739508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.739637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.739781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.739807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.739932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.740068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.740094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.740176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.740288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.740321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.740417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.740528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.740554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.618 qpair failed and we were unable to recover it. 00:30:14.618 [2024-11-18 02:12:48.740647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.618 [2024-11-18 02:12:48.740803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.740829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.740915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.741055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.741081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.741189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.741343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.741371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.741452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.741563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.741589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.741715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.741830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.741855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.741967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.742081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.742109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.742187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.742286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.742327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.742441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.742525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.742551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.742643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.742772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.742799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.742908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.742998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.743024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.743108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.743217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.743244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.743323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.743432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.743458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.743541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.743661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.743687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.743777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.743894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.743920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.744039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.744143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.744169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.744254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.744343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.744370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.744458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.744567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.744593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.744729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.744809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.744835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.744924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.745014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.745042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.745121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.745223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.745249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.745367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.745456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.745483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.745637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.745762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.745789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.745871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.746010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.746036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.746144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.746259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.746286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.746433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.746557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.746586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.746705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.746810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.746838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.746992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.747110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.747136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.747219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.747346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.747373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.619 qpair failed and we were unable to recover it. 00:30:14.619 [2024-11-18 02:12:48.747511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.619 [2024-11-18 02:12:48.747646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.747675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.747795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.747925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.747954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.748052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.748151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.748194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.748273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.748370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.748397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.748496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.748579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.748607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.748695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.748821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.748859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.748990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.749112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.749141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.749292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.749407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.749434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.749514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.749595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.749620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.749741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.749820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.749861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.749990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.750082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.750111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.750233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.750371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.750397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.750504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.750582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.750607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.750685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.750790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.750815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.750971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.751069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.751099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.751252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.751389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.751416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.751520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.751615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.751644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.751779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.751920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.751973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.752094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.752200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.752226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.752326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.752442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.752468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.752563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.752652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.752678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.752791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.752912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.752939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.753052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.753164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.753190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.753300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.753429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.753456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.753540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.753648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.753674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.753819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.753910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.753937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.754032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.754150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.754176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.754325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.754414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.754441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.620 qpair failed and we were unable to recover it. 00:30:14.620 [2024-11-18 02:12:48.754528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.754650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.620 [2024-11-18 02:12:48.754677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.754784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.754869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.754895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.754986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.755093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.755127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.755207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.755281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.755306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.755397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.755501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.755528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.755654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.755769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.755795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.755891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.756027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.756053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.756137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.756219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.756246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.756364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.756455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.756483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.756565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.756684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.756711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.756822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.756943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.756970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.757081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.757159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.757186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.757299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.757413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.757440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.757529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.757649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.757675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.757772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.757888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.757914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.758054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.758166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.758200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.758277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.758394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.758421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.758536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.758651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.758678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.758791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.758924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.758951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.759098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.759183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.759209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.759294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.759413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.759441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.759561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.759653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.759680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.759770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.759892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.759920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.760019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.760128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.760154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.760266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.760357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.760384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.760499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.760620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.760647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.760763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.760899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.760926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.761009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.761150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.761177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.761259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.761997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.621 [2024-11-18 02:12:48.762030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.621 qpair failed and we were unable to recover it. 00:30:14.621 [2024-11-18 02:12:48.762125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.762216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.762253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.762357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.762448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.762475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.762565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.762660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.762687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.762800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.762919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.762953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.763049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.763168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.763194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.763317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.763407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.763432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.763514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.763660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.763686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.763828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.763944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.763970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.764081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.764162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.764189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.764307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.764449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.764480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.764600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.764715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.764742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.764829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.764912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.764939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.765023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.765134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.765160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.765279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.765402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.765430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.765570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.765668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.765697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.765812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.765899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.765926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.766020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.766132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.766160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.766277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.766406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.766432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.766543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.766662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.766688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.766834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.766946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.766976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.767098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.767249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.767275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.767422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.767505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.767531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.767647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.767759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.767785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.767866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.768012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.768038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.768120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.768200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.768228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.622 qpair failed and we were unable to recover it. 00:30:14.622 [2024-11-18 02:12:48.768376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.768489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.622 [2024-11-18 02:12:48.768515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.768634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.768721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.768747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.768869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.768980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.769008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.769091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.769199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.769225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.769352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.769469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.769500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.769643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.769787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.769812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.769895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.770005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.770030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.770107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.770245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.770272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.770402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.770485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.770511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.770587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.770696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.770723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.770833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.770982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.771008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.771132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.771287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.771317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.771458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.771591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.771634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.771732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.771867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.771894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.771987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.772092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.772122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.772213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.772302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.772336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.772454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.772541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.772566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.772688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.772799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.772825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.772914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.772989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.773016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.773134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.773245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.773272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.773378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.773457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.773483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.773628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.773704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.773730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.773871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.773984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.774010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.774095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.774209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.774236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.774345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.774465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.774492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.774580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.774695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.774721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.774834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.774920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.774946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.775064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.775151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.775177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.623 [2024-11-18 02:12:48.775293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.775409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.623 [2024-11-18 02:12:48.775437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.623 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.775557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.775649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.775684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.775793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.775906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.775931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.776045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.776163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.776189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.776276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.776374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.776401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.776520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.776634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.776660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.776776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.776933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.776959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.777078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.777199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.777225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.777351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.777492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.777518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.777658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.777782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.777808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.777918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.778034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.778059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.778151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.778237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.778263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.778385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.778500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.778525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.778611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.778758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.778784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.778894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.778978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.779004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.779086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.779198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.779224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.779345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.779428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.779455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.779544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.779670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.779702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.779787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.779900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.779926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.780050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.780199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.780225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.780363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.780451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.780478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.780594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.780702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.780728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.780872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.781002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.781028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.781114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.781212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.781238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.781333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.781472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.781499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.781612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.781691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.781717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.781842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.781985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.782011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.782102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.782239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.782266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.782384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.783143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.624 [2024-11-18 02:12:48.783173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.624 qpair failed and we were unable to recover it. 00:30:14.624 [2024-11-18 02:12:48.783343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.783453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.783480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.783621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.783732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.783758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.783883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.784026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.784053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.784193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.784298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.784330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.784446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.784558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.784584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.784726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.784851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.784876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.785010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.785158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.785184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.785303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.785422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.785448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.785544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.785658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.785684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.785796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.785884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.785909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.786018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.786127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.786154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.786265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.786386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.786414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.786554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.786677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.786703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.786798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.786949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.786975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.787065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.787143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.787170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.787256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.787374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.787401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.787518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.787601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.787628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.787719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.787833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.787859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.787980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.788096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.788123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.789024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.789171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.789200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.789327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.789421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.789447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.789565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.789653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.789690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.789809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.789896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.789923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.790004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.790116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.790143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.790267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.790389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.790416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.790512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.790618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.790645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.790777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16fbe00 is same with the state(5) to be set 00:30:14.625 [2024-11-18 02:12:48.790969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.791124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.791154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.791255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.791378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.625 [2024-11-18 02:12:48.791409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.625 qpair failed and we were unable to recover it. 00:30:14.625 [2024-11-18 02:12:48.791531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.791655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.791685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.791858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.791989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.792030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.792158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.792293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.792332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.792448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.792530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.792556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.792682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.792772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.792798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.792911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.793027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.793054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.793183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.793300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.793335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.793449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.793562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.793589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.793683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.793832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.793859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.793977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.794056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.794082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.794540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.794667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.794695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.794821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.794904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.794931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.795022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.795114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.795141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.795240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.795361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.795388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.795473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.795569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.795596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.795698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.795792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.795819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.795933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.796051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.796080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.796173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.796279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.796305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.796406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.796487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.796513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.796627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.796705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.796731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.796857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.796993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.797021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.797146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.797270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.797300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.797418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.797547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.797573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.797664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.797808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.797837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.797936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.798067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.798096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.626 [2024-11-18 02:12:48.798208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.798359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.626 [2024-11-18 02:12:48.798386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.626 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.798474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.798584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.798610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.798695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.798837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.798864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.798973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.799099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.799138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.799245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.799361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.799389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.799469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.799563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.799589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.799716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.799850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.799879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.800037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.800143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.800169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.800253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.800347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.800374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.800458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.800541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.800567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.800677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.800787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.800813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.800904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.801043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.801072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.801163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.801285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.801317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.801401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.801511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.801538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.801615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.801702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.801728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.801902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.802026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.802054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.802217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.802333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.802377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.802569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.802657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.802683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.802873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.803057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.803086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.803191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.803336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.803379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.803471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.803550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.803577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.803695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.803792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.803818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.803962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.804056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.804082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.804889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.805028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.805060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.805250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.805388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.805415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.805514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.805599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.805627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.805838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.806035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.806075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.806248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.806342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.806387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.806481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.806576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.627 [2024-11-18 02:12:48.806602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.627 qpair failed and we were unable to recover it. 00:30:14.627 [2024-11-18 02:12:48.806689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.806807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.806833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.806939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.807064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.807095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.807211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.807316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.807343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.807433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.807513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.807539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.807661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.807758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.807804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.808004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.808166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.808195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.808370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.808463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.808490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.808635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.808725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.808751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.808845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.808960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.808990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.809114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.809219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.809245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.809354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.809444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.809471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.809585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.809673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.809700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.809840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.809932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.809958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.810075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.810188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.810216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.810297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.810397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.810424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.810514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.810706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.810733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.810891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.811021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.811059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.811161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.811257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.811284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.811424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.811510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.811537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.811628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.811720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.811754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.811896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.811980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.812006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.812092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.812185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.812211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.812301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.812413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.812439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.812552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.812687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.812713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.812822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.812898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.812924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.813013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.813148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.813179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.813282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.813401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.813429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.628 [2024-11-18 02:12:48.813522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.813639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.628 [2024-11-18 02:12:48.813682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.628 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.813802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.813895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.813924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.814064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.814166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.814192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.814302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.814497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.814522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.814638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.814732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.814758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.814836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.814946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.814972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.815083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.815214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.815241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.815361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.815452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.815479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.815561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.815659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.815696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.815771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.815884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.815915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.816003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.816093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.816121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.816240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.816335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.816363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.816454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.816540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.816566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.816714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.816829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.816855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.816968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.817078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.817106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.817217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.817315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.817343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.817432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.817514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.817539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.817634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.817775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.817802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.817972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.818073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.818098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.818188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.818340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.818368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.818457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.818569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.818596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.818684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.818760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.818785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.818904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.818979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.819005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.819086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.819166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.819193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.819321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.819403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.819430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.819524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.819633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.819660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.819767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.819841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.819867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.820375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.820503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.820532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.820640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.820786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.629 [2024-11-18 02:12:48.820830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.629 qpair failed and we were unable to recover it. 00:30:14.629 [2024-11-18 02:12:48.820972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.821132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.821162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.821257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.821380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.821406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.821496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.821585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.821612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.821695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.821837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.821863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.821952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.822024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.822050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.822131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.822212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.822239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.822327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.822422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.822448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.822546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.822663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.822716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.822853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.823000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.823042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.823135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.823261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.823290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.823414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.823499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.823530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.823648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.823787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.823813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.823950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.824031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.824058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.824172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.824256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.824282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.824407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.824502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.824530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.824628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.824722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.824749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.824881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.824998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.825027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.825119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.825226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.825252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.825339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.825456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.825482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.825571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.825685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.825711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.825820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.825892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.825922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.825996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.826109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.826139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.826251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.826347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.826373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.826471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.826546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.826573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.826732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.826871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.826904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.827046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.827151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.827180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.827322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.827431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.827457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.827536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.827621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.827646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.630 qpair failed and we were unable to recover it. 00:30:14.630 [2024-11-18 02:12:48.827748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.630 [2024-11-18 02:12:48.827857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.827901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.828119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.828242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.828285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.828375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.828485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.828516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.828592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.828709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.828734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.828817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.828893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.828934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.829025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.829137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.829169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.829291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.829419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.829444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.829528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.829625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.829650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.829754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.829837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.829862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.829957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.830111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.830137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.830286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.830381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.830406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.830497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.830570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.830595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.830675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.830816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.830844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.830967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.831100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.831129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.831241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.831377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.831404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.831486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.831599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.831629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.831708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.831845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.831876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.831962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.832044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.832070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.832183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.832275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.832300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.832404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.832488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.832513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.832597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.832750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.832775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.832881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.833002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.833027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.833114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.833244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.833272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.833436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.833542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.833572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.833658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.833740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.833766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.833872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.834023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.834052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.834177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.834268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.834298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.631 qpair failed and we were unable to recover it. 00:30:14.631 [2024-11-18 02:12:48.834418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.834509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.631 [2024-11-18 02:12:48.834535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.834643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.834790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.834817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.834926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.835003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.835029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.835124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.835210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.835236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.835326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.835440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.835466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.835546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.835633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.835659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.835761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.835852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.835897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.836002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.836105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.836136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.836232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.836355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.836400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.836488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.836570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.836596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.836682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.836791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.836817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.836957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.837077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.837102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.837176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.837285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.837318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.837404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.837506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.837532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.837629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.837710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.837735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.837881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.837993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.838018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.838152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.838256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.838286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.838407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.838494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.838522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.838603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.838734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.838761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.838906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.839017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.839044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.839155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.839240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.839266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.839361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.839448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.839474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.839626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.839737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.839763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.839848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.839964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.839992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.840075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.840162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.840200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.840296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.840400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.840428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.840519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.840633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.840660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.840750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.840830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.840857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.840982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.841123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.841148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.841233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.841330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.841356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.841498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.841582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.632 [2024-11-18 02:12:48.841618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.632 qpair failed and we were unable to recover it. 00:30:14.632 [2024-11-18 02:12:48.841729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.841835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.841860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.841939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.842014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.842038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.842131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.842246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.842291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.842422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.842534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.842561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.842687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.842774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.842801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.842905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.843044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.843070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.843199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.843283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.843316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.843407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.843490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.843515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.843611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.843710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.843736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.843863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.843963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.843991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.844111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.844213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.844237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.844354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.844441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.844467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.844596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.844708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.844738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.844835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.844986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.845014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.845115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.845209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.845239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.845357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.845447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.845473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.845585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.845673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.845699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.845796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.845900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.845926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.846027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.846119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.846148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.846244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.846336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.846380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.846464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.846547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.846571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.846684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.846766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.846791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.846906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.846982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.847025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.847128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.847215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.847241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.847358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.847465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.847491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.847578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.847704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.847729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.847816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.847893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.847919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.847999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.848121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.848146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.848230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.848329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.848354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.848449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.848529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.848553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.633 qpair failed and we were unable to recover it. 00:30:14.633 [2024-11-18 02:12:48.848699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.633 [2024-11-18 02:12:48.848789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.848814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.848894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.848968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.848993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.849085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.849181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.849211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.849297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.849401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.849428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.849514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.849605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.849632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.849753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.849864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.849895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.850088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.850170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.850197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.850305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.850405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.850432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.850524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.850713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.850739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.850853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.850947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.850973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.851080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.851172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.851198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.851337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.851436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.851462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.851577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.851740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.851769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.851878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.852007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.852035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.852162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.852323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.852371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.852482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.852568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.852600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.852701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.852840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.852867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.852962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.853048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.853074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.853200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.853299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.853335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.853415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.853498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.853525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.853604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.853688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.853714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.853846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.853934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.853964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.854055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.854152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.854182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.854286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.854444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.854474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.854561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.854723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.854749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.854864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.854939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.854988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.855079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.855196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.855238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.855377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.855457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.855482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.855569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.855653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.855679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.855815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.855944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.855970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.856053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.856187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.856218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.856375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.856466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.856492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.856584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.856668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.856692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.634 qpair failed and we were unable to recover it. 00:30:14.634 [2024-11-18 02:12:48.856780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.856935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.634 [2024-11-18 02:12:48.856978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.857085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.857205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.857247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.857343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.857429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.857454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.857535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.857639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.857665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.857775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.857861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.857887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.858024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.858153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.858178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.858270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.858393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.858420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.858500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.858576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.858601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.858686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.858800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.858826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.858911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.859003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.859028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.859142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.859278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.859303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.859407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.859519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.859547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.859639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.859745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.859770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.859885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.860001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.860028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.860181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.860346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.860373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.860456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.860536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.860561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.860707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.860793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.860819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.860953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.861048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.861075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.861201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.861321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.861348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.861466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.861547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.861573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.861692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.861771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.861796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.861926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.862062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.862088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.862177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.862263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.862304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.862492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.862589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.862619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.862744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.862855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.862881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.862998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.863088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.863115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.863236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.863332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.863362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.863450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.863557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.863584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.863673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.863762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.863790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.863910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.864016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.864043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.635 [2024-11-18 02:12:48.864126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.864210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.635 [2024-11-18 02:12:48.864236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.635 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.864334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.864528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.864554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.864660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.864799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.864824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.864949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.865068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.865094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.865283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.865405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.865432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.865555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.865664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.865691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.865777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.865863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.865890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.865980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.866101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.866127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.866204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.866346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.866375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.866492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.866577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.866604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.866718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.866808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.866835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.866946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.867034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.867061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.867190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.867271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.867298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.867405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.867489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.867518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.867676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.867783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.867809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.867924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.868008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.868034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.868127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.868245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.868271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.868384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.868468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.868494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.868610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.868728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.868754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.868840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.868925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.868950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.869063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.869143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.869170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.869296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.869422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.869449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.869534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.869641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.869667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.869808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.869922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.869949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.870038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.870124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.870150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.870268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.870400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.870428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.870545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.870660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.870687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.870768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.870870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.870895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.870983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.871093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.871118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.871232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.871324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.871353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.871466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.871552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.871579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.871696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.871810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.871836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.871955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.872095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.872121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.636 qpair failed and we were unable to recover it. 00:30:14.636 [2024-11-18 02:12:48.872234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.872320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.636 [2024-11-18 02:12:48.872347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.872451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.872535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.872562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.872705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.872787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.872813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.872926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.873031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.873057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.873175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.873260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.873285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.873385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.873499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.873526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.873640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.873724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.873750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.873834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.873915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.873941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.874027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.874140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.874165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.874252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.874339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.874375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.874460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.874575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.874603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.874745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.874857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.874884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.874968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.875073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.875104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.875216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.875335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.875362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.875458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.875573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.875599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.875722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.875809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.875836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.875977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.876063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.876088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.876165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.876306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.876338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.876420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.876533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.876564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.876684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.876770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.876796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.876887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.877008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.877034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.877122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.877200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.877226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.877335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.877458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.877484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.877599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.877719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.877745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.877827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.877944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.877970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.878082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.878173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.878199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.878323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.878437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.878464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.878577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.878703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.878728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.878844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.878949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.878974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.879084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.879192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.879218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.879337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.879432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.879458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.879576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.879667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.879694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.879785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.879899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.879926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.880048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.880139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.880166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.880254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.880396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.880422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.637 qpair failed and we were unable to recover it. 00:30:14.637 [2024-11-18 02:12:48.880502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.637 [2024-11-18 02:12:48.880614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.880642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.880754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.880868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.880894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.880973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.881067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.881092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.881233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.881327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.881360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.881449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.881540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.881567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.881659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.881774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.881801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.881878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.881997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.882024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.882137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.882278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.882304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.882430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.882509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.882535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.882653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.882770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.882797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.882925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.883013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.883040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.883157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.883271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.883297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.883405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.883494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.883520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.883639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.883746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.883772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.883883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.883991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.884017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.884105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.884222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.884248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.884368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.884486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.884511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.884630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.884718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.884745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.884864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.884949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.884976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.885122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.885207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.885235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.885329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.885479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.885504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.885615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.885695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.885721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.885881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.885998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.886024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.886110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.886199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.886224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.886334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.886426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.886451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.886546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.886628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.886661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.886772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.886885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.886912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.886992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.887082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.887109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.887221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.887298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.887337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.887430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.887542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.887569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.887653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.887793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.887819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.887936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.888053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.888079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.888192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.888268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.888294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.888400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.888513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.888539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.888655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.888740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.888767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.888875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.888961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.888990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.889076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.889151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.889189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.889331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.889424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.889450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.889557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.889640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.889666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.889778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.889899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.889925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.890007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.890095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.890121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.890239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.890349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.890376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.890493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.890593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.890619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.890711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.890816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.890842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.890929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.891042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.638 [2024-11-18 02:12:48.891068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.638 qpair failed and we were unable to recover it. 00:30:14.638 [2024-11-18 02:12:48.891183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.891296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.891332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.891417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.891507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.891533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.891672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.891753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.891779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.891892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.892005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.892030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.892138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.892252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.892278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.892428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.892508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.892533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.892608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.892746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.892772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.892889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.892993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.893018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.893126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.893206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.893232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.893370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.893456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.893482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.893558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.893668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.893699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.893809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.893915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.893942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.894020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.894136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.894162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.894277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.894378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.894405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.894488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.894605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.894632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.894746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.894858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.894885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.894973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.895054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.895081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.895188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.895307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.895339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.895432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.895517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.895543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.895628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.895742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.895768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.895858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.898461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.898489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.898583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.898700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.898726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.898844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.898958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.898984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.899125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.899241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.899267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.899390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.899478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.899504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.899594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.899710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.899739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.899853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.899966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.899992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.900079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.900187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.900214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.900304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.900421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.900447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.900540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.900673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.900699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.900786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.900927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.900954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.901070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.901176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.901202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.901275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.901395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.901423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.901535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.901624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.901650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.901769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.901880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.901906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.902018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.902124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.902150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.902231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.902341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.902369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.902444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.902557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.902585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.902730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.902803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.902829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.902909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.903004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.903030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.903147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.903259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.903285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.903388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.903502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.903528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.903642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.903759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.903785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.903883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.903993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.904019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.904124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.904240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.904266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.904363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.904482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.904508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.904596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.904712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.904739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.904846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.904930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.904957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.905045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.905167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.905193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.905302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.905395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.905421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.905509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.905589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.905616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.639 qpair failed and we were unable to recover it. 00:30:14.639 [2024-11-18 02:12:48.905729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.639 [2024-11-18 02:12:48.905813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.905840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.905919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.906058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.906084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.906193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.906273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.906300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.906424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.906520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.906545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.906664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.906802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.906829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.906942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.907047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.907073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.907153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.907243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.907270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.907416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.907501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.907527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.907630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.907742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.907768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.907911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.907994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.908021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.908103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.908216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.908243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.908382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.908469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.908495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.908617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.908702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.908728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.908810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.908950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.908976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.909091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.909169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.909195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.909337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.909427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.909454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.909540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.909624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.909650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.909737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.909850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.909877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.909954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.910032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.910058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.910177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.910282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.910308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.910432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.910526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.910554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.910667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.910809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.910835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.910943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.911060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.911086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.911201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.911314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.911341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.911422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.911507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.911533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.911642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.911749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.911774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.911866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.911973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.911999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.912114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.912282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.912319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.912415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.912509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.912535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.912650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.912757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.912783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.912924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.913023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.913049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.913188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.913300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.913334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.913421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.913535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.913561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.913707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.913815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.913840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.913955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.914034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.914060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.914145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.914224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.914250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.914391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.914479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.914504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.914629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.914715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.914741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.914849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.914963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.914990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.915085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.915173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.915199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.915306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.915448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.915479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.915615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.915743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.915788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.915910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.915989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.916016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.916112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.916222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.916248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.916360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.916484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.916510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.916587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.916674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.916700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.916841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.916924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.916953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.917042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.917148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.917174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.917267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.917395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.917422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.917504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.917595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.917621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.917736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.917831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.917858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.917965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.918046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.918072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.918189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.918302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.918337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.640 [2024-11-18 02:12:48.918431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.918514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-18 02:12:48.918540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.640 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.918631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.918776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.918806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.918896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.919031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.919057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.919194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.919353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.919380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.919491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.919580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.919606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.919732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.919841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.919870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.919993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.920082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.920110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.920206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.920330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.920359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.920461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.920571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.920597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.920678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.920811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.920840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.920968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.921061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.921089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.921252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.921340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.921375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.921514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.921601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.921645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.921770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.921885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.921914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.922080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.922168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.922196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.922306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.922409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.922434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.922553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.922672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.922698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.922797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.922947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.922976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.923097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.923252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.923281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.923457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.923601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.923629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.923742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.923899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.923928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.924019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.924142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.924173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.924269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.924398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.924425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.924522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.924666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.924711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.924853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.924998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.925027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.925139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.925225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.925252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.925382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.925509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.925535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.925623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.925744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.925770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.925862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.925971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.925997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.926135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.926243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.926270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.926365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.926454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.926481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.926570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.926711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.926738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.926882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.926966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.926994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.927108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.927188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.927214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.927305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.927437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.927465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.927567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.927653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.927680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.927819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.927900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.927926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.928020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.928171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.928201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.928286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.928432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.928461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.928556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.928699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.928729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.928821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.928948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.928976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.929077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.929241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.929266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.929390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.929503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.929530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.929628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.929742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.929770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.929896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.929993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.930023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.930191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.930322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.930350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.930446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.930553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.930579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.930674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.930806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.930839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.930921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.931004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.931030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.641 qpair failed and we were unable to recover it. 00:30:14.641 [2024-11-18 02:12:48.931172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-18 02:12:48.931290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.931341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.931502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.931623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.931653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.931813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.931944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.931988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.932087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.932205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.932247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.932372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.932462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.932488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.932578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.932689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.932734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.932853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.933017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.933043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.933137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.933240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.933269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.933390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.933469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.933499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.933614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.933724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.933750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.933835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.933991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.934021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.934126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.934257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.934300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.934435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.934582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.934608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.934742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.934824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.934868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.934992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.935144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.935173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.935265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.935383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.935409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.935526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.935607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.935648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.935771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.935884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.935913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.936032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.936125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.936160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.936266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.936420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.936447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.936572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.936683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.936726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.936894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.937015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.937042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.937151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.937230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.937256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.937336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.937424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.937452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.937563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.937680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.937707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.937824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.937974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.938000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.938115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.938196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.938222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.938309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.938407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.938433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.938522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.938659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.938685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.938803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.938886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.938928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.939056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.939179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.939209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.939320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.939409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.939435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.939552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.939666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.939693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.939780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.939924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.939954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.940054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.940178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.940207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.940302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.940466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.940492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.940620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.940735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.940761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.940891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.940982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.941011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.941093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.941232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.941261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.941385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.941474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.941501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.941597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.941684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.941710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.941823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.941908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.941937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.942017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.942100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.942127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.942229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.942326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.942354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.942461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.942602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.942628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.942765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.942854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.942880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.942995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.943106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.943133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.943215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.943360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.943387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.943498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.943611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.943637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.943724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.943828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.943854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.943942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.944032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.944058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.944175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.944259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.944286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.944383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.944475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.944502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.944613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.944727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.944753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.642 qpair failed and we were unable to recover it. 00:30:14.642 [2024-11-18 02:12:48.944835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-18 02:12:48.944921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.944947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.945068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.945172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.945199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.945303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.945395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.945422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.945538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.945653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.945679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.945757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.945870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.945896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.945988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.946066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.946093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.946213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.946328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.946364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.946469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.946582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.946608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.946744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.946859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.946885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.946977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.947059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.947085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.947199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.947307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.947339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.947420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.947528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.947555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.947696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.947790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.947816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.947903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.948012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.948038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.948120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.948201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.948228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.948338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.948480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.948507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.948618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.948694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.948720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.948802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.948893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.948921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.949031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.949116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.949143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.949229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.949345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.949373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.949485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.949591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.949617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.949704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.949782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.949808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.949918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.950038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.950066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.950182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.950324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.950352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.950463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.950550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.950576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.950661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.950749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.950776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.950873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.950987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.951014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.951153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.951264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.951290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.951457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.951540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.951572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.951662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.951776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.951802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.951955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.952046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.952072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.952185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.952295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.952333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.952453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.952570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.952596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.952701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.952789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.952817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.952901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.952981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.953007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.953151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.953236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.953263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.953374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.953485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.953511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.953602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.953711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.953737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.953810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.953917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.953942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.954048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.954161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.954187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.954290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.954444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.954470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.954620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.954700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.954726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.954804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.954889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.954917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.955004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.955140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.955166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.955243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.955332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.955360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.955478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.955625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.955651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.955768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.955880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.955906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.956015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.956128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.956155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.956272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.956419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.956446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.956563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.956678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.956704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.643 [2024-11-18 02:12:48.956846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.956959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.643 [2024-11-18 02:12:48.956986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.643 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.957097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.957210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.957237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.957384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.957496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.957522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.957609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.957703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.957730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.957837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.957946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.957971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.958054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.958178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.958204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.958322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.958432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.958459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.958606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.958742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.958768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.958883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.958990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.959017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.959099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.959176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.959202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.959317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.959464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.959490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.959589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.959690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.959717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.959822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.959903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.959928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.960037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.960115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.960141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.960303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.960409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.960446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.960525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.960619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.960646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.960772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.960887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.960913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.960992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.961109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.961136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.961274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.961426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.961453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.961567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.961670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.961696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.961813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.961896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.961923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.962036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.962179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.962205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.962289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.962392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.962419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.962512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.962596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.962624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.962718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.962834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.962860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.962972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.963065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.963091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.963200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.963286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.963320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.963413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.963502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.963529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.963632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.963739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.963765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.963863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.963950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.963975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.964058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.964146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.964172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.964250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.964343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.964382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.964474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.964563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.964589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.964698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.964782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.644 [2024-11-18 02:12:48.964808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.644 qpair failed and we were unable to recover it. 00:30:14.644 [2024-11-18 02:12:48.964895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.965011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.965037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.965163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.965287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.965322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.965459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.965546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.965574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.965694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.965822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.965848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.965962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.966046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.966072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.966183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.966321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.966348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.966434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.966518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.966544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.966687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.966806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.966833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.966912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.966992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.967019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.967110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.967255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.967282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.967381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.967492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.967519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.967644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.967782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.967815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.967930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.968043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.968076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.968217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.968296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.968335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.968446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.968558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.968583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.968696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.968784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.968810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.968950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.969066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.969092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.969170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.969281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.969308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.969435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.969528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.969553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.969679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.969792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.969818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.969935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.970074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.970100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.970212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.970331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.970364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.970448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.970557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.970582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.970695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.970801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.970827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.970914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.970996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.971023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.971113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.971225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.971252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.971336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.971479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.971505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.971588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.971673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.971700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.971841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.971920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.971946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.972035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.972175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.972204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.972317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.972406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.972431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.972527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.972666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.972696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.972827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.972953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.972980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.973063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.973189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.973215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.973337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.973460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.973486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.645 qpair failed and we were unable to recover it. 00:30:14.645 [2024-11-18 02:12:48.973569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.973675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.645 [2024-11-18 02:12:48.973701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.973791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.973902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.973927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.974039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.974143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.974169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.974289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.974444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.974471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.974563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.974661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.974687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.974778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.974864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.974891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.975008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.975162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.975189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.975316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.975425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.975451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.975568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.975655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.975680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.975787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.975898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.975923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.976052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.976132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.976158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.976273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.976374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.976401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.976521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.976613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.976640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.976758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.976837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.976863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.976944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.977083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.977109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.977199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.977286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.977324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.977449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.977535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.977561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.977672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.977775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.977807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.977896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.978039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.978065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.978155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.978269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.978295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.978419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.978500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.978526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.978626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.978734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.978760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.978868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.978980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.979006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.979096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.979206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.646 [2024-11-18 02:12:48.979232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.646 qpair failed and we were unable to recover it. 00:30:14.646 [2024-11-18 02:12:48.979345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.979457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.979484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.979601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.979682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.979710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.979828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.979968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.979994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.980110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.980230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.980257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.980345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.980425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.980452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.980567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.980678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.980704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.980847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.980920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.980946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.981033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.981117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.981145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.981257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.981358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.981386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.981467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.981557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.981584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.981694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.981800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.981826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.981950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.982071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.982097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.982174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.982284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.982316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.982408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.982525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.982552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.982667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.982789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.982816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.982909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.983021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.983048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.983160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.983273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.983299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.983389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.983472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.983499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.983610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.983701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.983728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.983816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.983960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.983986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.937 qpair failed and we were unable to recover it. 00:30:14.937 [2024-11-18 02:12:48.984129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.984244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.937 [2024-11-18 02:12:48.984270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.984365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.984446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.984474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.984600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.984714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.984740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.984835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.984945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.984971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.985059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.985144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.985170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.985306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.985433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.985459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.985542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.985631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.985658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.985771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.985843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.985869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.985952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.986057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.986083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.986208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.986322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.986355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.986444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.986556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.986583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.986690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.986795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.986821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.986922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.987002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.987028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.987154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.987266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.987293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.987451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.987557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.987584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.987695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.987812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.987840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.987957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.988045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.988072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.988211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.988290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.988323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.988439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.988556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.988582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.988699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.988785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.988811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.988931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.989016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.989042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.938 [2024-11-18 02:12:48.989129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.989264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.938 [2024-11-18 02:12:48.989290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.938 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.989389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.989504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.989530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.989650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.989765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.989791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.989904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.989988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.990014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.990155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.990305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.990339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.990475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.990565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.990592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.990732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.990850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.990876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.991015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.991133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.991170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.991263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.991383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.991410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.991501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.991617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.991642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.991727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.991824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.991850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.991956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.992063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.992089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.992226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.992325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.992366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.992487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.992632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.992658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.992798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.992881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.992916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.993009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.993129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.993156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.993239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.993348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.993376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.993493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.993609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.993637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.993753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.993840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.993866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.993952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.994049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.994077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.994171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.994283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.994320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.994467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.994582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.994608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.994716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.994808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.994834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.994955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.995052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.995079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.939 qpair failed and we were unable to recover it. 00:30:14.939 [2024-11-18 02:12:48.995161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.939 [2024-11-18 02:12:48.995319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.995348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.995485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.995626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.995653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.995743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.995829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.995860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.995958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.996046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.996073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.996192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.996282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.996309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.996440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.996524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.996551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.996644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.996759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.996787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.996905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.997026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.997057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.997148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.997279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.997307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.997422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.997570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.997596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.997679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.997793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.997820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.997904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.998017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.998042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.998184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.998275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.998303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.998443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.998559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.998586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.998675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.998758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.998785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.998872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.998965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.998991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.999079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.999192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.999218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.999338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.999451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.999478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.999567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.999672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.999704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:48.999790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.999884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:48.999910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:49.000120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:49.000249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:49.000278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:49.000443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:49.000538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:49.000568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:49.000686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:49.000803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:49.000830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:49.000972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:49.001086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:49.001116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.940 qpair failed and we were unable to recover it. 00:30:14.940 [2024-11-18 02:12:49.001233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.940 [2024-11-18 02:12:49.001333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.001360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.001466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.001618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.001647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.001822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.001946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.001976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.002101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.002254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.002283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.002453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.002576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.002620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.002765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.002884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.002913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.003044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.003133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.003162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.003256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.003373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.003400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.003553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.003709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.003739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.003835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.003925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.003954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.004081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.004201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.004230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.004388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.004473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.004500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.004582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.004667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.004710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.004833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.004990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.005019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.005104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.005199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.005231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.005383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.005474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.005500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.005583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.005706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.005735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.005857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.006013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.006043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.006194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.006329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.006367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.006475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.006552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.006596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.006713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.006861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.006890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.007010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.007116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.007143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.007282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.007425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.007451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.007589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.007749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.007779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.007914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.008011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.008045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.008173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.008304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.941 [2024-11-18 02:12:49.008342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.941 qpair failed and we were unable to recover it. 00:30:14.941 [2024-11-18 02:12:49.008444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.008560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.008586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.008728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.008818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.008863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.008999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.009089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.009118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.009272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.009390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.009417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.009507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.009621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.009647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.009759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.009844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.009870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.009997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.010084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.010114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.010215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.010319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.010349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.010458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.010540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.010572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.010707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.010855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.010884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.011007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.011098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.011128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.011259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.011370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.011397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.011515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.011628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.011655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.011767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.011885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.011911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.011993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.012159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.012188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.012323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.012435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.012462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.012554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.012645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.012672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.012789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.012931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.012957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.013047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.013201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.013238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.942 [2024-11-18 02:12:49.013354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.013466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.942 [2024-11-18 02:12:49.013493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.942 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.013602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.013703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.013729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.013829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.013947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.013977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.014106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.014187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.014217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.014392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.014475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.014502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.014594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.014706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.014733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.014845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.014925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.014953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.015093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.015184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.015211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.015356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.015445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.015472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.015583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.015696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.015722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.015804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.015877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.015903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.016020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.016100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.016127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.016266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.016409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.016435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.016556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.016642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.016669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.016784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.016865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.016893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.017006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.017089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.017115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.017201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.017339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.017367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.017510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.017597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.017624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.017742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.017881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.017907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.018029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.018138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.018164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.018259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.018415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.018442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.018583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.018722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.018748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.018860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.018967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.018993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.943 [2024-11-18 02:12:49.019099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.019172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.943 [2024-11-18 02:12:49.019198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.943 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.019277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.019403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.019431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.019543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.019659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.019685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.019834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.019916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.019942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.020054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.020174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.020200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.020288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.020434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.020461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.020603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.020708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.020734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.020831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.020945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.020972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.021064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.021207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.021233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.021322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.021416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.021443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.021555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.021667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.021694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.021811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.021949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.021975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.022060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.022169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.022195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.022318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.022429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.022454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.022534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.022679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.022705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.022783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.022892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.022918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.023006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.023121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.023147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.023297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.023426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.023452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.023594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.023705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.023731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.023819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.023932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.023958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.024079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.024163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.024189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.024271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.024388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.024415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.024524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.024668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.024694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.944 qpair failed and we were unable to recover it. 00:30:14.944 [2024-11-18 02:12:49.024778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.944 [2024-11-18 02:12:49.024858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.024884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.025029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.025144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.025171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.025286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.025412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.025439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.025555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.025693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.025718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.025862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.025971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.025997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.026108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.026198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.026224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.026323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.026440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.026466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.026557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.026635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.026661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.026788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.026873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.026899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.027020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.027103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.027130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.027288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.027427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.027454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.027542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.027627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.027653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.027790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.027903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.027929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.028020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.028104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.028131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.028247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.028396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.028423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.028536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.028632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.028659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.028747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.028891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.028917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.029005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.029095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.029122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.029208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.029287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.029319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.029465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.029607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.029633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.029716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.029827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.029854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.029996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.030075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.030101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.030177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.030337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.030364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.030458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.030573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.945 [2024-11-18 02:12:49.030600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.945 qpair failed and we were unable to recover it. 00:30:14.945 [2024-11-18 02:12:49.030720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.030809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.030836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.030915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.030998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.031024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.031135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.031250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.031276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.031371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.031476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.031502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.031581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.031693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.031719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.031827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.031920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.031945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.032055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.032142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.032169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.032291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.032428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.032455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.032535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.032645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.032671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.032756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.032835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.032862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.033008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.033139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.033170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.033302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.033392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.033420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.033539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.033652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.033678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.033793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.033881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.033907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.033985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.034091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.034117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.034237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.034346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.034373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.034487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.034632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.034658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.034771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.034885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.034911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.035006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.035148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.035175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.035258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.035345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.035373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.035463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.035606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.035632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.035748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.035835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.035861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.946 [2024-11-18 02:12:49.036001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.036110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.946 [2024-11-18 02:12:49.036136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.946 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.036219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.036360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.036387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.036504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.036620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.036648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.036764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.036871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.036897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.036993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.037107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.037133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.037216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.037304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.037336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.037453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.037541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.037567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.037655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.037798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.037824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.037940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.038041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.038068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.038172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.038288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.038321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.038438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.038553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.038579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.038694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.038776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.038802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.038880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.038960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.038987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.039110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.039191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.039217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.039332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.039412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.039439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.039554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.039629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.039655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.039741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.039829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.039857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.039952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.040043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.040071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.040212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.040303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.040335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.040415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.040523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.040549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.040666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.040750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.040777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.040867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.040953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.040980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.947 qpair failed and we were unable to recover it. 00:30:14.947 [2024-11-18 02:12:49.041124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.947 [2024-11-18 02:12:49.041239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.948 [2024-11-18 02:12:49.041265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.948 qpair failed and we were unable to recover it. 00:30:14.948 [2024-11-18 02:12:49.041360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.948 [2024-11-18 02:12:49.041450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.948 [2024-11-18 02:12:49.041476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.948 qpair failed and we were unable to recover it. 00:30:14.948 [2024-11-18 02:12:49.041562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.948 [2024-11-18 02:12:49.041672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.948 [2024-11-18 02:12:49.041698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.948 qpair failed and we were unable to recover it. 00:30:14.948 [2024-11-18 02:12:49.041812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.948 [2024-11-18 02:12:49.041897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.948 [2024-11-18 02:12:49.041923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.948 qpair failed and we were unable to recover it. 00:30:14.948 [2024-11-18 02:12:49.042030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.948 [2024-11-18 02:12:49.042148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.949 [2024-11-18 02:12:49.042174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.949 qpair failed and we were unable to recover it. 00:30:14.949 [2024-11-18 02:12:49.042288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.949 [2024-11-18 02:12:49.042403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.949 [2024-11-18 02:12:49.042429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.949 qpair failed and we were unable to recover it. 00:30:14.949 [2024-11-18 02:12:49.042544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.949 [2024-11-18 02:12:49.042623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.949 [2024-11-18 02:12:49.042649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.950 qpair failed and we were unable to recover it. 00:30:14.950 [2024-11-18 02:12:49.042729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.950 [2024-11-18 02:12:49.042846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.950 [2024-11-18 02:12:49.042873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.950 qpair failed and we were unable to recover it. 00:30:14.950 [2024-11-18 02:12:49.043015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.950 [2024-11-18 02:12:49.043095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.950 [2024-11-18 02:12:49.043122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.951 qpair failed and we were unable to recover it. 00:30:14.951 [2024-11-18 02:12:49.043237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.951 [2024-11-18 02:12:49.043317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.951 [2024-11-18 02:12:49.043344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.951 qpair failed and we were unable to recover it. 00:30:14.951 [2024-11-18 02:12:49.043454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.951 [2024-11-18 02:12:49.043537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.951 [2024-11-18 02:12:49.043562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.951 qpair failed and we were unable to recover it. 00:30:14.951 [2024-11-18 02:12:49.043651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.951 [2024-11-18 02:12:49.043770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.951 [2024-11-18 02:12:49.043796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.951 qpair failed and we were unable to recover it. 00:30:14.951 [2024-11-18 02:12:49.043937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.951 [2024-11-18 02:12:49.044052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.951 [2024-11-18 02:12:49.044078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.951 qpair failed and we were unable to recover it. 00:30:14.951 [2024-11-18 02:12:49.044220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.951 [2024-11-18 02:12:49.044305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.952 [2024-11-18 02:12:49.044339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.952 qpair failed and we were unable to recover it. 00:30:14.952 [2024-11-18 02:12:49.044477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.952 [2024-11-18 02:12:49.044581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.952 [2024-11-18 02:12:49.044607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.952 qpair failed and we were unable to recover it. 00:30:14.952 [2024-11-18 02:12:49.044732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.952 [2024-11-18 02:12:49.044889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.952 [2024-11-18 02:12:49.044914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.952 qpair failed and we were unable to recover it. 00:30:14.952 [2024-11-18 02:12:49.045034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.952 [2024-11-18 02:12:49.045126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.952 [2024-11-18 02:12:49.045157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.952 qpair failed and we were unable to recover it. 00:30:14.952 [2024-11-18 02:12:49.045276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.952 [2024-11-18 02:12:49.045398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.952 [2024-11-18 02:12:49.045426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.952 qpair failed and we were unable to recover it. 00:30:14.952 [2024-11-18 02:12:49.045549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.953 [2024-11-18 02:12:49.045661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.953 [2024-11-18 02:12:49.045687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.953 qpair failed and we were unable to recover it. 00:30:14.953 [2024-11-18 02:12:49.045801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.953 [2024-11-18 02:12:49.045939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.953 [2024-11-18 02:12:49.045965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.953 qpair failed and we were unable to recover it. 00:30:14.953 [2024-11-18 02:12:49.046083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.953 [2024-11-18 02:12:49.046222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.953 [2024-11-18 02:12:49.046248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.953 qpair failed and we were unable to recover it. 00:30:14.953 [2024-11-18 02:12:49.046363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.953 [2024-11-18 02:12:49.046476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.953 [2024-11-18 02:12:49.046502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.953 qpair failed and we were unable to recover it. 00:30:14.953 [2024-11-18 02:12:49.046643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.953 [2024-11-18 02:12:49.046762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.953 [2024-11-18 02:12:49.046788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.953 qpair failed and we were unable to recover it. 00:30:14.953 [2024-11-18 02:12:49.046873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.953 [2024-11-18 02:12:49.046986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.047012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.954 qpair failed and we were unable to recover it. 00:30:14.954 [2024-11-18 02:12:49.047102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.047212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.047238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.954 qpair failed and we were unable to recover it. 00:30:14.954 [2024-11-18 02:12:49.047351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.047493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.047519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.954 qpair failed and we were unable to recover it. 00:30:14.954 [2024-11-18 02:12:49.047597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.047681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.047713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.954 qpair failed and we were unable to recover it. 00:30:14.954 [2024-11-18 02:12:49.047827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.047967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.047993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.954 qpair failed and we were unable to recover it. 00:30:14.954 [2024-11-18 02:12:49.048076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.048214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.048240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.954 qpair failed and we were unable to recover it. 00:30:14.954 [2024-11-18 02:12:49.048323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.048419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.954 [2024-11-18 02:12:49.048445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.955 qpair failed and we were unable to recover it. 00:30:14.955 [2024-11-18 02:12:49.048563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.048678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.048705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.955 qpair failed and we were unable to recover it. 00:30:14.955 [2024-11-18 02:12:49.048824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.048929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.048955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.955 qpair failed and we were unable to recover it. 00:30:14.955 [2024-11-18 02:12:49.049069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.049147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.049175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.955 qpair failed and we were unable to recover it. 00:30:14.955 [2024-11-18 02:12:49.049262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.049360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.049387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.955 qpair failed and we were unable to recover it. 00:30:14.955 [2024-11-18 02:12:49.049503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.049617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.049643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.955 qpair failed and we were unable to recover it. 00:30:14.955 [2024-11-18 02:12:49.049759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.049838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.049865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.955 qpair failed and we were unable to recover it. 00:30:14.955 [2024-11-18 02:12:49.049973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.050078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.050108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.955 qpair failed and we were unable to recover it. 00:30:14.955 [2024-11-18 02:12:49.050251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.050362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.955 [2024-11-18 02:12:49.050388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.956 qpair failed and we were unable to recover it. 00:30:14.956 [2024-11-18 02:12:49.050499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.050582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.050610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.956 qpair failed and we were unable to recover it. 00:30:14.956 [2024-11-18 02:12:49.050754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.050856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.050882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.956 qpair failed and we were unable to recover it. 00:30:14.956 [2024-11-18 02:12:49.051028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.051145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.051171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.956 qpair failed and we were unable to recover it. 00:30:14.956 [2024-11-18 02:12:49.051291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.051386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.051413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.956 qpair failed and we were unable to recover it. 00:30:14.956 [2024-11-18 02:12:49.051526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.051642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.051668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.956 qpair failed and we were unable to recover it. 00:30:14.956 [2024-11-18 02:12:49.051782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.051897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.051924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.956 qpair failed and we were unable to recover it. 00:30:14.956 [2024-11-18 02:12:49.052037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-18 02:12:49.052112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.052138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.957 qpair failed and we were unable to recover it. 00:30:14.957 [2024-11-18 02:12:49.052231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.052341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.052368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.957 qpair failed and we were unable to recover it. 00:30:14.957 [2024-11-18 02:12:49.052445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.052551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.052582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.957 qpair failed and we were unable to recover it. 00:30:14.957 [2024-11-18 02:12:49.052670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.052812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.052839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.957 qpair failed and we were unable to recover it. 00:30:14.957 [2024-11-18 02:12:49.052977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.053120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.053146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.957 qpair failed and we were unable to recover it. 00:30:14.957 [2024-11-18 02:12:49.053237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.053336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.053362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.957 qpair failed and we were unable to recover it. 00:30:14.957 [2024-11-18 02:12:49.053458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.053545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.053571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.957 qpair failed and we were unable to recover it. 00:30:14.957 [2024-11-18 02:12:49.053685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.053826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-18 02:12:49.053852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.958 qpair failed and we were unable to recover it. 00:30:14.958 [2024-11-18 02:12:49.053967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.054108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.054135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.958 qpair failed and we were unable to recover it. 00:30:14.958 [2024-11-18 02:12:49.054248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.054364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.054393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.958 qpair failed and we were unable to recover it. 00:30:14.958 [2024-11-18 02:12:49.054536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.054627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.054654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.958 qpair failed and we were unable to recover it. 00:30:14.958 [2024-11-18 02:12:49.054773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.054911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.054938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.958 qpair failed and we were unable to recover it. 00:30:14.958 [2024-11-18 02:12:49.055048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.055136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.055162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.958 qpair failed and we were unable to recover it. 00:30:14.958 [2024-11-18 02:12:49.055283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.055407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.055440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.958 qpair failed and we were unable to recover it. 00:30:14.958 [2024-11-18 02:12:49.055554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.055696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-18 02:12:49.055723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.959 qpair failed and we were unable to recover it. 00:30:14.959 [2024-11-18 02:12:49.055833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.055946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.055972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.959 qpair failed and we were unable to recover it. 00:30:14.959 [2024-11-18 02:12:49.056082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.056188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.056213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.959 qpair failed and we were unable to recover it. 00:30:14.959 [2024-11-18 02:12:49.056318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.056429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.056455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.959 qpair failed and we were unable to recover it. 00:30:14.959 [2024-11-18 02:12:49.056569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.056648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.056676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.959 qpair failed and we were unable to recover it. 00:30:14.959 [2024-11-18 02:12:49.056761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.056846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.056874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.959 qpair failed and we were unable to recover it. 00:30:14.959 [2024-11-18 02:12:49.056986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.057093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.057123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.959 qpair failed and we were unable to recover it. 00:30:14.959 [2024-11-18 02:12:49.057242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.057358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.057385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.959 qpair failed and we were unable to recover it. 00:30:14.959 [2024-11-18 02:12:49.057496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.057608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.057634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.959 qpair failed and we were unable to recover it. 00:30:14.959 [2024-11-18 02:12:49.057754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.057840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.959 [2024-11-18 02:12:49.057867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.959 qpair failed and we were unable to recover it. 00:30:14.960 [2024-11-18 02:12:49.058009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.058093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.058119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.960 qpair failed and we were unable to recover it. 00:30:14.960 [2024-11-18 02:12:49.058237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.058356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.058384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.960 qpair failed and we were unable to recover it. 00:30:14.960 [2024-11-18 02:12:49.058471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.058580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.058607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.960 qpair failed and we were unable to recover it. 00:30:14.960 [2024-11-18 02:12:49.058692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.058837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.058863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.960 qpair failed and we were unable to recover it. 00:30:14.960 [2024-11-18 02:12:49.058939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.059077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.059103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.960 qpair failed and we were unable to recover it. 00:30:14.960 [2024-11-18 02:12:49.059216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.059331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.059359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.960 qpair failed and we were unable to recover it. 00:30:14.960 [2024-11-18 02:12:49.059433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.059517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.059544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.960 qpair failed and we were unable to recover it. 00:30:14.960 [2024-11-18 02:12:49.059654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.059776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.059802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.960 qpair failed and we were unable to recover it. 00:30:14.960 [2024-11-18 02:12:49.059910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.060030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.960 [2024-11-18 02:12:49.060058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.961 qpair failed and we were unable to recover it. 00:30:14.961 [2024-11-18 02:12:49.060175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.961 [2024-11-18 02:12:49.060256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.961 [2024-11-18 02:12:49.060284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.961 qpair failed and we were unable to recover it. 00:30:14.961 [2024-11-18 02:12:49.060379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.961 [2024-11-18 02:12:49.060525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.961 [2024-11-18 02:12:49.060551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.961 qpair failed and we were unable to recover it. 00:30:14.961 [2024-11-18 02:12:49.060671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.961 [2024-11-18 02:12:49.060786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.961 [2024-11-18 02:12:49.060813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.961 qpair failed and we were unable to recover it. 00:30:14.961 [2024-11-18 02:12:49.060906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.961 [2024-11-18 02:12:49.061016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.961 [2024-11-18 02:12:49.061042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.961 qpair failed and we were unable to recover it. 00:30:14.961 [2024-11-18 02:12:49.061154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.961 [2024-11-18 02:12:49.061240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.962 [2024-11-18 02:12:49.061268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.962 qpair failed and we were unable to recover it. 00:30:14.962 [2024-11-18 02:12:49.061394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.962 [2024-11-18 02:12:49.061536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.962 [2024-11-18 02:12:49.061563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.962 qpair failed and we were unable to recover it. 00:30:14.962 [2024-11-18 02:12:49.061652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.962 [2024-11-18 02:12:49.061759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.962 [2024-11-18 02:12:49.061785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.962 qpair failed and we were unable to recover it. 00:30:14.962 [2024-11-18 02:12:49.061898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.962 [2024-11-18 02:12:49.062017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.962 [2024-11-18 02:12:49.062044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.962 qpair failed and we were unable to recover it. 00:30:14.962 [2024-11-18 02:12:49.062157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.962 [2024-11-18 02:12:49.062242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.962 [2024-11-18 02:12:49.062268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.962 qpair failed and we were unable to recover it. 00:30:14.962 [2024-11-18 02:12:49.062445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.962 [2024-11-18 02:12:49.062588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.962 [2024-11-18 02:12:49.062616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.962 qpair failed and we were unable to recover it. 00:30:14.962 [2024-11-18 02:12:49.062740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.963 [2024-11-18 02:12:49.062861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.963 [2024-11-18 02:12:49.062887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.963 qpair failed and we were unable to recover it. 00:30:14.963 [2024-11-18 02:12:49.063029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.963 [2024-11-18 02:12:49.063114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.963 [2024-11-18 02:12:49.063141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.963 qpair failed and we were unable to recover it. 00:30:14.963 [2024-11-18 02:12:49.063257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.963 [2024-11-18 02:12:49.063371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.963 [2024-11-18 02:12:49.063397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.963 qpair failed and we were unable to recover it. 00:30:14.963 [2024-11-18 02:12:49.063488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.963 [2024-11-18 02:12:49.063582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.963 [2024-11-18 02:12:49.063610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.963 qpair failed and we were unable to recover it. 00:30:14.963 [2024-11-18 02:12:49.063727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.963 [2024-11-18 02:12:49.063841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.963 [2024-11-18 02:12:49.063871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.963 qpair failed and we were unable to recover it. 00:30:14.963 [2024-11-18 02:12:49.063986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.963 [2024-11-18 02:12:49.064070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.963 [2024-11-18 02:12:49.064096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.963 qpair failed and we were unable to recover it. 00:30:14.964 [2024-11-18 02:12:49.064245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.064355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.064383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.964 qpair failed and we were unable to recover it. 00:30:14.964 [2024-11-18 02:12:49.064472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.064617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.064643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.964 qpair failed and we were unable to recover it. 00:30:14.964 [2024-11-18 02:12:49.064755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.064896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.064922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.964 qpair failed and we were unable to recover it. 00:30:14.964 [2024-11-18 02:12:49.065036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.065156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.065182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.964 qpair failed and we were unable to recover it. 00:30:14.964 [2024-11-18 02:12:49.065302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.065393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.065421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.964 qpair failed and we were unable to recover it. 00:30:14.964 [2024-11-18 02:12:49.065533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.065649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.065677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.964 qpair failed and we were unable to recover it. 00:30:14.964 [2024-11-18 02:12:49.065822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.065939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.065965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.964 qpair failed and we were unable to recover it. 00:30:14.964 [2024-11-18 02:12:49.066047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.066156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.964 [2024-11-18 02:12:49.066183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.965 qpair failed and we were unable to recover it. 00:30:14.965 [2024-11-18 02:12:49.066274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.066385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.066413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.965 qpair failed and we were unable to recover it. 00:30:14.965 [2024-11-18 02:12:49.066533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.066677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.066705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.965 qpair failed and we were unable to recover it. 00:30:14.965 [2024-11-18 02:12:49.066790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.066932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.066959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.965 qpair failed and we were unable to recover it. 00:30:14.965 [2024-11-18 02:12:49.067072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.067184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.067212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.965 qpair failed and we were unable to recover it. 00:30:14.965 [2024-11-18 02:12:49.067325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.067456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.067500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.965 qpair failed and we were unable to recover it. 00:30:14.965 [2024-11-18 02:12:49.067616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.067725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.067752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.965 qpair failed and we were unable to recover it. 00:30:14.965 [2024-11-18 02:12:49.067902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.068045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.068071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.965 qpair failed and we were unable to recover it. 00:30:14.965 [2024-11-18 02:12:49.068163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.965 [2024-11-18 02:12:49.068273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.068299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.966 qpair failed and we were unable to recover it. 00:30:14.966 [2024-11-18 02:12:49.068393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.068481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.068512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.966 qpair failed and we were unable to recover it. 00:30:14.966 [2024-11-18 02:12:49.068595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.068712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.068738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.966 qpair failed and we were unable to recover it. 00:30:14.966 [2024-11-18 02:12:49.068814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.068896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.068922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.966 qpair failed and we were unable to recover it. 00:30:14.966 [2024-11-18 02:12:49.069067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.069159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.069186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.966 qpair failed and we were unable to recover it. 00:30:14.966 [2024-11-18 02:12:49.069303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.069405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.069433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.966 qpair failed and we were unable to recover it. 00:30:14.966 [2024-11-18 02:12:49.069517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.069656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.069683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.966 qpair failed and we were unable to recover it. 00:30:14.966 [2024-11-18 02:12:49.069800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.069914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.069942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.966 qpair failed and we were unable to recover it. 00:30:14.966 [2024-11-18 02:12:49.070062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.070176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.966 [2024-11-18 02:12:49.070203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:14.966 qpair failed and we were unable to recover it. 00:30:14.967 [2024-11-18 02:12:49.070329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.967 [2024-11-18 02:12:49.070464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.967 [2024-11-18 02:12:49.070494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.967 qpair failed and we were unable to recover it. 00:30:14.967 [2024-11-18 02:12:49.070578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.967 [2024-11-18 02:12:49.070693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.967 [2024-11-18 02:12:49.070725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.967 qpair failed and we were unable to recover it. 00:30:14.967 [2024-11-18 02:12:49.070825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.967 [2024-11-18 02:12:49.070916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.967 [2024-11-18 02:12:49.070945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.967 qpair failed and we were unable to recover it. 00:30:14.967 [2024-11-18 02:12:49.071105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.967 [2024-11-18 02:12:49.071353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.967 [2024-11-18 02:12:49.071384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.967 qpair failed and we were unable to recover it. 00:30:14.967 [2024-11-18 02:12:49.071538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.967 [2024-11-18 02:12:49.071692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.967 [2024-11-18 02:12:49.071720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.967 qpair failed and we were unable to recover it. 00:30:14.967 [2024-11-18 02:12:49.071846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.967 [2024-11-18 02:12:49.071975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.967 [2024-11-18 02:12:49.072004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.967 qpair failed and we were unable to recover it. 00:30:14.967 [2024-11-18 02:12:49.072123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.072256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.072282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.968 qpair failed and we were unable to recover it. 00:30:14.968 [2024-11-18 02:12:49.072382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.072502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.072527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.968 qpair failed and we were unable to recover it. 00:30:14.968 [2024-11-18 02:12:49.072688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.072824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.072850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.968 qpair failed and we were unable to recover it. 00:30:14.968 [2024-11-18 02:12:49.073064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.073213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.073243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:14.968 qpair failed and we were unable to recover it. 00:30:14.968 [2024-11-18 02:12:49.073396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.073498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.073529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.968 qpair failed and we were unable to recover it. 00:30:14.968 [2024-11-18 02:12:49.073673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.073768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.073796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.968 qpair failed and we were unable to recover it. 00:30:14.968 [2024-11-18 02:12:49.073985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.074106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.074156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.968 qpair failed and we were unable to recover it. 00:30:14.968 [2024-11-18 02:12:49.074254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.968 [2024-11-18 02:12:49.074365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.969 [2024-11-18 02:12:49.074392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.969 qpair failed and we were unable to recover it. 00:30:14.969 [2024-11-18 02:12:49.074533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.969 [2024-11-18 02:12:49.074695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.969 [2024-11-18 02:12:49.074723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.969 qpair failed and we were unable to recover it. 00:30:14.969 [2024-11-18 02:12:49.074872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.969 [2024-11-18 02:12:49.074984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.969 [2024-11-18 02:12:49.075036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.969 qpair failed and we were unable to recover it. 00:30:14.969 [2024-11-18 02:12:49.075173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.969 [2024-11-18 02:12:49.075295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.969 [2024-11-18 02:12:49.075331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.970 qpair failed and we were unable to recover it. 00:30:14.970 [2024-11-18 02:12:49.075442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.970 [2024-11-18 02:12:49.075555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.970 [2024-11-18 02:12:49.075597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.970 qpair failed and we were unable to recover it. 00:30:14.970 [2024-11-18 02:12:49.075784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.970 [2024-11-18 02:12:49.075905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.970 [2024-11-18 02:12:49.075933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.970 qpair failed and we were unable to recover it. 00:30:14.970 [2024-11-18 02:12:49.076055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.970 [2024-11-18 02:12:49.076149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.076191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.076306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.076404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.076429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.076543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.076657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.076685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.076807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.076894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.076923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.077020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.077137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.077179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.077295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.077389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.077414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.077530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.077650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.077676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.077769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.077900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.077942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.078156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.078249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.078278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.078391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.078499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.078524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.078633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.078758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.078786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.078955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.079113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.079146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.079274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.079382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.079407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.079490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.079614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.079642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.079758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.079848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.079877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.079969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.080088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.080117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.080202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.080319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.080346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.080428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.080559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.080588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.080711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.080829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.080857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.080940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.081026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.081054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.081178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.081295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.081329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.081435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.081548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.081591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.081715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.081812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.081840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.081998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.082120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.082148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.082276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.082395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.082422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.082514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.082621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.082663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.082782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.082900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.082928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.083017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.083100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.083128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.083251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.083336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.083379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.083466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.083577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.083602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.083681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.083820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.083848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.083955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.084059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.084087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.971 qpair failed and we were unable to recover it. 00:30:14.971 [2024-11-18 02:12:49.084248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.084389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.971 [2024-11-18 02:12:49.084415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.084494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.084585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.084630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.084719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.084859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.084884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.085005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.085141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.085183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.085263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.085384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.085410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.085527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.085606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.085633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.085757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.085875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.085903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.085988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.086093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.086121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.086241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.086374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.086400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.086509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.086621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.086646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.086747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.086870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.086913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.087050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.087139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.087169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.087275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.087386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.087413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.087551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.087682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.087710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.087796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.087916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.087945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.088161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.088261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.088289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.088419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.088528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.088554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.088669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.088804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.088833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.089047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.089160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.089188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.089283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.089388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.089416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.089510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.089663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.089692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.089799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.089972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.090016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.090119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.090251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.090279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.090406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.090493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.090519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.090625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.090737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.090762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.090868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.090945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.090971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.091101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.091230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.091255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.091394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.091479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.091504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.091611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.091708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.091737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.091866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.091951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.091979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.092114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.092196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.972 [2024-11-18 02:12:49.092227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.972 qpair failed and we were unable to recover it. 00:30:14.972 [2024-11-18 02:12:49.092347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.092476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.092504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.092604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.092758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.092786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.092917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.093002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.093027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.093157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.093270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.093300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.093391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.093486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.093516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.093683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.093823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.093848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.093933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.094034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.094063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.094153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.094318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.094344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.094458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.094546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.094571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.094657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.094795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.094820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.094905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.095019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.095044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.095175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.095267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.095294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.095434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.095537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.095563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.095683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.095790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.095816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.095899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.095973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.095999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.096076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.096185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.096210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.096291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.096383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.096426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.096552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.096670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.096695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.096807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.096921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.096946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.097053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.097179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.097207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.097353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.097495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.097520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.097632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.097753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.097782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.097910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.098000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.098028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.098156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.098237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.098263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.098403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.098482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.098508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.098589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.098708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.098733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.098846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.098931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.098956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.099036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.099176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.099202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.099322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.099417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.099461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.099549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.099671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.099696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.099775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.099903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.099931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.100020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.100109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.100137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.973 qpair failed and we were unable to recover it. 00:30:14.973 [2024-11-18 02:12:49.100265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.973 [2024-11-18 02:12:49.100370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.100396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.974 qpair failed and we were unable to recover it. 00:30:14.974 [2024-11-18 02:12:49.100535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.100644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.100669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.974 qpair failed and we were unable to recover it. 00:30:14.974 [2024-11-18 02:12:49.100798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.100914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.100941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.974 qpair failed and we were unable to recover it. 00:30:14.974 [2024-11-18 02:12:49.101042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.101124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.101150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.974 qpair failed and we were unable to recover it. 00:30:14.974 [2024-11-18 02:12:49.101263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.101357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.101383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.974 qpair failed and we were unable to recover it. 00:30:14.974 [2024-11-18 02:12:49.101463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.101601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.101627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.974 qpair failed and we were unable to recover it. 00:30:14.974 [2024-11-18 02:12:49.101703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.101781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.101806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.974 qpair failed and we were unable to recover it. 00:30:14.974 [2024-11-18 02:12:49.101918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.102062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.102088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.974 qpair failed and we were unable to recover it. 00:30:14.974 [2024-11-18 02:12:49.102201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.102320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.102347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.974 qpair failed and we were unable to recover it. 00:30:14.974 [2024-11-18 02:12:49.102431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.102550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.102576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.974 qpair failed and we were unable to recover it. 00:30:14.974 [2024-11-18 02:12:49.102681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.102785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.102813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.974 qpair failed and we were unable to recover it. 00:30:14.974 [2024-11-18 02:12:49.102938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.103061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.103089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.974 qpair failed and we were unable to recover it. 00:30:14.974 [2024-11-18 02:12:49.103227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.103342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.974 [2024-11-18 02:12:49.103368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.975 qpair failed and we were unable to recover it. 00:30:14.975 [2024-11-18 02:12:49.103476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.103590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.103618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.975 qpair failed and we were unable to recover it. 00:30:14.975 [2024-11-18 02:12:49.103749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.103838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.103879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.975 qpair failed and we were unable to recover it. 00:30:14.975 [2024-11-18 02:12:49.103961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.104075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.104102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.975 qpair failed and we were unable to recover it. 00:30:14.975 [2024-11-18 02:12:49.104207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.104319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.104348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.975 qpair failed and we were unable to recover it. 00:30:14.975 [2024-11-18 02:12:49.104448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.104553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.104580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.975 qpair failed and we were unable to recover it. 00:30:14.975 [2024-11-18 02:12:49.104718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.104799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.104832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.975 qpair failed and we were unable to recover it. 00:30:14.975 [2024-11-18 02:12:49.104985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.105082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.105108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.975 qpair failed and we were unable to recover it. 00:30:14.975 [2024-11-18 02:12:49.105222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.975 [2024-11-18 02:12:49.105343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.976 [2024-11-18 02:12:49.105370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.976 qpair failed and we were unable to recover it. 00:30:14.976 [2024-11-18 02:12:49.105479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.976 [2024-11-18 02:12:49.105585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.976 [2024-11-18 02:12:49.105610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.976 qpair failed and we were unable to recover it. 00:30:14.976 [2024-11-18 02:12:49.105727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.976 [2024-11-18 02:12:49.105822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.976 [2024-11-18 02:12:49.105848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.976 qpair failed and we were unable to recover it. 00:30:14.976 [2024-11-18 02:12:49.105932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.976 [2024-11-18 02:12:49.106038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.976 [2024-11-18 02:12:49.106064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.976 qpair failed and we were unable to recover it. 00:30:14.976 [2024-11-18 02:12:49.106214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.976 [2024-11-18 02:12:49.106339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.976 [2024-11-18 02:12:49.106381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.976 qpair failed and we were unable to recover it. 00:30:14.976 [2024-11-18 02:12:49.106461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.976 [2024-11-18 02:12:49.106543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.977 [2024-11-18 02:12:49.106570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.977 qpair failed and we were unable to recover it. 00:30:14.977 [2024-11-18 02:12:49.106708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.977 [2024-11-18 02:12:49.106799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.977 [2024-11-18 02:12:49.106827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.977 qpair failed and we were unable to recover it. 00:30:14.977 [2024-11-18 02:12:49.106941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.977 [2024-11-18 02:12:49.107056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.977 [2024-11-18 02:12:49.107081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.977 qpair failed and we were unable to recover it. 00:30:14.977 [2024-11-18 02:12:49.107171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.977 [2024-11-18 02:12:49.107262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.977 [2024-11-18 02:12:49.107291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.977 qpair failed and we were unable to recover it. 00:30:14.977 [2024-11-18 02:12:49.107402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.977 [2024-11-18 02:12:49.107522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.977 [2024-11-18 02:12:49.107548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.977 qpair failed and we were unable to recover it. 00:30:14.977 [2024-11-18 02:12:49.107659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.977 [2024-11-18 02:12:49.107740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.977 [2024-11-18 02:12:49.107766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.977 qpair failed and we were unable to recover it. 00:30:14.977 [2024-11-18 02:12:49.107874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.978 [2024-11-18 02:12:49.107993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.978 [2024-11-18 02:12:49.108021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.978 qpair failed and we were unable to recover it. 00:30:14.979 [2024-11-18 02:12:49.108117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.108287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.108320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.979 qpair failed and we were unable to recover it. 00:30:14.979 [2024-11-18 02:12:49.108405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.108545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.108570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.979 qpair failed and we were unable to recover it. 00:30:14.979 [2024-11-18 02:12:49.108711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.108867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.108892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.979 qpair failed and we were unable to recover it. 00:30:14.979 [2024-11-18 02:12:49.108969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.109136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.109165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.979 qpair failed and we were unable to recover it. 00:30:14.979 [2024-11-18 02:12:49.109294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.109397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.109423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.979 qpair failed and we were unable to recover it. 00:30:14.979 [2024-11-18 02:12:49.109513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.109623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.109666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.979 qpair failed and we were unable to recover it. 00:30:14.979 [2024-11-18 02:12:49.109820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.109941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.979 [2024-11-18 02:12:49.109970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.979 qpair failed and we were unable to recover it. 00:30:14.980 [2024-11-18 02:12:49.110082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.980 [2024-11-18 02:12:49.110168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.980 [2024-11-18 02:12:49.110193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.980 qpair failed and we were unable to recover it. 00:30:14.980 [2024-11-18 02:12:49.110305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.980 [2024-11-18 02:12:49.110403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.980 [2024-11-18 02:12:49.110447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.980 qpair failed and we were unable to recover it. 00:30:14.980 [2024-11-18 02:12:49.110567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.980 [2024-11-18 02:12:49.110697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.980 [2024-11-18 02:12:49.110725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.980 qpair failed and we were unable to recover it. 00:30:14.980 [2024-11-18 02:12:49.110825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.980 [2024-11-18 02:12:49.110931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.980 [2024-11-18 02:12:49.110956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.980 qpair failed and we were unable to recover it. 00:30:14.980 [2024-11-18 02:12:49.111033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.980 [2024-11-18 02:12:49.111155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.980 [2024-11-18 02:12:49.111181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.980 qpair failed and we were unable to recover it. 00:30:14.980 [2024-11-18 02:12:49.111265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.981 [2024-11-18 02:12:49.111347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.981 [2024-11-18 02:12:49.111374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.981 qpair failed and we were unable to recover it. 00:30:14.981 [2024-11-18 02:12:49.111515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.981 [2024-11-18 02:12:49.111656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.981 [2024-11-18 02:12:49.111699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.981 qpair failed and we were unable to recover it. 00:30:14.981 [2024-11-18 02:12:49.111848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.981 [2024-11-18 02:12:49.111942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.981 [2024-11-18 02:12:49.111971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.981 qpair failed and we were unable to recover it. 00:30:14.981 [2024-11-18 02:12:49.112064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.981 [2024-11-18 02:12:49.112145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.981 [2024-11-18 02:12:49.112174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.981 qpair failed and we were unable to recover it. 00:30:14.981 [2024-11-18 02:12:49.112279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.981 [2024-11-18 02:12:49.112407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.981 [2024-11-18 02:12:49.112434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.981 qpair failed and we were unable to recover it. 00:30:14.981 [2024-11-18 02:12:49.112582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.981 [2024-11-18 02:12:49.112663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.981 [2024-11-18 02:12:49.112688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.981 qpair failed and we were unable to recover it. 00:30:14.981 [2024-11-18 02:12:49.112796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.112888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.112914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.982 qpair failed and we were unable to recover it. 00:30:14.982 [2024-11-18 02:12:49.113021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.113162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.113187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.982 qpair failed and we were unable to recover it. 00:30:14.982 [2024-11-18 02:12:49.113341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.113475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.113501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.982 qpair failed and we were unable to recover it. 00:30:14.982 [2024-11-18 02:12:49.113619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.113747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.113773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.982 qpair failed and we were unable to recover it. 00:30:14.982 [2024-11-18 02:12:49.113883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.113972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.113997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.982 qpair failed and we were unable to recover it. 00:30:14.982 [2024-11-18 02:12:49.114133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.114218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.114246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.982 qpair failed and we were unable to recover it. 00:30:14.982 [2024-11-18 02:12:49.114377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.114487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.982 [2024-11-18 02:12:49.114513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.982 qpair failed and we were unable to recover it. 00:30:14.983 [2024-11-18 02:12:49.114607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.114712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.114737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.983 qpair failed and we were unable to recover it. 00:30:14.983 [2024-11-18 02:12:49.114848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.114953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.114979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.983 qpair failed and we were unable to recover it. 00:30:14.983 [2024-11-18 02:12:49.115052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.115190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.115217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.983 qpair failed and we were unable to recover it. 00:30:14.983 [2024-11-18 02:12:49.115302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.115392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.115417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.983 qpair failed and we were unable to recover it. 00:30:14.983 [2024-11-18 02:12:49.115501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.115663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.115705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.983 qpair failed and we were unable to recover it. 00:30:14.983 [2024-11-18 02:12:49.115814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.115893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.115936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.983 qpair failed and we were unable to recover it. 00:30:14.983 [2024-11-18 02:12:49.116099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.116211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.983 [2024-11-18 02:12:49.116237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.983 qpair failed and we were unable to recover it. 00:30:14.983 [2024-11-18 02:12:49.116325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.984 [2024-11-18 02:12:49.116431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.984 [2024-11-18 02:12:49.116459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.984 qpair failed and we were unable to recover it. 00:30:14.984 [2024-11-18 02:12:49.116567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.984 [2024-11-18 02:12:49.116678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.984 [2024-11-18 02:12:49.116703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.984 qpair failed and we were unable to recover it. 00:30:14.984 [2024-11-18 02:12:49.116784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.984 [2024-11-18 02:12:49.116897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.984 [2024-11-18 02:12:49.116923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.984 qpair failed and we were unable to recover it. 00:30:14.984 [2024-11-18 02:12:49.117003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.984 [2024-11-18 02:12:49.117131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.984 [2024-11-18 02:12:49.117160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.984 qpair failed and we were unable to recover it. 00:30:14.984 [2024-11-18 02:12:49.117287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.984 [2024-11-18 02:12:49.117448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.984 [2024-11-18 02:12:49.117477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.984 qpair failed and we were unable to recover it. 00:30:14.984 [2024-11-18 02:12:49.117611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.984 [2024-11-18 02:12:49.117725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.117750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.985 qpair failed and we were unable to recover it. 00:30:14.985 [2024-11-18 02:12:49.117926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.118035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.118061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.985 qpair failed and we were unable to recover it. 00:30:14.985 [2024-11-18 02:12:49.118190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.118287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.118322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.985 qpair failed and we were unable to recover it. 00:30:14.985 [2024-11-18 02:12:49.118436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.118552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.118577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.985 qpair failed and we were unable to recover it. 00:30:14.985 [2024-11-18 02:12:49.118690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.118811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.118838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.985 qpair failed and we were unable to recover it. 00:30:14.985 [2024-11-18 02:12:49.119012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.119095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.119123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.985 qpair failed and we were unable to recover it. 00:30:14.985 [2024-11-18 02:12:49.119254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.119336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.985 [2024-11-18 02:12:49.119362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.986 qpair failed and we were unable to recover it. 00:30:14.986 [2024-11-18 02:12:49.119496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.119575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.119601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.986 qpair failed and we were unable to recover it. 00:30:14.986 [2024-11-18 02:12:49.119751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.119861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.119886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.986 qpair failed and we were unable to recover it. 00:30:14.986 [2024-11-18 02:12:49.119997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.120107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.120132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.986 qpair failed and we were unable to recover it. 00:30:14.986 [2024-11-18 02:12:49.120243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.120334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.120382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.986 qpair failed and we were unable to recover it. 00:30:14.986 [2024-11-18 02:12:49.120466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.120601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.120626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.986 qpair failed and we were unable to recover it. 00:30:14.986 [2024-11-18 02:12:49.120736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.120817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.120843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.986 qpair failed and we were unable to recover it. 00:30:14.986 [2024-11-18 02:12:49.120947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.986 [2024-11-18 02:12:49.121023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.987 [2024-11-18 02:12:49.121048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.987 qpair failed and we were unable to recover it. 00:30:14.987 [2024-11-18 02:12:49.121189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.987 [2024-11-18 02:12:49.121287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.987 [2024-11-18 02:12:49.121323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.987 qpair failed and we were unable to recover it. 00:30:14.987 [2024-11-18 02:12:49.121441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.987 [2024-11-18 02:12:49.121553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.987 [2024-11-18 02:12:49.121578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.987 qpair failed and we were unable to recover it. 00:30:14.987 [2024-11-18 02:12:49.121715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.987 [2024-11-18 02:12:49.121840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.987 [2024-11-18 02:12:49.121869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.987 qpair failed and we were unable to recover it. 00:30:14.987 [2024-11-18 02:12:49.121986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.987 [2024-11-18 02:12:49.122107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.987 [2024-11-18 02:12:49.122150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.987 qpair failed and we were unable to recover it. 00:30:14.987 [2024-11-18 02:12:49.122259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.987 [2024-11-18 02:12:49.122374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.987 [2024-11-18 02:12:49.122400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.987 qpair failed and we were unable to recover it. 00:30:14.987 [2024-11-18 02:12:49.122556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.987 [2024-11-18 02:12:49.122640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.988 [2024-11-18 02:12:49.122668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.988 qpair failed and we were unable to recover it. 00:30:14.988 [2024-11-18 02:12:49.122790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.988 [2024-11-18 02:12:49.122877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.988 [2024-11-18 02:12:49.122906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.988 qpair failed and we were unable to recover it. 00:30:14.988 [2024-11-18 02:12:49.123041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.988 [2024-11-18 02:12:49.123125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.988 [2024-11-18 02:12:49.123166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.988 qpair failed and we were unable to recover it. 00:30:14.988 [2024-11-18 02:12:49.123282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.988 [2024-11-18 02:12:49.123422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.988 [2024-11-18 02:12:49.123448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.988 qpair failed and we were unable to recover it. 00:30:14.988 [2024-11-18 02:12:49.123540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.988 [2024-11-18 02:12:49.123677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.988 [2024-11-18 02:12:49.123721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.989 qpair failed and we were unable to recover it. 00:30:14.989 [2024-11-18 02:12:49.123883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.989 [2024-11-18 02:12:49.124025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.989 [2024-11-18 02:12:49.124050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.989 qpair failed and we were unable to recover it. 00:30:14.989 [2024-11-18 02:12:49.124134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.989 [2024-11-18 02:12:49.124268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.989 [2024-11-18 02:12:49.124296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.989 qpair failed and we were unable to recover it. 00:30:14.989 [2024-11-18 02:12:49.124453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.989 [2024-11-18 02:12:49.124563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.989 [2024-11-18 02:12:49.124604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.989 qpair failed and we were unable to recover it. 00:30:14.989 [2024-11-18 02:12:49.124704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.989 [2024-11-18 02:12:49.124792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.989 [2024-11-18 02:12:49.124816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.989 qpair failed and we were unable to recover it. 00:30:14.989 [2024-11-18 02:12:49.124933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.989 [2024-11-18 02:12:49.125044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.990 [2024-11-18 02:12:49.125086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.990 qpair failed and we were unable to recover it. 00:30:14.990 [2024-11-18 02:12:49.125242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.990 [2024-11-18 02:12:49.125379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.990 [2024-11-18 02:12:49.125406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.990 qpair failed and we were unable to recover it. 00:30:14.990 [2024-11-18 02:12:49.125489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.990 [2024-11-18 02:12:49.125567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.990 [2024-11-18 02:12:49.125592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.990 qpair failed and we were unable to recover it. 00:30:14.990 [2024-11-18 02:12:49.125686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.990 [2024-11-18 02:12:49.125799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.990 [2024-11-18 02:12:49.125824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.990 qpair failed and we were unable to recover it. 00:30:14.990 [2024-11-18 02:12:49.125935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.990 [2024-11-18 02:12:49.126022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.990 [2024-11-18 02:12:49.126048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.990 qpair failed and we were unable to recover it. 00:30:14.990 [2024-11-18 02:12:49.126164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.990 [2024-11-18 02:12:49.126246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.990 [2024-11-18 02:12:49.126271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.990 qpair failed and we were unable to recover it. 00:30:14.990 [2024-11-18 02:12:49.126387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.126499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.126525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.991 qpair failed and we were unable to recover it. 00:30:14.991 [2024-11-18 02:12:49.126652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.126743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.126772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.991 qpair failed and we were unable to recover it. 00:30:14.991 [2024-11-18 02:12:49.126910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.127022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.127047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.991 qpair failed and we were unable to recover it. 00:30:14.991 [2024-11-18 02:12:49.127179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.127271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.127299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.991 qpair failed and we were unable to recover it. 00:30:14.991 [2024-11-18 02:12:49.127433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.127570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.127596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.991 qpair failed and we were unable to recover it. 00:30:14.991 [2024-11-18 02:12:49.127738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.127847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.127873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.991 qpair failed and we were unable to recover it. 00:30:14.991 [2024-11-18 02:12:49.127990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.128144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.128172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.991 qpair failed and we were unable to recover it. 00:30:14.991 [2024-11-18 02:12:49.128306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.128399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.128427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.991 qpair failed and we were unable to recover it. 00:30:14.991 [2024-11-18 02:12:49.128561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.128675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.991 [2024-11-18 02:12:49.128701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.991 qpair failed and we were unable to recover it. 00:30:14.991 [2024-11-18 02:12:49.128789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.128869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.128895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.992 qpair failed and we were unable to recover it. 00:30:14.992 [2024-11-18 02:12:49.129011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.129122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.129148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.992 qpair failed and we were unable to recover it. 00:30:14.992 [2024-11-18 02:12:49.129287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.129431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.129457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.992 qpair failed and we were unable to recover it. 00:30:14.992 [2024-11-18 02:12:49.129538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.129650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.129676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.992 qpair failed and we were unable to recover it. 00:30:14.992 [2024-11-18 02:12:49.129764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.129905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.129930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.992 qpair failed and we were unable to recover it. 00:30:14.992 [2024-11-18 02:12:49.130007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.130085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.130110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.992 qpair failed and we were unable to recover it. 00:30:14.992 [2024-11-18 02:12:49.130229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.130341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.130367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.992 qpair failed and we were unable to recover it. 00:30:14.992 [2024-11-18 02:12:49.130493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.130618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.130648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.992 qpair failed and we were unable to recover it. 00:30:14.992 [2024-11-18 02:12:49.130780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.130972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.130997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.992 qpair failed and we were unable to recover it. 00:30:14.992 [2024-11-18 02:12:49.131151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.131302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.131338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.992 qpair failed and we were unable to recover it. 00:30:14.992 [2024-11-18 02:12:49.131535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.131666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.131694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.992 qpair failed and we were unable to recover it. 00:30:14.992 [2024-11-18 02:12:49.131792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.992 [2024-11-18 02:12:49.131907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.993 [2024-11-18 02:12:49.131932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.993 qpair failed and we were unable to recover it. 00:30:14.993 [2024-11-18 02:12:49.132057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.993 [2024-11-18 02:12:49.132150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.993 [2024-11-18 02:12:49.132178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.993 qpair failed and we were unable to recover it. 00:30:14.993 [2024-11-18 02:12:49.132272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.993 [2024-11-18 02:12:49.132379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.993 [2024-11-18 02:12:49.132408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.993 qpair failed and we were unable to recover it. 00:30:14.993 [2024-11-18 02:12:49.132514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.993 [2024-11-18 02:12:49.132621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.993 [2024-11-18 02:12:49.132647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.993 qpair failed and we were unable to recover it. 00:30:14.993 [2024-11-18 02:12:49.132771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.993 [2024-11-18 02:12:49.132897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.993 [2024-11-18 02:12:49.132923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.993 qpair failed and we were unable to recover it. 00:30:14.994 [2024-11-18 02:12:49.133002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.994 [2024-11-18 02:12:49.133163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.994 [2024-11-18 02:12:49.133205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.994 qpair failed and we were unable to recover it. 00:30:14.994 [2024-11-18 02:12:49.133286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.994 [2024-11-18 02:12:49.133421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.994 [2024-11-18 02:12:49.133448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.994 qpair failed and we were unable to recover it. 00:30:14.994 [2024-11-18 02:12:49.133554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.994 [2024-11-18 02:12:49.133632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.994 [2024-11-18 02:12:49.133662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.994 qpair failed and we were unable to recover it. 00:30:14.994 [2024-11-18 02:12:49.133801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.994 [2024-11-18 02:12:49.133996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.994 [2024-11-18 02:12:49.134024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.994 qpair failed and we were unable to recover it. 00:30:14.995 [2024-11-18 02:12:49.134156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.134268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.134294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.995 qpair failed and we were unable to recover it. 00:30:14.995 [2024-11-18 02:12:49.134415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.134529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.134555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.995 qpair failed and we were unable to recover it. 00:30:14.995 [2024-11-18 02:12:49.134682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.134806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.134833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.995 qpair failed and we were unable to recover it. 00:30:14.995 [2024-11-18 02:12:49.134996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.135077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.135102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.995 qpair failed and we were unable to recover it. 00:30:14.995 [2024-11-18 02:12:49.135240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.135402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.135446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.995 qpair failed and we were unable to recover it. 00:30:14.995 [2024-11-18 02:12:49.135565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.135670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.135695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.995 qpair failed and we were unable to recover it. 00:30:14.995 [2024-11-18 02:12:49.135842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.135936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.995 [2024-11-18 02:12:49.135961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.995 qpair failed and we were unable to recover it. 00:30:14.996 [2024-11-18 02:12:49.136074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.136188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.136213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.996 qpair failed and we were unable to recover it. 00:30:14.996 [2024-11-18 02:12:49.136299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.136390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.136416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.996 qpair failed and we were unable to recover it. 00:30:14.996 [2024-11-18 02:12:49.136535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.136619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.136645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.996 qpair failed and we were unable to recover it. 00:30:14.996 [2024-11-18 02:12:49.136763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.136876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.136920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.996 qpair failed and we were unable to recover it. 00:30:14.996 [2024-11-18 02:12:49.137015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.137105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.137132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.996 qpair failed and we were unable to recover it. 00:30:14.996 [2024-11-18 02:12:49.137285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.137453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.137479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.996 qpair failed and we were unable to recover it. 00:30:14.996 [2024-11-18 02:12:49.137609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.137728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.137757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.996 qpair failed and we were unable to recover it. 00:30:14.996 [2024-11-18 02:12:49.137854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.137950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.137996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.996 qpair failed and we were unable to recover it. 00:30:14.996 [2024-11-18 02:12:49.138131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.138247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.996 [2024-11-18 02:12:49.138273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.996 qpair failed and we were unable to recover it. 00:30:14.997 [2024-11-18 02:12:49.138428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.997 [2024-11-18 02:12:49.138511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.997 [2024-11-18 02:12:49.138536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.997 qpair failed and we were unable to recover it. 00:30:14.997 [2024-11-18 02:12:49.138669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.997 [2024-11-18 02:12:49.138789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.997 [2024-11-18 02:12:49.138818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.997 qpair failed and we were unable to recover it. 00:30:14.997 [2024-11-18 02:12:49.138918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.997 [2024-11-18 02:12:49.139029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.997 [2024-11-18 02:12:49.139055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.997 qpair failed and we were unable to recover it. 00:30:14.997 [2024-11-18 02:12:49.139170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.997 [2024-11-18 02:12:49.139275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.997 [2024-11-18 02:12:49.139300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.997 qpair failed and we were unable to recover it. 00:30:14.997 [2024-11-18 02:12:49.139469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.997 [2024-11-18 02:12:49.139664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.997 [2024-11-18 02:12:49.139692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.997 qpair failed and we were unable to recover it. 00:30:14.997 [2024-11-18 02:12:49.139798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.997 [2024-11-18 02:12:49.139936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.997 [2024-11-18 02:12:49.139961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.998 qpair failed and we were unable to recover it. 00:30:14.998 [2024-11-18 02:12:49.140139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.998 [2024-11-18 02:12:49.140226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.998 [2024-11-18 02:12:49.140251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.998 qpair failed and we were unable to recover it. 00:30:14.998 [2024-11-18 02:12:49.140331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.998 [2024-11-18 02:12:49.140467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.998 [2024-11-18 02:12:49.140495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.998 qpair failed and we were unable to recover it. 00:30:14.998 [2024-11-18 02:12:49.140603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.998 [2024-11-18 02:12:49.140715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.998 [2024-11-18 02:12:49.140742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.998 qpair failed and we were unable to recover it. 00:30:14.998 [2024-11-18 02:12:49.140830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.998 [2024-11-18 02:12:49.140944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.998 [2024-11-18 02:12:49.140985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.998 qpair failed and we were unable to recover it. 00:30:14.998 [2024-11-18 02:12:49.141076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.998 [2024-11-18 02:12:49.141159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.998 [2024-11-18 02:12:49.141188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.998 qpair failed and we were unable to recover it. 00:30:14.998 [2024-11-18 02:12:49.141289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.998 [2024-11-18 02:12:49.141429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.998 [2024-11-18 02:12:49.141456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:14.999 qpair failed and we were unable to recover it. 00:30:14.999 [2024-11-18 02:12:49.141589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.141691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.141719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.000 qpair failed and we were unable to recover it. 00:30:15.000 [2024-11-18 02:12:49.141814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.141929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.141955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.000 qpair failed and we were unable to recover it. 00:30:15.000 [2024-11-18 02:12:49.142144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.142259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.142303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.000 qpair failed and we were unable to recover it. 00:30:15.000 [2024-11-18 02:12:49.142432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.142587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.142612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.000 qpair failed and we were unable to recover it. 00:30:15.000 [2024-11-18 02:12:49.142726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.142838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.142863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.000 qpair failed and we were unable to recover it. 00:30:15.000 [2024-11-18 02:12:49.142944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.143028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.143054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.000 qpair failed and we were unable to recover it. 00:30:15.000 [2024-11-18 02:12:49.143195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.143285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.143318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.000 qpair failed and we were unable to recover it. 00:30:15.000 [2024-11-18 02:12:49.143442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.143517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.000 [2024-11-18 02:12:49.143543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.000 qpair failed and we were unable to recover it. 00:30:15.000 [2024-11-18 02:12:49.143646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.001 [2024-11-18 02:12:49.143760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.001 [2024-11-18 02:12:49.143785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.001 qpair failed and we were unable to recover it. 00:30:15.001 [2024-11-18 02:12:49.143919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.001 [2024-11-18 02:12:49.144073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.001 [2024-11-18 02:12:49.144101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.001 qpair failed and we were unable to recover it. 00:30:15.001 [2024-11-18 02:12:49.144246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.001 [2024-11-18 02:12:49.144379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.001 [2024-11-18 02:12:49.144406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.001 qpair failed and we were unable to recover it. 00:30:15.001 [2024-11-18 02:12:49.144526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.001 [2024-11-18 02:12:49.144670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.001 [2024-11-18 02:12:49.144696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.001 qpair failed and we were unable to recover it. 00:30:15.001 [2024-11-18 02:12:49.144785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.001 [2024-11-18 02:12:49.144863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.001 [2024-11-18 02:12:49.144889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.001 qpair failed and we were unable to recover it. 00:30:15.001 [2024-11-18 02:12:49.144993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.001 [2024-11-18 02:12:49.145151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.001 [2024-11-18 02:12:49.145193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.001 qpair failed and we were unable to recover it. 00:30:15.001 [2024-11-18 02:12:49.145304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.145452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.145478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.145596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.145721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.145746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.145886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.145975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.146002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.146113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.146223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.146248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.146395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.146477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.146503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.146616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.146730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.146774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.146969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.147059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.147085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.147200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.147284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.147335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.147437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.147518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.147546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.147704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.147820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.147845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.147999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.148112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.148137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.148270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.148396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.148423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.148536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.148615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.148642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.148727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.148843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.148869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.148950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.149032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.149058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.149203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.149357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.149385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.149530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.149654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.149683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.149787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.149904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.149937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.150070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.150191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.150216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.150362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.150475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.150500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.150656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.150809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.150837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.150999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.151109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.151135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.151326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.151457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.151486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.151581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.151708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.151750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.151860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.151946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.151973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.152092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.152205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.152231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.002 [2024-11-18 02:12:49.152346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.152475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.002 [2024-11-18 02:12:49.152504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.002 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.152615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.152711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.152736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.152932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.153047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.153076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.153227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.153353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.153397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.153586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.153700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.153741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.153828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.154022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.154050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.154144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.154272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.154297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.154405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.154516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.154542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.154664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.154766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.154791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.154929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.155029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.155057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.155193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.155304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.155337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.155469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.155617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.155646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.155778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.155881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.155909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.156017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.156153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.156178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.156305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.156445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.156471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.156554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.156708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.156736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.156877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.156959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.156984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.157064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.157176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.157201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.157282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.157481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.157507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.157647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.157725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.157751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.157866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.157983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.158027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.158164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.158286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.158334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.158466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.158586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.158612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.158724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.158880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.158909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.159028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.159162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.159187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.159325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.159409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.159434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.159549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.159664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.159689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.159834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.159934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.159963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.160068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.160182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.160207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.160325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.160464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.160492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.160595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.160753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.160778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.160890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.161002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.161027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.161179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.161305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.161353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.161470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.161626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.161654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.161814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.161897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.161922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.162028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.162156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.162182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.162294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.162426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.162455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.162584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.162670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.162697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.162814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.162902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.162927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.163031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.163120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.163148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.163253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.163470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.163497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.003 qpair failed and we were unable to recover it. 00:30:15.003 [2024-11-18 02:12:49.163581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.163785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.003 [2024-11-18 02:12:49.163813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.163902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.164100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.164133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.164306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.164454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.164480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.164585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.164777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.164805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.164927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.165059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.165085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.165196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.165306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.165340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.165424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.165557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.165586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.165717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.165829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.165855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.165960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.166074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.166099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.166260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.166385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.166428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.166508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.166593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.166619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.166724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.166811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.166837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.166952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.167069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.167095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.167235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.167346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.167376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.167538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.167628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.167653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.167745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.167871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.167898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.168017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.168140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.004 [2024-11-18 02:12:49.168168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.004 qpair failed and we were unable to recover it. 00:30:15.004 [2024-11-18 02:12:49.168324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.168436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.168462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.005 qpair failed and we were unable to recover it. 00:30:15.005 [2024-11-18 02:12:49.168539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.168617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.168643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.005 qpair failed and we were unable to recover it. 00:30:15.005 [2024-11-18 02:12:49.168761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.168967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.168996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.005 qpair failed and we were unable to recover it. 00:30:15.005 [2024-11-18 02:12:49.169144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.169290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.169340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.005 qpair failed and we were unable to recover it. 00:30:15.005 [2024-11-18 02:12:49.169480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.169606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.169635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.005 qpair failed and we were unable to recover it. 00:30:15.005 [2024-11-18 02:12:49.169778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.169884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.169910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.005 qpair failed and we were unable to recover it. 00:30:15.005 [2024-11-18 02:12:49.170025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.170107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.170132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.005 qpair failed and we were unable to recover it. 00:30:15.005 [2024-11-18 02:12:49.170222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.170336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.005 [2024-11-18 02:12:49.170362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.005 qpair failed and we were unable to recover it. 00:30:15.006 [2024-11-18 02:12:49.170471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.170602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.170631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.006 qpair failed and we were unable to recover it. 00:30:15.006 [2024-11-18 02:12:49.170800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.170933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.170958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.006 qpair failed and we were unable to recover it. 00:30:15.006 [2024-11-18 02:12:49.171103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.171224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.171249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.006 qpair failed and we were unable to recover it. 00:30:15.006 [2024-11-18 02:12:49.171328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.171440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.171465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.006 qpair failed and we were unable to recover it. 00:30:15.006 [2024-11-18 02:12:49.171548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.171662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.171687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.006 qpair failed and we were unable to recover it. 00:30:15.006 [2024-11-18 02:12:49.171774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.171901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.171930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.006 qpair failed and we were unable to recover it. 00:30:15.006 [2024-11-18 02:12:49.172052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.172175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.172218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.006 qpair failed and we were unable to recover it. 00:30:15.006 [2024-11-18 02:12:49.172339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.006 [2024-11-18 02:12:49.172453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.007 [2024-11-18 02:12:49.172478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.007 qpair failed and we were unable to recover it. 00:30:15.007 [2024-11-18 02:12:49.172670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.007 [2024-11-18 02:12:49.172795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.007 [2024-11-18 02:12:49.172824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.007 qpair failed and we were unable to recover it. 00:30:15.007 [2024-11-18 02:12:49.172933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.007 [2024-11-18 02:12:49.173042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.007 [2024-11-18 02:12:49.173068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.007 qpair failed and we were unable to recover it. 00:30:15.007 [2024-11-18 02:12:49.173182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.007 [2024-11-18 02:12:49.173265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.007 [2024-11-18 02:12:49.173291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.007 qpair failed and we were unable to recover it. 00:30:15.007 [2024-11-18 02:12:49.173412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.007 [2024-11-18 02:12:49.173518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.007 [2024-11-18 02:12:49.173544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.007 qpair failed and we were unable to recover it. 00:30:15.007 [2024-11-18 02:12:49.173651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.173753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.173782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.008 qpair failed and we were unable to recover it. 00:30:15.008 [2024-11-18 02:12:49.173887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.173994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.174019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.008 qpair failed and we were unable to recover it. 00:30:15.008 [2024-11-18 02:12:49.174133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.174262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.174290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.008 qpair failed and we were unable to recover it. 00:30:15.008 [2024-11-18 02:12:49.174411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.174494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.174519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.008 qpair failed and we were unable to recover it. 00:30:15.008 [2024-11-18 02:12:49.174631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.174704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.174730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.008 qpair failed and we were unable to recover it. 00:30:15.008 [2024-11-18 02:12:49.174862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.174984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.175026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.008 qpair failed and we were unable to recover it. 00:30:15.008 [2024-11-18 02:12:49.175162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.175289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.175326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.008 qpair failed and we were unable to recover it. 00:30:15.008 [2024-11-18 02:12:49.175466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.175605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.175630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.008 qpair failed and we were unable to recover it. 00:30:15.008 [2024-11-18 02:12:49.175770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.175863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.175888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.008 qpair failed and we were unable to recover it. 00:30:15.008 [2024-11-18 02:12:49.176031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.176120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.176162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.008 qpair failed and we were unable to recover it. 00:30:15.008 [2024-11-18 02:12:49.176282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.176436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.176463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.008 qpair failed and we were unable to recover it. 00:30:15.008 [2024-11-18 02:12:49.176543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.008 [2024-11-18 02:12:49.176654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.176680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.176818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.176940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.176969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.177107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.177211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.177237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.177345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.177426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.177452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.177553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.177636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.177669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.177801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.177937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.177962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.178089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.178183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.178212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.178407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.178490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.178516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.178657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.178745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.178771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.178881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.179067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.179094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.179227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.179361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.179392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.179538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.179619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.179644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.179735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.179840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.179867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.179964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.180057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.180082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.180196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.180277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.180303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.180434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.180548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.180574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.180687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.180830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.180855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.180996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.181086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.181111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.181235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.181360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.181391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.181502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.181616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.181641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.181758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.181961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.181990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.182112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.182236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.182265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.182380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.182466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.182492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.182603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.182682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.182708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.182798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.182913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.182939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.183052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.183160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.183186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.183296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.183393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.183420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.183552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.183746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.183774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.183901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.184022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.184051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.184211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.184327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.184353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.184490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.184618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.184646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.184809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.184901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.184928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.185032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.185148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.185174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.185322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.185457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.185500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.009 qpair failed and we were unable to recover it. 00:30:15.009 [2024-11-18 02:12:49.185618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.009 [2024-11-18 02:12:49.185720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.185749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.185920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.186032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.186058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.186193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.186277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.186305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.186419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.186537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.186565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.186688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.186792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.186816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.186907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.187045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.187070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.187176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.187343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.187373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.187482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.187622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.187647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.187752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.187877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.187905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.188061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.188210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.188239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.188365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.188479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.188505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.188636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.188758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.188787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.188934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.189052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.189094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.189227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.189327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.189370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.189509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.189591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.189634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.189814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.189941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.189969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.190128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.190274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.190299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.190496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.190611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.190635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.190784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.190909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.190937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.191067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.191178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.191204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.191346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.191449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.191477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.191606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.191728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.191757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.191902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.191989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.192015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.192099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.192187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.192213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.192339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.192460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.192488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.192628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.192718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.192746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.192857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.192993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.193021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.193121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.193210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.193239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.193368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.193462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.193488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.193678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.193829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.193871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.194013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.194156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.010 [2024-11-18 02:12:49.194182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.010 qpair failed and we were unable to recover it. 00:30:15.010 [2024-11-18 02:12:49.194327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.194417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.194442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.194533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.194635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.194664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.194787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.194886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.194911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.195050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.195163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.195189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.195275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.195372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.195416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.195532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.195631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.195660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.195754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.195942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.195967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.196101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.196241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.196266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.196355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.196496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.196522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.196605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.196697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.196722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.196836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.197023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.197052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.197251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.197388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.197415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.197524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.197637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.197663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.197771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.197886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.197929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.198049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.198201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.198229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.198363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.198448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.198473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.198632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.198784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.198813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.198931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.199080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.199108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.199243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.199335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.199362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.199451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.199584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.199613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.199819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.199897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.199924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.200040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.200178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.200203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.200337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.200470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.200500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.200594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.200693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.200722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.200824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.200933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.200958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.201079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.201213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.201241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.201358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.201483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.201511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.201642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.201730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.201757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.201864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.201944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.201969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.202080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.202275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.202303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.202521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.202664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.202691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.202803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.202948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.202974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.203089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.203200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.203243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.203381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.203454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.203481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.203567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.203699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.203727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.203854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.203983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.204008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.011 qpair failed and we were unable to recover it. 00:30:15.011 [2024-11-18 02:12:49.204200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.011 [2024-11-18 02:12:49.204304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.204377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.204492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.204572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.204615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.204787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.204902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.204927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.205038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.205149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.205175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.205276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.205412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.205442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.205532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.205645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.205679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.205808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.205919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.205944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.206049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.206127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.206153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.206270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.206387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.206431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.206537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.206608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.206633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.206822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.206942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.206970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.207139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.207251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.207277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.207407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.207487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.207513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.207646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.207793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.207822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.207936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.208055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.208083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.208184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.208287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.208327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.208412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.208507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.208535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.208656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.208777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.208806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.208949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.209037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.209063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.209175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.209364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.209394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.209516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.209607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.209635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.209844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.209952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.209977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.210085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.210175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.210217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.210344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.210438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.210467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.210600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.210707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.210733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.210844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.210953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.210982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.012 qpair failed and we were unable to recover it. 00:30:15.012 [2024-11-18 02:12:49.211139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.211259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.012 [2024-11-18 02:12:49.211288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.211427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.211536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.211562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.211687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.211807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.211836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.211974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.212114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.212139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.212253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.212375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.212402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.212590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.212720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.212748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.212871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.212960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.213003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.213111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.213249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.213292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.213438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.213584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.213610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.213696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.213847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.213872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.213963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.214069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.214094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.214204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.214338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.214368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.214484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.214607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.214636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.214746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.214819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.214845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.214937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.215016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.215041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.215157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.215279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.215305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.215396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.215507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.215532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.215615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.215726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.215752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.215863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.215947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.215972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.216097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.216235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.216260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.216384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.216496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.216525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.216648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.216744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.216772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.216934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.217039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.217064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.217144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.217281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.217307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.217429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.217582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.217622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.217732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.217842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.217868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.013 [2024-11-18 02:12:49.217959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.218061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.013 [2024-11-18 02:12:49.218103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.013 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.218289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.218387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.218413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.218527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.218630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.218657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.218786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.218875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.218903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.219053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.219200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.219226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.219341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.219457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.219482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.219562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.219723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.219751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.219899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.220030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.220056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.220167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.220248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.220275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.220382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.220458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.220484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.220620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.220710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.220738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.220901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.220990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.221016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.221161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.221343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.221370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.221484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.221618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.221646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.221749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.221820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.221849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.221984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.222115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.222158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.222244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.222349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.222376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.222496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.222637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.222662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.222794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.222922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.222947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.223088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.223199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.223227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.223340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.223450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.223476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.223562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.223685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.223710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.223845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.223998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.224026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.224167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.224248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.224273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.224363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.224447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.224473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.224635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.224723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.224751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.224850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.224991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.225016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.225100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.225213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.225239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.225377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.225530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.225559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.225716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.225813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.225838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.225938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.226055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.226083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.226163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.226287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.226325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.014 qpair failed and we were unable to recover it. 00:30:15.014 [2024-11-18 02:12:49.226483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.014 [2024-11-18 02:12:49.226569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.226594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.226719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.226847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.226872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.226963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.227045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.227071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.227185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.227289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.227323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.227412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.227519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.227545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.227655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.227767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.227793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.227884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.227967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.227992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.228106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.228255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.228283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.228447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.228549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.228578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.228745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.228849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.228874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.229014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.229125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.229153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.229237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.229341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.229371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.229482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.229565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.229590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.229686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.229823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.229849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.229985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.230138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.230166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.230287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.230384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.230410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.230502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.230684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.230710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.230821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.230956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.230984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.231115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.231255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.231280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.231432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.231517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.231541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.231695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.231820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.231867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.231989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.232129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.232155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.232263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.232361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.232391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.232486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.232588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.232617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.232728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.232842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.232868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.232955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.233040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.233085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.233180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.233301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.233371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.233488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.233568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.233595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.233747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.233873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.233917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.234026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.234138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.234181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.234287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.234383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.234409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.234571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.234691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.234720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.234845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.234931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.234956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.235065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.235139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.235169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.235328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.235481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.235510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.235605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.235726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.015 [2024-11-18 02:12:49.235755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.015 qpair failed and we were unable to recover it. 00:30:15.015 [2024-11-18 02:12:49.235890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.236009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.236034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.236154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.236238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.236263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.236355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.236473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.236498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.236586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.236699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.236725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.236856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.236983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.237011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.237102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.237279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.237305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.237427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.237536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.237563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.237694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.237852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.237881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.238010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.238114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.238140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.238281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.238399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.238425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.238515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.238597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.238622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.238730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.238814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.238839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.238951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.239031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.239057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.239162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.239274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.239300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.239414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.239498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.239524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.239612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.239696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.239722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.239833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.239921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.239946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.240072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.240207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.240235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.240386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.240477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.240502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.240588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.240707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.240732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.240859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.240958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.240984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.241127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.241271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.241320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.241445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.241583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.241609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.241689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.241797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.241822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.241935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.242058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.242085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.242244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.242372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.242402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.242498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.242621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.242650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.242760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.242837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.242863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.242939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.243080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.243109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.243208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.243324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.243365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.243478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.243567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.243592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.243705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.243790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.243816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.243931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.244104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.244129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.244245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.244333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.244360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.244471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.244576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.016 [2024-11-18 02:12:49.244602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.016 qpair failed and we were unable to recover it. 00:30:15.016 [2024-11-18 02:12:49.244709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.244832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.244857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.244970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.245091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.245116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.245258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.245410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.245440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.245568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.245655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.245683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.245850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.245991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.246016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.246156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.246237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.246263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.246378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.246455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.246481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.246617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.246733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.246758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.246870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.246992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.247020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.247142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.247281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.247307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.247422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.247536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.247563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.247640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.247756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.247797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.247927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.248079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.248108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.248214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.248296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.248335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.248427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.248515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.248540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.248655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.248798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.248841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.248954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.249103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.249128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.249243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.249356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.249383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.249563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.249703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.249728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.249842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.249927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.249952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.250036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.250174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.250199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.250279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.250363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.250389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.250500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.250617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.250642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.250806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.250923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.250968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.251053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.251133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.251159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.251285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.251406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.251432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.251519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.251674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.251702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.251831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.251923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.251951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.252077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.252189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.252215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.252305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.252426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.252453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.252586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.252743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.252769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.252895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.252985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.253010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.253103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.253213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.253238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.253321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.253435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.253460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.253579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.253686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.253711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.253841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.253950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.253979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.254068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.254188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.254216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.254343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.254424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.254450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.254531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.254638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.254664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.254743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.254857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.254883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.254971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.255078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.255104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.255259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.255348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.255377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.255477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.255573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.255603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.255702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.255809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.255835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.255958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.256067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.256092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.256265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.256399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.256428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.256566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.256686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.256711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.256854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.257037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.257063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.257148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.257259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.257285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.257406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.257489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.257515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.257603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.257682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.017 [2024-11-18 02:12:49.257708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.017 qpair failed and we were unable to recover it. 00:30:15.017 [2024-11-18 02:12:49.257796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.257936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.257961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.258046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.258206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.258234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.258335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.258441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.258468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.258564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.258690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.258719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.258844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.258930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.258956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.259057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.259170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.259199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.259321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.259424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.259450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.259527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.259640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.259665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.259780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.259921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.259948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.260076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.260201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.260227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.260368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.260452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.260478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.260584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.260697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.260723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.260864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.260978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.261007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.261117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.261197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.261223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.261320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.261404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.261431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.261544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.261620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.261646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.261754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.261865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.261890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.261974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.262096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.262124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.262220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.262330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.262374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.262461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.262574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.262600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.262762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.262886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.262911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.263050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.263126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.263152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.263241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.263359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.263386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.263465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.263635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.263665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.263805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.263939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.263968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.264096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.264183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.264210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.264324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.264490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.264519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.264648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.264761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.264790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.264900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.265006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.265031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.265141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.265253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.265281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.265376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.265502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.265531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.265670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.265749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.265775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.265865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.266005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.266031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.266138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.266257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.266282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.266431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.266555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.266584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.266691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.266846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.266897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.267041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.267132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.267160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.267283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.267410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.267437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.267558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.267701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.267728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.267810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.267955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.267981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.268067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.268150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.268177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.268295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.268420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.268447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.268541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.268682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.268710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.268795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.268912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.268940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.269028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.269142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.269169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.269283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.269435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.269464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.269594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.269739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.269767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.269879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.270019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.270046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.270131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.270214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.270242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.270360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.270454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.270480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.270623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.270732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.270758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.270864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.270954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.270980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.271058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.271169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.271196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.271343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.271437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.271464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.018 qpair failed and we were unable to recover it. 00:30:15.018 [2024-11-18 02:12:49.271582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.018 [2024-11-18 02:12:49.271700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.271727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.271868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.272009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.272035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.272174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.272265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.272292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.272408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.272566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.272596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.272759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.272874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.272900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.273017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.273132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.273160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.273271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.273400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.273446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.273525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.273612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.273639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.273753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.273872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.273899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.274039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.274156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.274189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.274284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.274367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.274395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.274510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.274633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.274662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.274772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.274858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.274884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.274971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.275084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.275110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.275258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.275370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.275397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.275479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.275570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.275597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.275688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.275803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.275829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.275918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.276030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.276057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.276154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.276266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.276293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.276411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.276524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.276550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.276646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.276760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.276788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.276875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.277015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.277041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.277127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.277210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.277236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.277322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.277442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.277468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.277583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.277696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.277723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.277838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.277924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.277951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.278067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.278158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.278187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.278308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.278432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.278458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.278577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.278661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.278687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.278797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.278911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.278938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.279054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.279141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.279170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.279286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.279442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.279468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.279588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.279688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.279719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.279845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.279935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.279961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.280070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.280160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.280186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.280272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.280419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.280449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.280568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.280655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.280684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.280804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.281008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.281037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.281194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.281308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.281345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.281434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.281516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.281543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.281677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.281842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.281874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.281979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.282092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.282121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.282271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.282416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.282443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.282529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.282617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.282658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.282777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.282902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.282930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.283019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.283130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.283176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.283252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.283362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.283389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.283480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.283565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.283592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.283753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.283865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.283894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.283984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.284132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.284161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.019 [2024-11-18 02:12:49.284284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.284374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.019 [2024-11-18 02:12:49.284400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.019 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.284512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.284598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.284624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.284750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.284867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.284895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.284976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.285067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.285095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.285223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.285358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.285386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.285468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.285574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.285601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.285695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.285818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.285847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.285935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.286083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.286111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.286204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.286353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.286394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.286508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.286615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.286658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.286858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.286952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.286985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.287091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.287205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.287233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.287360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.287447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.287473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.287550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.287633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.287660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.287743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.287872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.287901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.288013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.288123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.288149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.288284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.288419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.288445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.288560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.288671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.288697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.288815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.288903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.288928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.289029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.289147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.289175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.289255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.289399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.289425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.289516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.289632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.289658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.289783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.289908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.289951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.290041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.290127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.290152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.290337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.290442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.290467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.290549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.290670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.290698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.290852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.290944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.290972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.291080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.291183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.291211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.291303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.291464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.291490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.291602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.291720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.291745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.291893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.292008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.292033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.292151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.292276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.292305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.292435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.292554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.292582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.292722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.292835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.292860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.292982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.293115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.293140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.293218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.293327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.293356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.293481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.293593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.293618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.293714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.293828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.293856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.293951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.294072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.294101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.294261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.294402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.294428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.294541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.294670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.294699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.294803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.294958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.294988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.295117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.295253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.295282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.295453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1336754 Killed "${NVMF_APP[@]}" "$@" 00:30:15.020 [2024-11-18 02:12:49.295636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.295687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.295793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.295928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.295965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 02:12:49 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:15.020 [2024-11-18 02:12:49.296150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.296280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 02:12:49 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:15.020 [2024-11-18 02:12:49.296341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.296514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 02:12:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:15.020 [2024-11-18 02:12:49.296649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.296700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.020 02:12:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.296813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 02:12:49 -- common/autotest_common.sh@10 -- # set +x 00:30:15.020 [2024-11-18 02:12:49.296950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.296975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.297090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.297225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.297251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.297345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.297468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.297493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.297612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.297751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.297781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.297891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.297980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.298006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.298125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.298256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.298284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.020 [2024-11-18 02:12:49.298508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.298615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.020 [2024-11-18 02:12:49.298643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.020 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.298759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.298850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.298876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.298996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.299129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.299158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.299329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.299440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.299477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.299601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.299731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.299767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.299909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.300064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.300106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.300261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.300406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 02:12:49 -- nvmf/common.sh@469 -- # nvmfpid=1337455 00:30:15.021 [2024-11-18 02:12:49.300432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 02:12:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:15.021 02:12:49 -- nvmf/common.sh@470 -- # waitforlisten 1337455 00:30:15.021 [2024-11-18 02:12:49.300552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.300663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.300688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 02:12:49 -- common/autotest_common.sh@829 -- # '[' -z 1337455 ']' 00:30:15.021 [2024-11-18 02:12:49.300798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 02:12:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:15.021 [2024-11-18 02:12:49.300942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.300967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 02:12:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:15.021 [2024-11-18 02:12:49.301084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 02:12:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:15.021 [2024-11-18 02:12:49.301220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:15.021 [2024-11-18 02:12:49.301248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 02:12:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:15.021 [2024-11-18 02:12:49.301385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 02:12:49 -- common/autotest_common.sh@10 -- # set +x 00:30:15.021 [2024-11-18 02:12:49.301471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.301498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.301601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.301717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.301742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.301902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.302028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.302056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.302192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.302339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.302365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.302490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.302581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.302613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.302741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.302835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.302878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.303014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.303101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.303126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.303236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.303326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.303352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.303473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.303584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.303610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.303722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.303801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.303825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.303898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.303983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.304008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.304126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.304202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.304227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.304338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.304418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.304444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.304527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.304602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.304627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.304734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.304843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.304868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.304950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.305064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.305096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.305207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.305332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.305361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.305469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.305615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.305641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.305729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.305844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.305868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.305978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.306062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.306103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.306275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.306370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.306397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.306480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.306593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.306619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.306697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.306785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.306810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.306922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.307034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.307059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.307139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.307245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.307270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.307348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.307472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.307501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.307596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.307683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.307709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.307823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.307936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.021 [2024-11-18 02:12:49.307961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-11-18 02:12:49.308041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.308131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.308156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.308246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.308355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.308382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.308471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.308585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.308611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.308745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.308842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.308870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.309006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.309117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.309142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.309251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.309424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.309450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.309534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.309621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.309663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.309762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.309860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.309904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.310000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.310079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.310104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.310216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.310334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.310360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.310446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.310525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.310550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.310655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.310743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.310769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.310930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.311048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.311076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.310 qpair failed and we were unable to recover it. 00:30:15.310 [2024-11-18 02:12:49.311191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.310 [2024-11-18 02:12:49.311320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.311349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.311476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.311563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.311588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.311715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.311838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.311864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.311952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.312087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.312114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.312217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.312329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.312354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.312501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.312615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.312640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.312718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.312847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.312877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.313021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.313105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.313132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.313220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.313315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.313342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.313436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.313548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.313574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.313660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.313766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.313792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.313883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.313967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.313993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.314089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.314212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.314241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.314386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.314468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.314496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.314691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.314803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.314830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.314947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.315042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.315087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.315219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.315302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.315356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.315444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.315538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.315564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.315693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.315780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.315807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.315937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.316052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.316077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.316217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.316297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.316333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.316451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.316537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.316564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.316677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.316793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.316819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.316902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.317004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.317030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.317144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.317237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.317264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.317410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.317532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.317558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.311 [2024-11-18 02:12:49.317671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.317767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.311 [2024-11-18 02:12:49.317796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.311 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.317904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.317989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.318014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.318131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.318258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.318284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.318378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.318485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.318510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.318594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.318702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.318728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.318814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.318891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.318917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.319052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.319158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.319183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.319308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.319469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.319494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.319579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.319668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.319694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.319805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.319884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.319914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.320002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.320095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.320121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.320292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.320409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.320435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.320523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.320663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.320688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.320771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.320883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.320908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.321017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.321100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.321125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.321238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.321345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.321371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.321487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.321577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.321603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.321716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.321828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.321855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.321968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.322055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.322081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.322223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.322318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.322353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.322440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.322551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.322576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.322684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.322770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.322795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.322868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.323005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.323030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.323146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.323236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.323262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.323358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.323472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.323499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.323645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.323754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.323779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.312 qpair failed and we were unable to recover it. 00:30:15.312 [2024-11-18 02:12:49.323887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.323974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.312 [2024-11-18 02:12:49.324000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.324111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.324215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.324241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.324332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.324418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.324444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.324531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.324616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.324642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.324730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.324820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.324845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.324955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.325081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.325106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.325229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.325318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.325344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.325422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.325503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.325528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.325632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.325760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.325789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.325877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.325964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.325990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.326079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.326167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.326193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.326306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.326429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.326455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.326563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.326642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.326667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.326756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.326849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.326875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.327008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.327148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.327173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.327254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.327369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.327396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.327481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.327590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.327617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.327733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.327844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.327871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.327961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.328074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.328100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.328208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.328324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.328351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.328459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.328575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.328600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.328712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.328824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.328849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.328958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.329076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.329102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.329196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.329288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.329330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.329482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.329620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.329645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.329732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.329847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.329872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.329987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.330070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.330096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.330211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.330326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.330355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.313 qpair failed and we were unable to recover it. 00:30:15.313 [2024-11-18 02:12:49.330435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.330549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.313 [2024-11-18 02:12:49.330575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.330660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.330741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.330767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.330843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.330927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.330952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.331055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.331161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.331188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.331276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.331372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.331399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.331529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.331638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.331664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.331753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.331853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.331879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.331996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.332081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.332106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.332217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.332329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.332356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.332442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.332563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.332589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.332707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.332848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.332873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.332986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.333097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.333124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.333236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.333343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.333370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.333458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.333572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.333597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.333679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.333786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.333811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.333897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.333979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.334005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.334120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.334222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.334248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.334360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.334474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.334499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.334585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.334670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.334695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.334806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.334889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.334915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.335018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.335131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.335157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.335243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.335354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.335380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.335463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.335550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.335576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.335690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.335776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.335802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.335887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.335969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.335994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.336083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.336189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.336215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.336330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.336413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.336442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.336526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.336608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.336632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.314 [2024-11-18 02:12:49.336746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.336837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.314 [2024-11-18 02:12:49.336862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.314 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.336943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.337058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.337083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.337193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.337283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.337308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.337444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.337525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.337550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.337648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.337759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.337785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.337874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.337958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.337983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.338073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.338182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.338207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.338319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.338431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.338458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.338535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.338615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.338645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.338736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.338811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.338837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.338929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.339008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.339034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.339119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.339204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.339230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.339324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.339433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.339458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.339570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.339676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.339701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.339793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.339931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.339957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.340039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.340165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.340190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.340301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.340389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.340416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.340525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.340643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.340669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.340745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.340828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.340854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.341000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.341119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.341144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.341228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.341345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.341371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.341514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.341627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.341653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.315 qpair failed and we were unable to recover it. 00:30:15.315 [2024-11-18 02:12:49.341737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.341822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.315 [2024-11-18 02:12:49.341847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.341923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.342037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.342062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.342171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.342256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.342281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.342402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.342512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.342537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.342651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.342736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.342761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.342875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.343011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.343037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.343145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.343225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.343252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.343354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.343469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.343495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.343611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.343720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.343745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.343860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.343969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.343994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.344086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.344232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.344257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.344398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.344506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.344494] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:15.316 [2024-11-18 02:12:49.344532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.344554] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:15.316 [2024-11-18 02:12:49.344612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.344722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.344746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.344860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.344961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.344985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.345067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.345144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.345172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.345283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.345402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.345428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.345511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.345627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.345653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.345742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.345854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.345880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.345971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.346049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.346074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.346166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.346277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.346303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.346426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.346537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.346561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.346644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.346749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.346773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.346854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.346941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.346965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.347082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.347197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.347223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.347337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.347423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.347449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.347530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.347614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.347639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.347781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.347888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.316 [2024-11-18 02:12:49.347917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.316 qpair failed and we were unable to recover it. 00:30:15.316 [2024-11-18 02:12:49.348001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.348082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.348109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.348196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.348281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.348307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.348426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.348538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.348563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.348685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.348765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.348790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.348874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.348980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.349005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.349097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.349209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.349234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.349358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.349438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.349464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.349577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.349717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.349742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.349881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.349962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.349988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.350075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.350191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.350217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.350303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.350416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.350442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.350583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.350690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.350716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.350830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.350962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.350987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.351098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.351207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.351232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.351337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.351411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.351435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.351515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.351635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.351660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.351743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.351859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.351884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.351969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.352077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.352102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.352212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.352323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.352349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.352432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.352547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.352572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.352680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.352795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.352820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.352931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.353034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.353059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.353159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.353267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.353293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.353405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.353514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.353540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.353620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.353758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.353782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.353867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.353953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.353980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.354065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.354208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.354234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.354335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.354422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.354448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.317 qpair failed and we were unable to recover it. 00:30:15.317 [2024-11-18 02:12:49.354533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.354644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.317 [2024-11-18 02:12:49.354668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.354795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.354905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.354930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.355017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.355100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.355126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.355242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.355356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.355382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.355466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.355584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.355609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.355719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.355805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.355829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.355918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.356028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.356053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.356178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.356266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.356291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.356413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.356522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.356547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.356655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.356751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.356777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.356861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.356998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.357022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.357159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.357245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.357270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.357421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.357537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.357562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.357677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.357789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.357814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.357900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.357990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.358014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.358153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.358268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.358292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.358374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.358463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.358487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.358596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.358733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.358758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.358866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.358957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.358983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.359095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.359201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.359226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.359344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.359420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.359445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.359556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.359680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.359706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.359815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.359924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.359954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.360070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.360174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.360199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.360277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.360400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.360424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.360514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.360600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.360624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.360708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.360816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.360841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.360952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.361065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.361090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.318 [2024-11-18 02:12:49.361200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.361330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.318 [2024-11-18 02:12:49.361361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.318 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.361451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.361526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.361550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.361661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.361747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.361772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.361852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.362005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.362028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.362113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.362228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.362259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.362395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.362485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.362510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.362624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.362703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.362728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.362811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.362896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.362920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.362999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.363101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.363126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.363210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.363297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.363330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.363443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.363527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.363551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.363661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.363775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.363800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.363913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.363997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.364022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.364110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.364224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.364249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.364385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.364530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.364555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.364670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.364785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.364809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.364919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.365006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.365031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.365142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.365231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.365256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.365393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.365508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.365532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.365612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.365700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.365725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.365838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.365948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.365972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.366110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.366195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.366220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.366305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.366397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.366421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.366537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.366623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.366647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.366734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.366849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.366873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.366968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.367078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.367103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.367191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.367305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.367334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.319 [2024-11-18 02:12:49.367417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.367529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.319 [2024-11-18 02:12:49.367554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.319 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.367667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.367748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.367772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.367882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.367962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.367986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.368098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.368182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.368207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.368345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.368452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.368477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.368564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.368674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.368699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.368808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.368913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.368937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.369022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.369158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.369182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.369264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.369368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.369394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.369506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.369642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.369667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.369780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.369917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.369941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.370030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.370140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.370164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.370246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.370359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.370385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.370502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.370615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.370639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.370751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.370861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.370885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.370973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.371053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.371077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.371215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.371357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.371382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.371469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.371580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.371605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.371717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.371842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.371867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.371949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.372062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.372088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.372182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.372292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.372323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.372435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.372519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.372543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.372676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.372783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.372808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.372925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.373060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.320 [2024-11-18 02:12:49.373086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.320 qpair failed and we were unable to recover it. 00:30:15.320 [2024-11-18 02:12:49.373172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.373257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.373281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.373409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.373495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.373519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.373625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.373735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.373759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.373847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.373928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.373952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.374046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.374131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.374165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.374309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.374398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.374423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.374507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.374645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.374670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.374751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.374839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.374863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.374948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.375028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.375053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.375168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.375280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.375305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.375401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.375514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.375539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.375653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.375730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.375756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.375859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.375994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.376020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.376131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.376217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.376241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.376333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.376446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.376472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.376594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.376676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.376702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.376815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.376925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.376950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.377041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.377150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.377174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.377278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.377414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.377440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.377559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.377669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.377694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.377779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.377892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.377916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.378028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.378113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.378137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.378243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.378352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.378377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.378494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.378603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.378628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.378738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.378815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.378841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.378963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.379076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.379102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.379182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.379264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.379288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.379377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.379482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.379507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.321 qpair failed and we were unable to recover it. 00:30:15.321 [2024-11-18 02:12:49.379617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.321 [2024-11-18 02:12:49.379723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.379747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.379861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.379946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.379972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.380109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.380193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.380218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.380329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.380466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.380501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.380586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.380705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.380731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.380820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.380901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.380928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.381042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.381126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.381153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.381247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.381358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.381385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.381464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.381578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.381604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.381718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.381833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.381859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.381942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.382031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.382056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.382164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.382283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.382308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.382425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.382514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.382541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.382656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.382740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.382767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.382848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.382958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.382984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.383102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.383220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.383246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.383328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.383413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.383439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.383550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.383668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.383695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.383779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 EAL: No free 2048 kB hugepages reported on node 1 00:30:15.322 [2024-11-18 02:12:49.383868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.383895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.383984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.384097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.384123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.384204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.384328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.384355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.384475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.384588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.384614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.384731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.384816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.384842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.384957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.385039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.385066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.385182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.385270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.385295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.385390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.385505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.385531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.385673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.385760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.385787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.385877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.385957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.385983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.322 qpair failed and we were unable to recover it. 00:30:15.322 [2024-11-18 02:12:49.386073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.322 [2024-11-18 02:12:49.386166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.386192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.386279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.386396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.386423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.386513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.386624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.386650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.386736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.386822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.386848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.386967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.387082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.387108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.387250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.387336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.387364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.387454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.387598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.387624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.387740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.387855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.387882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.387968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.388104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.388130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.388244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.388342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.388370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.388462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.388576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.388602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.388714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.388823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.388849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.388966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.389048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.389074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.389157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.389299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.389331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.389426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.389569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.389595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.389739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.389847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.389873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.389985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.390101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.390127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.390244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.390323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.390350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.390438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.390553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.390580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.390691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.390813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.390839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.390930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.391020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.391046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.391158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.391241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.391268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.391363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.391474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.391501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.391612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.391726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.391753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.391870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.391946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.391972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.392082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.392219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.392246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.392335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.392446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.392472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.392557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.392664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.392691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.323 qpair failed and we were unable to recover it. 00:30:15.323 [2024-11-18 02:12:49.392801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.323 [2024-11-18 02:12:49.392876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.392902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.392986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.393105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.393132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.393221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.393336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.393362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.393479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.393561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.393587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.393665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.393780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.393806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.393886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.393992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.394018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.394131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.394244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.394270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.394373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.394516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.394543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.394661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.394747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.394773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.394893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.395008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.395034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.395153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.395270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.395296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.395447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.395569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.395596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.395705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.395815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.395841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.395926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.396009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.396035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.396117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.396204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.396230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.396324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.396436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.396463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.396575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.396664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.396689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.396801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.396884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.396910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.397030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.397144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.397170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.397257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.397355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.397382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.397497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.397611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.397638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.397748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.397886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.397917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.398002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.398091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.398121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.398235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.398351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.398378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.324 qpair failed and we were unable to recover it. 00:30:15.324 [2024-11-18 02:12:49.398460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.324 [2024-11-18 02:12:49.398601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.398627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.398715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.398794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.398821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.398932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.399019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.399045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.399126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.399219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.399246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.399368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.399458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.399485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.399566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.399705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.399730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.399845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.399952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.399979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.400089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.400177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.400207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.400303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.400418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.400444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.400523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.400638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.400664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.400806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.400893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.400919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.401030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.401126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.401152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.401235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.401353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.401380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.401493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.401576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.401602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.401715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.401822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.401848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.401988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.402101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.402127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.402206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.402320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.402347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.402431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.402512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.402543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.402651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.402766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.402792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.402936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.403051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.403077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.403184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.403333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.403360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.403476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.403588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.403614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.403751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.403864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.403890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.404002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.404082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.404109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.404223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.404375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.404401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.404513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.404599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.404625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.325 [2024-11-18 02:12:49.404711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.404787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.325 [2024-11-18 02:12:49.404812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.325 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.404922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.405040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.405071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.405156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.405264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.405290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.405417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.405494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.405520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.405632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.405710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.405737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.405877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.405966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.405992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.406109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.406198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.406224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.406324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.406440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.406466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.406590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.406702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.406729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.406823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.406935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.406961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.407070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.407176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.407202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.407282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.407400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.407427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.407523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.407608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.407633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.407772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.407861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.407888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.407969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.408075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.408101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.408176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.408263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.408289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.408453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.408560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.408590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.408748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.408834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.408861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.409003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.409118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.409144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.409343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.409457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.409484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.409599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.409716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.409741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.409849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.409926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.409952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.410045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.410131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.410158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.410271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.410394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.410421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.410508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.410597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.410623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.410715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.410795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.410821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.326 qpair failed and we were unable to recover it. 00:30:15.326 [2024-11-18 02:12:49.410901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.326 [2024-11-18 02:12:49.410980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.411006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.411123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.411226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.411253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.411366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.411477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.411504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.411614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.411718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.411745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.411884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.411969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.411996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.412116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.412200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.412227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.412322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.412438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.412464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.412577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.412690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.412717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.412803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.412879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.412904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.413017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.413095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.413121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.413199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.413292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.413330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.413415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.413532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.413559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.413674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.413790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.413816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.413901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.414011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.414038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.414117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.414193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.414219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.414308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.414440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.414466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.414555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.414635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.414661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.414749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.414889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.414915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.415025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.415115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.415142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.415222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.415330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.415357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.415443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.415565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.415590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.415669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.415753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.415779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.415883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.415960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.415986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.416062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.416203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.416229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.416314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.416408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.416434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.416571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.416681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.416708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.416799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.416905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.416932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.417071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.417179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.417205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.327 qpair failed and we were unable to recover it. 00:30:15.327 [2024-11-18 02:12:49.417314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.327 [2024-11-18 02:12:49.417393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.417419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.417564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.417670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.417696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.417779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.417880] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:15.328 [2024-11-18 02:12:49.417893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.417919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.418003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.418112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.418138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.418229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.418336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.418363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.418477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.418590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.418616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.418733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.418850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.418876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.418964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.419075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.419101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.419221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.419334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.419362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.419475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.419614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.419640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.419732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.419843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.419869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.419975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.420087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.420113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.420204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.420284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.420316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.420435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.420511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.420537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.420648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.420758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.420784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.420860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.420996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.421021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.421129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.421241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.421267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.421356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.421467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.421493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.421583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.421693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.421718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.421802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.421908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.421935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.422074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.422214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.422241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.422371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.422484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.422511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.422651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.422726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.422752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.422866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.422961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.422987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.423078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.423163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.423189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.423287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.423378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.423405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.423491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.423580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.423607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.423719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.423799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.423826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.328 qpair failed and we were unable to recover it. 00:30:15.328 [2024-11-18 02:12:49.423914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.328 [2024-11-18 02:12:49.424059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.424086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.424205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.424291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.424326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.424445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.424531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.424557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.424644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.424725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.424753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.424895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.425011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.425037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.425116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.425233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.425259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.425367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.425461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.425488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.425575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.425669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.425695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.425811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.425900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.425926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.426024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.426101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.426127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.426279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.426400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.426427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.426520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.426609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.426639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.426788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.426899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.426925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.427012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.427132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.427158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.427271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.427365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.427391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.427515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.427599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.427626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.427741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.427826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.427855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.427940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.428022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.428049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.428128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.428206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.428232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.428315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.428460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.428487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.428641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.428756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.428782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.428870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.428954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.428981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.429092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.429210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.429236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.329 qpair failed and we were unable to recover it. 00:30:15.329 [2024-11-18 02:12:49.429352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.329 [2024-11-18 02:12:49.429433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.429460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.429601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.429720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.429747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.429863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.429949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.429977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.430094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.430185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.430212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.430355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.430441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.430468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.430555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.430676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.430702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.430793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.430874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.430900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.431022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.431116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.431142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.431224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.431316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.431342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.431430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.431521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.431546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.431660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.431742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.431768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.431908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.432022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.432048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.432189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.432273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.432299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.432393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.432508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.432534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.432650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.432739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.432766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.432873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.432957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.432982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.433093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.433209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.433235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.433358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.433467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.433496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.433615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.433692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.433717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.433799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.433919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.433945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.434084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.434200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.434225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.434306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.434395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.434420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.434499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.434611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.434635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.434749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.434857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.434882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.435024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.435129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.435154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.435231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.435317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.435361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.435474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.435585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.435610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.435696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.435810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.435836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.330 [2024-11-18 02:12:49.435940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.436056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.330 [2024-11-18 02:12:49.436082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.330 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.436169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.436282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.436308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.436406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.436490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.436514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.436631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.436710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.436734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.436842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.436929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.436953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.437038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.437151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.437176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.437268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.437389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.437415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.437500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.437581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.437606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.437691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.437803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.437829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.437967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.438045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.438076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.438196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.438305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.438337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.438422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.438535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.438562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.438678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.438796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.438822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.438911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.439020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.439045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.439133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.439222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.439247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.439366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.439448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.439473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.439554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.439641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.439666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.439781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.439895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.439920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.440028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.440165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.440190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.440277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.440389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.440416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.440499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.440581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.440606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.440715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.440849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.440874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.440956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.441067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.441093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.441167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.441275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.441300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.441390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.441502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.441527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.441611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.441716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.441742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.441856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.441942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.441968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.442047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.442154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.442180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.442289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.442410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.331 [2024-11-18 02:12:49.442436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.331 qpair failed and we were unable to recover it. 00:30:15.331 [2024-11-18 02:12:49.442519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.442659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.442685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.442827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.442910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.442936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.443052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.443167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.443192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.443272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.443409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.443435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.443547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.443656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.443681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.443802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.443921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.443947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.444054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.444167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.444193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.444278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.444399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.444426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.444535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.444648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.444673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.444758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.444864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.444889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.445002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.445083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.445109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.445239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.445382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.445412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.445500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.445639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.445665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.445779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.445918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.445944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.446047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.446158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.446184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.446290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.446392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.446420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.446534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.446643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.446668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.446805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.446893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.446918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.447054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.447145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.447171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.447284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.447372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.447399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.447513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.447592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.447618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.447706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.447801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.447827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.447949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.448057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.448083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.448166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.448283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.448309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.448406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.448492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.448519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.448635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.448717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.448743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.448862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.448945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.448970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.449054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.449195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.332 [2024-11-18 02:12:49.449221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.332 qpair failed and we were unable to recover it. 00:30:15.332 [2024-11-18 02:12:49.449303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.449414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.449441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.449580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.449663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.449688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.449767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.449907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.449933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.450018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.450163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.450189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.450274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.450373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.450400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.450478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.450569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.450594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.450731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.450848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.450874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.450989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.451074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.451100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.451211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.451305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.451338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.451418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.451495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.451520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.451606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.451710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.451736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.451845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.451936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.451962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.452077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.452155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.452180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.452286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.452401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.452431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.452517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.452600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.452625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.452706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.452789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.452815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.452925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.453034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.453060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.453169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.453254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.453280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.453398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.453476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.453501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.453584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.453694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.453719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.453801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.453885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.453910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.454017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.454129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.454155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.454238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.454348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.454375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.454485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.454574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.454601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.454701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.454792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.454817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.454929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.455008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.455032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.455153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.455241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.455266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.455377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.455492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.455517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.333 qpair failed and we were unable to recover it. 00:30:15.333 [2024-11-18 02:12:49.455625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.333 [2024-11-18 02:12:49.455765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.455791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.455875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.455989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.456015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.456121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.456204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.456230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.456384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.456509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.456539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.456686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.456800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.456827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.456933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.457046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.457071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.457154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.457282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.457308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.457467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.457580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.457606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.457721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.457846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.457872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.457986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.458102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.458127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.458267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.458349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.458375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.458463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.458588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.458616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.458753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.458861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.458886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.458967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.459053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.459080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.459196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.459302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.459337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.459451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.459540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.459566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.459652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.459765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.459792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.459907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.460023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.460049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.460130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.460270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.460297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.460416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.460505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.460533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.460644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.460727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.460754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.460866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.460969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.460996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.461112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.461218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.461245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.461354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.461468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.461495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.461581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.461667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.334 [2024-11-18 02:12:49.461694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.334 qpair failed and we were unable to recover it. 00:30:15.334 [2024-11-18 02:12:49.461810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.461892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.461917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.462034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.462117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.462142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.462251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.462330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.462356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.462463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.462581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.462606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.462682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.462787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.462812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.462903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.463019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.463045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.463163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.463246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.463272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.463367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.463471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.463497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.463582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.463722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.463747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.463826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.463918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.463942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.464016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.464104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.464128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.464246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.464333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.464359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.464504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.464616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.464641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.464726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.464833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.464859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.464947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.465032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.465058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.465198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.465286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.465318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.465436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.465517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.465544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.465631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.465773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.465799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.465882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.465960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.465986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.466103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.466192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.466219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.466334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.466475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.466501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.466586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.466671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.466697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.466814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.466950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.466977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.467092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.467233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.467258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.467371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.467483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.467508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.467599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.467705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.467730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.335 [2024-11-18 02:12:49.467868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.467989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.335 [2024-11-18 02:12:49.468015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.335 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.468096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.468192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.468219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.468329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.468419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.468445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.468553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.468634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.468660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.468747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.468864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.468889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.469008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.469122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.469148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.469243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.469334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.469362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.469482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.469568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.469593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.469711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.469790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.469814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.469922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.470065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.470091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.470177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.470264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.470289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.470385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.470494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.470520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.470631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.470742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.470768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.470849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.470937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.470962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.471050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.471168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.471194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.471276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.471391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.471422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.471506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.471617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.471642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.471732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.471848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.471873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.471962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.472052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.472078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.472190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.472330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.472356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.472470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.472584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.472610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.472729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.472845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.472870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.472951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.473077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.473104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.473241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.473360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.473387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.473470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.473554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.473580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.473672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.473749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.473775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.473890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.473997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.474023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.474109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.474222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.474247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.336 qpair failed and we were unable to recover it. 00:30:15.336 [2024-11-18 02:12:49.474321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.336 [2024-11-18 02:12:49.474412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.474438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.474557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.474663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.474688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.474798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.474912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.474937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.475021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.475099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.475124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.475237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.475357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.475386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.475465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.475571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.475597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.475687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.475796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.475822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.475903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.476021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.476046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.476126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.476204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.476230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.476346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.476488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.476513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.476611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.476724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.476749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.476861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.477001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.477027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.477132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.477214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.477239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.477352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.477472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.477498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.477603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.477719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.477745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.477827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.477913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.477938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.478049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.478132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.478158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.478262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.478379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.478405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.478519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.478597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.478622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.478708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.478818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.478843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.478951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.479058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.479083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.479161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.479271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.479297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.479418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.479502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.479527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.479610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.479699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.479725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.479810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.479916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.479941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.480022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.480128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.480153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.480226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.480331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.480357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.480443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.480523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.480548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.337 [2024-11-18 02:12:49.480639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.480754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.337 [2024-11-18 02:12:49.480780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.337 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.480889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.481025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.481051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.481133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.481270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.481295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.481386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.481494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.481520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.481633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.481773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.481800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.481912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.482019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.482045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.482170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.482280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.482306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.482413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.482525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.482552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.482668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.482773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.482799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.482889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.482993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.483019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.483110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.483234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.483264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.483380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.483495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.483520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.483636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.483744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.483770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.483913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.484020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.484046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.484128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.484236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.484262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.484348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.484434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.484459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.484544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.484631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.484658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.484775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.484857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.484883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.484964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.485077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.485103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.485218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.485344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.485370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.485480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.485591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.485621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.485710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.485790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.485816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.485930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.486024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.486049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.486157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.486266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.486291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.486415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.486529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.486555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.486632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.486772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.486798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.486910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.487021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.487046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.487159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.487274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.487300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.487457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.487588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.338 [2024-11-18 02:12:49.487617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.338 qpair failed and we were unable to recover it. 00:30:15.338 [2024-11-18 02:12:49.487749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.487838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.487865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.487983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.488063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.488090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.488204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.488285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.488318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.488431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.488554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.488581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.488703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.488781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.488807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.488892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.488971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.488998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.489086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.489167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.489193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.489332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.489424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.489450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.489574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.489654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.489679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.489791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.489900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.489926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.490013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.490139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.490165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.490259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.490378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.490405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.490524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.490633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.490658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.490744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.490861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.490887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.490968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.491079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.491105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.491192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.491270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.491296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.491383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.491523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.491549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.491632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.491715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.491741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.491859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.491946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.491972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.492060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.492149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.492176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.492327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.492419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.492447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.492526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.492642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.492668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.492813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.492902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.492928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.493066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.493180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.493207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.339 qpair failed and we were unable to recover it. 00:30:15.339 [2024-11-18 02:12:49.493323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.339 [2024-11-18 02:12:49.493419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.493445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.493526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.493608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.493634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.493750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.493893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.493919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.494006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.494084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.494111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.494190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.494296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.494329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.494438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.494550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.494576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.494697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.494780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.494805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.494926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.495035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.495061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.495193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.495280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.495306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.495430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.495518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.495543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.495627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.495740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.495767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.495878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.496016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.496040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.496149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.496258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.496284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.496402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.496493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.496519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.496605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.496712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.496739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.496878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.496955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.496980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.497074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.497186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.497212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.497290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.497417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.497444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.497560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.497650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.497676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.497762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.497885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.497911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.498025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.498135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.498160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.498276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.498406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.498432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.498517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.498599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.498625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.498766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.498851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.498877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.498990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.499073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.499098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.499180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.499323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.499349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.499464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.499551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.499577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.499664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.499804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.499830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.340 qpair failed and we were unable to recover it. 00:30:15.340 [2024-11-18 02:12:49.499945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.500060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.340 [2024-11-18 02:12:49.500085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.500170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.500284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.500309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.500423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.500539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.500564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.500650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.500760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.500786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.500875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.500995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.501021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.501146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.501222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.501248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.501367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.501508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.501534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.501611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.501751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.501777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.501862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.501944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.501970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.502083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.502197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.502223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.502322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.502476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.502513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.502662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.502780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.502808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.502893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.502985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.503011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.503100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.503183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.503209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.503325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.503408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.503436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.503551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.503637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.503663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.503774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.503903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.503929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.504042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.504182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.504207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.504325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.504431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.504461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.504546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.504635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.504661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.504746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.504870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.504896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.504992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.505134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.505160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.505274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.505366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.505393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.505537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.505629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.505656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.505739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.505843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.505869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.505990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.506104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.506131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.506223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.506336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.506364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.506450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.506530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.506557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.341 [2024-11-18 02:12:49.506698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.506802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.341 [2024-11-18 02:12:49.506828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.341 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.506912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.507032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.507059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.507141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.507221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.507247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.507306] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:15.342 [2024-11-18 02:12:49.507380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.507436] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:15.342 [2024-11-18 02:12:49.507472] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:15.342 [2024-11-18 02:12:49.507473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.507491] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:15.342 [2024-11-18 02:12:49.507501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.507590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.507698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.507725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 wit[2024-11-18 02:12:49.507676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:15.342 h addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.507734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:15.342 [2024-11-18 02:12:49.507844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.507927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.507951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.508058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.508068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:15.342 [2024-11-18 02:12:49.508072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:15.342 [2024-11-18 02:12:49.508135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.508162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.508280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.508374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.508400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.508516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.508624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.508649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.508731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.508809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.508835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.508910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.509027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.509052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.509153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.509241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.509267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.509359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.509433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.509458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.509543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.509629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.509654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.509768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.509849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.509875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.509987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.510066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.510091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.510167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.510246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.510272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.510359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.510498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.510524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.510601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.510691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.510716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.510828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.510939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.510965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.511050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.511156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.511182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.511277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.511377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.511405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.511488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.511573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.511600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.511688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.511764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.511790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.511868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.511976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.512003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.512081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.512169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.512197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.342 [2024-11-18 02:12:49.512278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.512372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.342 [2024-11-18 02:12:49.512401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.342 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.512488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.512620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.512646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.512723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.512806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.512833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.512922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.513045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.513071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.513149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.513236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.513263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.513398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.513475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.513501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.513621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.513713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.513738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.513813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.513899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.513925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.514003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.514085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.514110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.514187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.514264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.514289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.514389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.514484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.514510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.514593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.514704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.514731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.514812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.514898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.514926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.515014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.515099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.515128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.515220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.515341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.515368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.515453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.515542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.515568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.515667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.515758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.515784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.515869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.515994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.516020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.516102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.516190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.516216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.516293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.516380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.516407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.516491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.516577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.516603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.516684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.516767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.516793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.516934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.517023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.517050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.517128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.517211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.517238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.517325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.517438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.517465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.343 [2024-11-18 02:12:49.517553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.517643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.343 [2024-11-18 02:12:49.517670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.343 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.517785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.517859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.517885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.517968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.518081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.518109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.518245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.518370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.518396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.518479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.518564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.518590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.518676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.518766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.518792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.518871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.518959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.518986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.519097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.519172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.519198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.519295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.519418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.519444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.519556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.519628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.519654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.519744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.519856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.519886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.519976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.520054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.520079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.520163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.520248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.520274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.520368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.520480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.520506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.520584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.520669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.520697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.520780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.520859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.520885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.520969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.521045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.521072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.521182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.521295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.521338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.521433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.521512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.521537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.521622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.521733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.521759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.521874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.521962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.521993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.522076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.522191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.522217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.522303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.522398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.522423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.522503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.522608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.522633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.522711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.522794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.522820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.522907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.522983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.523009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.523082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.523170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.523195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.344 qpair failed and we were unable to recover it. 00:30:15.344 [2024-11-18 02:12:49.523271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.344 [2024-11-18 02:12:49.523377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.523403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.523495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.523600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.523626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.523706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.523785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.523811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.523916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.524024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.524049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.524134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.524243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.524268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.524358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.524444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.524469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.524556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.524668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.524694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.524775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.524854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.524879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.524967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.525074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.525099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.525180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.525254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.525279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.525380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.525510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.525537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.525640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.525754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.525780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.525891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.525978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.526004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.526089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.526167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.526192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.526304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.526421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.526449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.526535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.526614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.526639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.526754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.526876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.526902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.527040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.527123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.527148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.527235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.527328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.527355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.527480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.527588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.527614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.527739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.527857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.527883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.527977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.528097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.528123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.528239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.528349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.528376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.528487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.528567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.528592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.528699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.528804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.528835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.528923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.529011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.529037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.529118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.529227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.529253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.529395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.529481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.529508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.345 qpair failed and we were unable to recover it. 00:30:15.345 [2024-11-18 02:12:49.529593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.345 [2024-11-18 02:12:49.529703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.529730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.529841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.529925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.529951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.530040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.530149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.530175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.530254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.530343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.530371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.530465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.530573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.530599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.530692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.530824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.530851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.530936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.531030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.531057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.531142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.531222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.531248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.531357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.531470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.531496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.531578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.531688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.531714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.531824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.531908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.531935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.532019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.532129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.532155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.532269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.532359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.532386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.532467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.532547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.532573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.532654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.532734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.532760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.532870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.532953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.532979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.533060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.533150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.533177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.533271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.533379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.533406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.533524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.533601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.533627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.533744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.533821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.533847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.533927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.534008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.534035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.534145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.534231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.534258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.534345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.534456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.534483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.534597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.534676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.534702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.534783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.534897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.534925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.535032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.535153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.535179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.535297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.535421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.535448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.535538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.535615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.535641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.346 qpair failed and we were unable to recover it. 00:30:15.346 [2024-11-18 02:12:49.535723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.346 [2024-11-18 02:12:49.535834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.535860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.535952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.536026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.536053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.536144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.536223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.536249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.536339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.536453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.536480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.536556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.536638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.536665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.536748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.536826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.536853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.536937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.537048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.537075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.537170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.537259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.537285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.537381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.537500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.537527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.537609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.537748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.537774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.537887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.537968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.537994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.538079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.538218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.538244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.538332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.538440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.538466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.538544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.538634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.538661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.538752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.538870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.538897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.538986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.539075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.539102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.539209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.539295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.539328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.539417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.539534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.539560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.539679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.539763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.539794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.539909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.539991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.540018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.540110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.540205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.540230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.540322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.540402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.540428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.540507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.540597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.540624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.540715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.540795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.540821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.540900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.540982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.541008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.541092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.541180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.541206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.541287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.541384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.541410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.541489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.541569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.541596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.347 qpair failed and we were unable to recover it. 00:30:15.347 [2024-11-18 02:12:49.541714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.541809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.347 [2024-11-18 02:12:49.541839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.541928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.542012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.542039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.542133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.542244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.542271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.542395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.542474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.542500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.542643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.542757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.542785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.542875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.542958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.542985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.543075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.543164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.543191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.543270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.543394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.543421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.543508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.543651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.543677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.543765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.543873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.543900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.543981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.544066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.544099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.544209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.544297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.544330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.544415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.544501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.544528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.544605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.544700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.544727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.544812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.544895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.544921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.545029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.545171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.545197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.545281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.545434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.545462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.545550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.545636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.545662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.545747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.545874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.545902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.545978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.546083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.546109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.546195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.546272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.546302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.546399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.546484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.546510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.546628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.546707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.546734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.546820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.546934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.546961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.348 qpair failed and we were unable to recover it. 00:30:15.348 [2024-11-18 02:12:49.547044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.348 [2024-11-18 02:12:49.547125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.547152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.547265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.547364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.547391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.547473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.547579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.547606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.547716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.547794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.547821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.547899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.548009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.548035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.548119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.548194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.548221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.548308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.548423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.548449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.548568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.548680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.548705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.548779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.548894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.548920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.549028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.549140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.549165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.549245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.549330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.549357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.549439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.549561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.549587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.549676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.549757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.549784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.549860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.549970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.549996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.550101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.550209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.550235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.550352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.550467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.550494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.550591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.550675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.550701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.550790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.550869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.550896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.550982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.551102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.551128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.551223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.551319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.551346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.551446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.551556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.551587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.551676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.551754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.551780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.551876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.551950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.551976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.552051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.552140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.552167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.552248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.552356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.552383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.552472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.552603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.552629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.552712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.552827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.552854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.552944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.553032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.553059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.349 qpair failed and we were unable to recover it. 00:30:15.349 [2024-11-18 02:12:49.553143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.553256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.349 [2024-11-18 02:12:49.553282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.553377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.553458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.553484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.553573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.553682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.553707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.553824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.553937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.553964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.554090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.554197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.554224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.554333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.554428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.554456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.554545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.554629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.554656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.554795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.554885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.554912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.554990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.555080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.555106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.555204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.555288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.555321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.555413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.555546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.555573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.555680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.555759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.555797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.555916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.556031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.556060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.556139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.556248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.556274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.556397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.556484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.556511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.556600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.556684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.556711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.556806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.556917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.556944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.557055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.557139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.557166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.557248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.557328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.557355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.557475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.557562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.557588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.557671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.557760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.557785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.557873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.558022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.558048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.558137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.558254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.558281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.558386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.558471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.558498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.558614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.558705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.558731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.558874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.558958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.558986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.559103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.559188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.559214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.559306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.559423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.559450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.350 [2024-11-18 02:12:49.559536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.559677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.350 [2024-11-18 02:12:49.559702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.350 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.559789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.559870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.559896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.559976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.560059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.560085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.560163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.560242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.560269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.560359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.560442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.560468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.560551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.560645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.560670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.560742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.560833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.560859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.560935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.561025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.561052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.561159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.561247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.561273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.561372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.561450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.561476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.561580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.561673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.561702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.561804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.561933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.561962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.562054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.562130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.562156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.562267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.562370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.562397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.562484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.562561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.562588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.562675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.562760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.562786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.562896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.562977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.563004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.563098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.563176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.563207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.563297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.563388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.563415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.563501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.563582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.563610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.563695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.563777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.563803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.563925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.564055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.564087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.564201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.564325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.564354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.564450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.564533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.564560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.564649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.564729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.564757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.564846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.564928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.564954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.565043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.565182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.565210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.565296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.565402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.351 [2024-11-18 02:12:49.565430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.351 qpair failed and we were unable to recover it. 00:30:15.351 [2024-11-18 02:12:49.565515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.565590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.565616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.565752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.565838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.565866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.565944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.566033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.566060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.566178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.566263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.566290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.566381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.566467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.566495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.566576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.566664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.566696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.566841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.566925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.566952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.567028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.567107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.567133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.567214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.567299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.567334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.567423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.567502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.567529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.567619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.567705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.567731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.567824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.567943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.567969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.568045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.568122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.568148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.568264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.568390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.568418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.568502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.568589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.568616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.568699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.568783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.568810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.568887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.568974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.569001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.569085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.569165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.569193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.569307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.569401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.569427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.569505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.569589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.569615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.569700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.569784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.569810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.569919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.570005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.570032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.570130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.570242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.570270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.570366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.570453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.570479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.570568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.570654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.570680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.570760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.570875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.570900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.570978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.571052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.571078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.571166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.571252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.352 [2024-11-18 02:12:49.571279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.352 qpair failed and we were unable to recover it. 00:30:15.352 [2024-11-18 02:12:49.571370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.571479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.571504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.571580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.571655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.571681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.571808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.571915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.571941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.572035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.572113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.572138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.572214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.572294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.572328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.572413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.572494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.572524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.572635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.572710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.572737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.572821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.572932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.572958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.573044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.573125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.573151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.573237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.573338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.573365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.573483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.573590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.573615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.573698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.573772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.573798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.573877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.573953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.573979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.574065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.574142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.574169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.574253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.574360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.574387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.574515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.574605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.574637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.574781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.574869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.574895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.574974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.575062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.575089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.575208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.575290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.575323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.575418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.575529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.575554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.575663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.575747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.575772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.575861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.575989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.576016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.576140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.576249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.576277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.576368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.576455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.576481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.353 qpair failed and we were unable to recover it. 00:30:15.353 [2024-11-18 02:12:49.576607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.353 [2024-11-18 02:12:49.576688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.576715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.576840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.576928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.576954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.577049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.577165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.577192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.577272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.577367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.577393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.577476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.577559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.577584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.577666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.577747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.577772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.577898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.577974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.578001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.578084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.578206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.578232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.578323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.578414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.578441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.578522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.578609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.578635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.578714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.578793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.578819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.578908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.578995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.579021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.579109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.579224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.579249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.579330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.579426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.579452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.579529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.579618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.579644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.579749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.579878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.579904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.579999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.580132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.580158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.580244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.580330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.580357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.580445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.580538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.580564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.580655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.580744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.580770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.580847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.580923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.580949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.581044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.581131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.581156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.581254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.581341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.581367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.581456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.581534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.581560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.581645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.581765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.581792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.581883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.581972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.581997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.582112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.582223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.582250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.582370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.582456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.582482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.582570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.582720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.582745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.582839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.582926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.354 [2024-11-18 02:12:49.582951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.354 qpair failed and we were unable to recover it. 00:30:15.354 [2024-11-18 02:12:49.583034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.583122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.583147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.583258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.583350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.583376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.583462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.583548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.583572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.583684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.583772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.583797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.583913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.584001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.584028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.584109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.584220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.584246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.584326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.584405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.584431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.584544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.584630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.584656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.584735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.584814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.584840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.584951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.585065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.585091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.585179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.585264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.585290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.585378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.585467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.585494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.585581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.585693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.585719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.585838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.585915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.585940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.586046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.586151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.586175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.586275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.586429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.586459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.586590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.586674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.586700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.586787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.586896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.586922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.587002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.587108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.587134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.587217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.587294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.587342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.587449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.587527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.587553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.587639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.587724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.587749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.587832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.587956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.587982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.588068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.588149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.588175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.588253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.588334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.588360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.588450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.588532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.588557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.588641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.588728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.588755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.588837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.588919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.588945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.589071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.589144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.589169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.589255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.589333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.589360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.355 qpair failed and we were unable to recover it. 00:30:15.355 [2024-11-18 02:12:49.589475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.355 [2024-11-18 02:12:49.589559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.589584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.589668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.589775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.589801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.589880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.589969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.589995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.590069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.590140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.590166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.590244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.590324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.590350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.590438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.590520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.590546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.590627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.590712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.590738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.590813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.590925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.590950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.591034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.591114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.591140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.591222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.591415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.591442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.591567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.591672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.591698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.591793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.591867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.591893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.591974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.592099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.592128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.592203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.592371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.592397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.592492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.592569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.592595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.592677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.592750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.592775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.592861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.592940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.592965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.593085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.593162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.593187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.593284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.593380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.593410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.593526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.593600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.593627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.593715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.593830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.593856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.593943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.594038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.594075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.594183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.594296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.594346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.594448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.594579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.594608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.594689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.594771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.594796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.594910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.594995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.595020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.595106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.595180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.595206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.595287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.595375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.595401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.595482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.595559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.595585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.595669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.595770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.595794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.595873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.595949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.595972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.356 qpair failed and we were unable to recover it. 00:30:15.356 [2024-11-18 02:12:49.596099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.596178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.356 [2024-11-18 02:12:49.596203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.596323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.596403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.596428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.596555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.596693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.596718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.596831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.596953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.596978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.597067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.597150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.597175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.597255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.597370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.597396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.597481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.597566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.597597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.597723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.597811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.597836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.597951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.598032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.598058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.598146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.598230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.598255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.598372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.598457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.598482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.598567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.598652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.598677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.598776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.598854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.598879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.598956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.599035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.599061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.599144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.599235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.599261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.599344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.599424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.599449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.599575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.599685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.599710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.599793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.599902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.599928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.600009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.600089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.600116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.600199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.600280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.600306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.600423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.600505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.600531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.600666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.600756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.600783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.600913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.601021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.601047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.601160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.601271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.601296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.601396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.601478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.601503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.601615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.601695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.601720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.601800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.601911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.601936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.602020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.602102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.602128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.602213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.602322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.602349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.357 qpair failed and we were unable to recover it. 00:30:15.357 [2024-11-18 02:12:49.602461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.602547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.357 [2024-11-18 02:12:49.602573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.602684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.602794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.602820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.602906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.603016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.603042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.603159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.603269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.603295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.603389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.603474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.603499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.603586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.603700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.603725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.603805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.603929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.603955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.604040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.604127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.604153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.604232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.604330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.604365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.604446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.604555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.604581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.604663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.604777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.604802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.604877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.605016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.605042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.605118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.605200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.605225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.605308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.605408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.605435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.605556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.605633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.605659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.605736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.605811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.605837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.605945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.606024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.606050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.606127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.606215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.606241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.606339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.606447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.606476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.606587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.606698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.606727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.606816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.606901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.358 [2024-11-18 02:12:49.606928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.358 qpair failed and we were unable to recover it. 00:30:15.358 [2024-11-18 02:12:49.607039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.607147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.607173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.607265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.607377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.607404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.607494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.607577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.607612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.607702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.607781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.607807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.607896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.607971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.607996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.608113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.608196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.608222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.608296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.608397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.608423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.608504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.608602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.608628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.608735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.608863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.608889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.608968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.609046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.609072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.609195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.609275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.609301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.609396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.609506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.609532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.609615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.609717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.609747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.609861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.609943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.609968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.610081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.610191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.610216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.610298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.610394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.610420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.610495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.610621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.610647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.610729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.610835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.610861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.610937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.611012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.611037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.611117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.611226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.611251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.611335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.611448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.611474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.611555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.611662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.611687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.611798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.611875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.611900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.611989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.612073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.612098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.612224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.612315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.612341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.612421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.612510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.612535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.612622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.612704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.612730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.612841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.612922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.612947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.359 qpair failed and we were unable to recover it. 00:30:15.359 [2024-11-18 02:12:49.613034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.613119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.359 [2024-11-18 02:12:49.613145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.613228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.613307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.613345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.613430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.613513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.613539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.613628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.613705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.613730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.613838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.613950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.613975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.614060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.614142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.614167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.614245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.614332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.614359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.614473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.614547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.614573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.614660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.614745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.614771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.614852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.614928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.614954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.615042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.615132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.615158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.615245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.615323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.615349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.615434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.615512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.615539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.615633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.615709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.615735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.615831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.615908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.615934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.616009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.616098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.616124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.616210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.616290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.616327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.616404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.616482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.616509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.616594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.616698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.616724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.616806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.616888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.616913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.616990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.617070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.617096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.617204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.617315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.617342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.617423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.617504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.617529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.617611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.617688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.617713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.617792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.617867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.617894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.617979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.618093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.618119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.618206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.618304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.618339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.618429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.618520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.618548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.618638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.618718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.360 [2024-11-18 02:12:49.618745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.360 qpair failed and we were unable to recover it. 00:30:15.360 [2024-11-18 02:12:49.618831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.618916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.618943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.619030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.619113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.619140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.619238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.619350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.619377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.619460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.619537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.619564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.619642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.619724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.619750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.619858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.619935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.619962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.620038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.620142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.620174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.620260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.620356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.620384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.620467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.620608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.620634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.620752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.620836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.620862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.620944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.621024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.621050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.621190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.621294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.621338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.621448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.621536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.621563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.621654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.621765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.621792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.621909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.621999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.622026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.622140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.622221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.622254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.622346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.622433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.622469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.622565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.622706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.622732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.622811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.622897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.622923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.623003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.623084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.623111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.623227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.623317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.623344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.623427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.623514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.623541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.623628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.623715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.623742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.623824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.623910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.623938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.624021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.624104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.624132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.624210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.624328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.624355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.624437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.624518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.624550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.624698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.624811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.624837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.361 qpair failed and we were unable to recover it. 00:30:15.361 [2024-11-18 02:12:49.624947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.361 [2024-11-18 02:12:49.625060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.625087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.625164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.625250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.625278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.625375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.625460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.625488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.625571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.625680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.625707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.625816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.625901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.625928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.626014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.626093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.626119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.626233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.626315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.626343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.626449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.626527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.626553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.626634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.626725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.626755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.626847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.626924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.626950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.627061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.627143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.627170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.627248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.627364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.627391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.627468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.627546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.627571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.627657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.627730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.627755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.627831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.627905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.627931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.628026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.628117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.628144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.628229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.628305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.628338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.628430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.628518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.628547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.628624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.628710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.628736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.628823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.628964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.628990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.629078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.629159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.629185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.629264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.629351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.629377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.629457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.629536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.629561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.629647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.629724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.629751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.362 qpair failed and we were unable to recover it. 00:30:15.362 [2024-11-18 02:12:49.629827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.362 [2024-11-18 02:12:49.629906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.629932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.630009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.630091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.630117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.630191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.630302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.630337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.630446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.630523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.630549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.630676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.630782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.630808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.630920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.631002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.631028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.631106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.631186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.631211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.631295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.631422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.631448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.631536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.631650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.631676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.631787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.631860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.631886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.631961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.632075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.632100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.632176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.632252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.632277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.632375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.632454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.632480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.632565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.632640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.632665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.632780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.632860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.632885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.633008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.633093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.633118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.633202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.633277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.633302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.633390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.633471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.633497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.633605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.633684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.633711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.633797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.633885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.633912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.634023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.634103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.634129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.634214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.634349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.634377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.634457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.634535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.634561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.634636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.634721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.634747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.634827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.634952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.634978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.635062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.635150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.635176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.635279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.635380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.635406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.635486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.635565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.635591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.635679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.635755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.363 [2024-11-18 02:12:49.635781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.363 qpair failed and we were unable to recover it. 00:30:15.363 [2024-11-18 02:12:49.635865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.635972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.635998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.636072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.636151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.636177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.636263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.636338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.636365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.636448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.636553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.636578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.636692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.636802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.636827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.636934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.637014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.637040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.637119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.637211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.637241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.637379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.637468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.637494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.637570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.637682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.637708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.637787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.637896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.637922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.638009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.638083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.638109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.638191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.638328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.638354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.638437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.638518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.638544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.638734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.638818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.638843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.638937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.639077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.639102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.639186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.639376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.639403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.639481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.639557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.639583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.639673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.639780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.639806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.639892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.639965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.639990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.640072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.640155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.640182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.640263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.640342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.640369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.640458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.640533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.640559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.640632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.640713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.640738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.640850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.640955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.640980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.641066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.641147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.641172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.641258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.641337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.641364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.641477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.641563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.641588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.641679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.641763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.641788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.364 qpair failed and we were unable to recover it. 00:30:15.364 [2024-11-18 02:12:49.641904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.364 [2024-11-18 02:12:49.641983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.642010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.642094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.642282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.642307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.642399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.642477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.642502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.642584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.642724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.642749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.642838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.642930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.642957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.643038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.643115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.643141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.643224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.643316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.643359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.643446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.643528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.643554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.643660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.643737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.643763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.643882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.644003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.644032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.644149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.644237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.644265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.644363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.644454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.644482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.644557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.644664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.644691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.644780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.644855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.644881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.644992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.645073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.645100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.645216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.645299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.645332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.645418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.645498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.645524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.645636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.645718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.645743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.645835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.645923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.645950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.646140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.646225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.646251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.646344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.646430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.646458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.646538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.646725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.646751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.646869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.646944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.646977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.647080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.647267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.647293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.647382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.647492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.647518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.647603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.647722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.647749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.647865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.647947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.647973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.648088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.648165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.648190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.648315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.648393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.365 [2024-11-18 02:12:49.648419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.365 qpair failed and we were unable to recover it. 00:30:15.365 [2024-11-18 02:12:49.648505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.648595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.648621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.648736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.648857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.648883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.649014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.649095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.649121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.649198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.649306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.649340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.649424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.649503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.649528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.649609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.649716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.649741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.649819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.649905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.649931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.650032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.650117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.650142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.650258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.650340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.650366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.650442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.650527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.650551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.650665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.650760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.650786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.650872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.650981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.651006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.651204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.651288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.651322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.651403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.651487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.651513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.651597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.651679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.651705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.651896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.651968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.651994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.652072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.652146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.652171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.652257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.652365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.652391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.652501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.652583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.652609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.652691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.652830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.652855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.652945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.653053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.653083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.653160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.653245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.653270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.653363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.653477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.653503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.653587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.653672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.653697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.653812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.653888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.653914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.654027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.654115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.654141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.654248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.654324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.366 [2024-11-18 02:12:49.654350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.366 qpair failed and we were unable to recover it. 00:30:15.366 [2024-11-18 02:12:49.654430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.654515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.654542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.654659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.654745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.654771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.654847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.654960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.654985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.655095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.655170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.655200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.655286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.655385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.655411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.655491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.655605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.655630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.655715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.655795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.655821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.655895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.656004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.656031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.656117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.656201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.656226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.656307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.656395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.656420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.656501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.656584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.656610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.656684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.656761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.656786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.656895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.656973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.656999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.657076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.657156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.657182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.657273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.657352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.657377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.657463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.657541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.657566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.657685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.657761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.657788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.657865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.657975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.658001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.658082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.658168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.658193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.658288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.658383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.658410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.658495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.658575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.658601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.658685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.658765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.658791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.658868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.658950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.658974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.659082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.659159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.659186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.659270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.659385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.659412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.659521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.659631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.659657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.367 qpair failed and we were unable to recover it. 00:30:15.367 [2024-11-18 02:12:49.659747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.367 [2024-11-18 02:12:49.659848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.659873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.659958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.660036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.660063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.660159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.660277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.660303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.660393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.660482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.660509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.660643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.660750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.660776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.660860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.660970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.660995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.661078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.661157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.661183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.661257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.661337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.661364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.661444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.661531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.661557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.661672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.661751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.661776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.661884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.661962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.661989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.662127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.662209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.662235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.662352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.662438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.662464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.662556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.662635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.662660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.662740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.662819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.662844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.662952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.663060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.663085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.663170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.663298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.663331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.663449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.663536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.663562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.663645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.663754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.663780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.663862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.663937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.663963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.664040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.664116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.664142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.664217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.664299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.664332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.664419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.664523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.664548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.664630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.664744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.664771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.664858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.664932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.664957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.665042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.665155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.665179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.665298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.665387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.665412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.665502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.665638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.665662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.368 qpair failed and we were unable to recover it. 00:30:15.368 [2024-11-18 02:12:49.665748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.368 [2024-11-18 02:12:49.665868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.665893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.666006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.666088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.666113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.666191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.666270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.666297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.666383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.666463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.666488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.666566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.666675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.666701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.666807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.666912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.666937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.667050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.667157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.667182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.667265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.667349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.667375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.667455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.667541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.667568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.667645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.667732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.667758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.667847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.667958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.667983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.668057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.668134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.668162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.668237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.668325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.668352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.668429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.668507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.668533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.668613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.668697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.668725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.668838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.668945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.668970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.669055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.669166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.669193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.669298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.669381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.669406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.669484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.669588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.669614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.669689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.669794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.669820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.669907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.669996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.670021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.670102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.670209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.670234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.670317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.670398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.670425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.670532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.670611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.670635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.670707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.670781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.670805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.670881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.670959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.670985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.671066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.671141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.671164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.671245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.671347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.671372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.369 qpair failed and we were unable to recover it. 00:30:15.369 [2024-11-18 02:12:49.671456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.369 [2024-11-18 02:12:49.671533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.671557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.671663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.671741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.671765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.671847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.671934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.671959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.672068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.672148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.672172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.672290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.672384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.672410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.672517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.672590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.672614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.672721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.672801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.672825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.672940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.673047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.673071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.673155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.673226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.673250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.673327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.673431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.673456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.673536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.673645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.673668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.673773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.673852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.673875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.673983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.674091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.674120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.674196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.674274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.674298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.674402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.674479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.674503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.674589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.674666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.674691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.674769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.674880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.674904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.674983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.675055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.675079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.675192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.675292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.675327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.675414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.675503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.675527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.675616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.675694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.675718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.675809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.675892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.675924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.676006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.676079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.676108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.676205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.676287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.676318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.676399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.676476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.676501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.676584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.676658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.676682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.676764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.676837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.676861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.676936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.677023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.677048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.370 qpair failed and we were unable to recover it. 00:30:15.370 [2024-11-18 02:12:49.677127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.677200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.370 [2024-11-18 02:12:49.677224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.677304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.677395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.677419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.677508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.677594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.677618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.677698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.677790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.677818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.677915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.678033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.678063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.678144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.678258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.678282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.678370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.678458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.678482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.678571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.678654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.678679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.678766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.678844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.678869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.678978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.679054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.679079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.679162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.679242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.679266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.679376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.679456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.679480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.679594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.679701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.679725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.679832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.679913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.679937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.680018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.680095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.680119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.680238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.680322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.680347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.680434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.680518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.680544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.680629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.680737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.680770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.680878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.680976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.681010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.681127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.681237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.681260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.681355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.681478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.681503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.681589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.681694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.681718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.681808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.681891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.681916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.681996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.682072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.682096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.682201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.682283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.682306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.371 qpair failed and we were unable to recover it. 00:30:15.371 [2024-11-18 02:12:49.682409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.371 [2024-11-18 02:12:49.682487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.372 [2024-11-18 02:12:49.682517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.372 qpair failed and we were unable to recover it. 00:30:15.372 [2024-11-18 02:12:49.682600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.372 [2024-11-18 02:12:49.682689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.372 [2024-11-18 02:12:49.682717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.372 qpair failed and we were unable to recover it. 00:30:15.372 [2024-11-18 02:12:49.682838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.372 [2024-11-18 02:12:49.682938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.372 [2024-11-18 02:12:49.682973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.372 qpair failed and we were unable to recover it. 00:30:15.372 [2024-11-18 02:12:49.683082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.372 [2024-11-18 02:12:49.683199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.372 [2024-11-18 02:12:49.683225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.372 qpair failed and we were unable to recover it. 00:30:15.372 [2024-11-18 02:12:49.683341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.372 [2024-11-18 02:12:49.683423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.372 [2024-11-18 02:12:49.683447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.372 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.683522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.683600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.683625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.683720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.683835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.683859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.683945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.684015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.684039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.684117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.684190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.684213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.684293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.684374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.684398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.684510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.684596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.684621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.684718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.684831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.684856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.684933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.685013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.685037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.685126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.685206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.685230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.685321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.685394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.685418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.685497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.685625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.685648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.685788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.685866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.685896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.685976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.686053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.686079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.686155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.686232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.686256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.686341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.686418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.686442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.686526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.686604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.686627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.686745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.686829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.686856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.686934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.687010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.687037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.687123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.687226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.687250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.687357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.687440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.687465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.687547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.687649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.687673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.632 qpair failed and we were unable to recover it. 00:30:15.632 [2024-11-18 02:12:49.687784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.632 [2024-11-18 02:12:49.687876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.687902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.633 qpair failed and we were unable to recover it. 00:30:15.633 [2024-11-18 02:12:49.687987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.688076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.688101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.633 qpair failed and we were unable to recover it. 00:30:15.633 [2024-11-18 02:12:49.688177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.688252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.688276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.633 qpair failed and we were unable to recover it. 00:30:15.633 [2024-11-18 02:12:49.688362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.688472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.688496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.633 qpair failed and we were unable to recover it. 00:30:15.633 [2024-11-18 02:12:49.688589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.688667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.688692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.633 qpair failed and we were unable to recover it. 00:30:15.633 [2024-11-18 02:12:49.688775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.688877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.688907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.633 qpair failed and we were unable to recover it. 00:30:15.633 [2024-11-18 02:12:49.688994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.689101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.689130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.633 qpair failed and we were unable to recover it. 00:30:15.633 [2024-11-18 02:12:49.689217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.689293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.689323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.633 qpair failed and we were unable to recover it. 00:30:15.633 [2024-11-18 02:12:49.689406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.633 [2024-11-18 02:12:49.689522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.124727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.124956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.125061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.125087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.125192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.125328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.125354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.125484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.125581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.125610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.125710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.125800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.125823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.125937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.126023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.126046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.126133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.126284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.126319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.126412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.126496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.126521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.126623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.126716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.126741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.126827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.126966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.126992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.127084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.127166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.127191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.127278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.127376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.127402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.127481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.127562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.127586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.127673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.127765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.127791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.127908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.127984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.128010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.128132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.128220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.128244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.128364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.128445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.128469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.128605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.128680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.128705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.128851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.128935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.128960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.129049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.129137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.129162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.129247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.129329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.129355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.129432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.129517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.129542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.129631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.129709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.129735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.129814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.129974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.130000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.130080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.130188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.130214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.130301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.130391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.130416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.130509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.130592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.130619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.912 qpair failed and we were unable to recover it. 00:30:15.912 [2024-11-18 02:12:50.130716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.912 [2024-11-18 02:12:50.130835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.130861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.130949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.131033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.131058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.131164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.131256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.131281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.131366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.131446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.131473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.131550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.131658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.131685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.131776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.131856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.131883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.131965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.132062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.132089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.132166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.132244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.132270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.132370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.132479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.132504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.132591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.132685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.132711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.132816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.132928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.132954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.133032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.133119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.133145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.133241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.133323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.133350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.133459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.133539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.133564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.133679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.133760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.133786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.133867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.134015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.134042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.134130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.134204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.134230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.134341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.134422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.134448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.134537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.134619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.134645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.134740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.134848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.134874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.134950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.135061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.135088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.135170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.135248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.135275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.135361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.135438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.135463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.135546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.135636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.135662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.135740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.135858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.135887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.135965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.136069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.136095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.136174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.136248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.136274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.136361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.136445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.136471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.913 [2024-11-18 02:12:50.136555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.136643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.913 [2024-11-18 02:12:50.136668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.913 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.136749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.136871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.136897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.137010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.137088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.137114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.137190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.137321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.137348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.137435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.137548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.137573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.137657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.137734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.137759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.137867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.137962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.137988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.138075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.138160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.138187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.138298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.138411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.138437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.138521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.138607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.138633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.138709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.138793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.138820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.138903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.138989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.139017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.139106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.139182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.139208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.139308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.139404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.139429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.139526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.139616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.139641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.139728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.139801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.139827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.139912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.139988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.140014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.140108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.140229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.140254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.140366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.140443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.140469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.140574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.140680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.140705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.140790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.140876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.140901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.140985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.141058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.141088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.141168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.141259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.141285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.141395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.141474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.141499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.141576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.141654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.141680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.141779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.141855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.141880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.141963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.142045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.142072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.142159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.142236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.142263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.142393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.142509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.142535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.914 qpair failed and we were unable to recover it. 00:30:15.914 [2024-11-18 02:12:50.142626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.914 [2024-11-18 02:12:50.142708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.142734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.142847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.142922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.142948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.143042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.143116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.143146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.143224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.143336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.143362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.143447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.143527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.143553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.143642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.143725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.143750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.143860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.143974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.144001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.144091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.144171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.144196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.144284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.144408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.144435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.144533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.144615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.144642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.144736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.144815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.144840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.144916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.144995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.145022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.145132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.145213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.145244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.145340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.145480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.145506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.145591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.145669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.145694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.145772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.145881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.145908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.145992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.146069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.146094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.146170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.146280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.146306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.146414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.146492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.146517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.146596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.146682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.146708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.146818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.146908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.146934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.147012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.147128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.147153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.147249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.147341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.147370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.147451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.147557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.147584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.147669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.147747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.147773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.147882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.147977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.148003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.148112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.148220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.148246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.148362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.148450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.148476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.915 [2024-11-18 02:12:50.148562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.148672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.915 [2024-11-18 02:12:50.148698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.915 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.148779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.148867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.148893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.148972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.149047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.149073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.149172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.149300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.149336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.149426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.149501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.149525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.149625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.149737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.149763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.149851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.149927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.149952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.150038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.150146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.150171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.150295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.150399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.150424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.150502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.150593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.150619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.150712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.150790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.150815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.150924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.151045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.151071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.151161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.151240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.151265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.151391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.151476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.151502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.151612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.151694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.151719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.151817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.151921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.151947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.152028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.152114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.152140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.152248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.152334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.152359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.152479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.152554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.152579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.152661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.152772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.152798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.152879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.152994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.153021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.153110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.153211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.153236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.153327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.153406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.153431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.916 [2024-11-18 02:12:50.153547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.153634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.916 [2024-11-18 02:12:50.153660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.916 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.153748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.153836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.153861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.153950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.154025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.154050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.154129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.154214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.154240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.154339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.154480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.154505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.154593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.154722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.154751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.154859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.154934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.154959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.155036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.155113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.155137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.155223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.155347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.155378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.155450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.155527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.155553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.155641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.155718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.155742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.155846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.155928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.155954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.156044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.156121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.156146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.156253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.156396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.156423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.156514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.156604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.156630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.156712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.156796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.156823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.156907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.157044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.157069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.157151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.157234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.157260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.157355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.157468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.157494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.157575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.157656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.157681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.157781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.157909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.157938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.158021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.158099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.158125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.158217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.158291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.158325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.158441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.158527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.158553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.158666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.158780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.158806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.158879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.158961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.158986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.159069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.159182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.159207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.159327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.159410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.159435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.159511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.159600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.159629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.917 qpair failed and we were unable to recover it. 00:30:15.917 [2024-11-18 02:12:50.159709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.917 [2024-11-18 02:12:50.159815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.159841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.159917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.160030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.160056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.160170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.160248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.160273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.160388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.160510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.160536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.160631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.160769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.160795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.160908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.160993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.161019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.161097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.161207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.161234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.161333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.161444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.161469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.161581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.161659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.161685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.161774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.161860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.161885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.161999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.162085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.162110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.162215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.162286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.162318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.162431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.162511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.162536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.162630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.162749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.162775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.162854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.162965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.162991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.163073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.163160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.163184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.163265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.163400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.163427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.163515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.163596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.163621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.163706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.163790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.163816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.163926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.164009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.164037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.164121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.164230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.164255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.164345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.164426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.164451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.164525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.164603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.164628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.164758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.164843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.164871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.164959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.165030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.165056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.165165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.165244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.165271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.165390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.165498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.165524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.165637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.165744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.165770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.918 [2024-11-18 02:12:50.165853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.165959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.918 [2024-11-18 02:12:50.165985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.918 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.166140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.166249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.166274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.166370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.166454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.166479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.166554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.166709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.166735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.166810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.166888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.166914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.166995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.167079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.167106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.167193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.167297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.167330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.167411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.167486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.167512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.167593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.167698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.167724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.167805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.167887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.167913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.167988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.168091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.168117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.168201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.168286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.168325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.168407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.168516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.168542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.168652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.168745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.168770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.168854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.168967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.168992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.169067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.169142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.169172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.169259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.169346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.169372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.169482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.169557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.169582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.169709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.169788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.169813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.169894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.169978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.170004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.170089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.170159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.170185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.170291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.170384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.170410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.170501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.170621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.170647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.170767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.170879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.170905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.170981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.171070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.171096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.171176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.171285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.171324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.171444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.171524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.171550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.171667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.171784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.171820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.171910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.171994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.172020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.919 qpair failed and we were unable to recover it. 00:30:15.919 [2024-11-18 02:12:50.172097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.919 [2024-11-18 02:12:50.172286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.172327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.172421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.172494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.172519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.172606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.172689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.172715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.172852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.172948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.172973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.173083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.173190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.173215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.173305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.173384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.173410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.173490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.173570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.173595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.173717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.173796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.173821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.173928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.174013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.174039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.174123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.174201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.174226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.174315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.174395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.174420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.174497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.174573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.174598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.174682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.174799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.174825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.174935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.175013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.175039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.175127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.175211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.175236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.175326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.175416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.175441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.175516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.175587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.175613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.175702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.175781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.175806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.175890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.176090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.176116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.176228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.176347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.176373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.176451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.176534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.176560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.176652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.176731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.176758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.176875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.177073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.177098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.177187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.177270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.177295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.177380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.177459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.177484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.177565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.177657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.177690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.177774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.177862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.177888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.178000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.178112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.178145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.178224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.178302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.920 [2024-11-18 02:12:50.178334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.920 qpair failed and we were unable to recover it. 00:30:15.920 [2024-11-18 02:12:50.178408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.178484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.178509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.178593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.178713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.178739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.178812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.178917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.178943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.179019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.179101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.179127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.179206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.179349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.179376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.179459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.179566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.179591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.179719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.179828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.179853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.179930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.180012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.180037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.180151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.180238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.180263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.180351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.180428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.180454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.180541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.180631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.180657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.180735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.180812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.180838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.180919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.181003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.181029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.181106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.181193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.181219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.181303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.181428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.181453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.181565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.181678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.181704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.181787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.181865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.181890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.181965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.182073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.182098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.182202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.182320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.182351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.182433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.182511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.182537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.182622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.182722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.182748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.182830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.182913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.182938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.183045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.183124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.183149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.183235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.183324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.183351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.183431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.183509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.183534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.921 qpair failed and we were unable to recover it. 00:30:15.921 [2024-11-18 02:12:50.183621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.921 [2024-11-18 02:12:50.183695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.183720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.183801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.183877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.183902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.183980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.184060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.184085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.184164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.184237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.184262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.184348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.184429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.184455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.184528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.184617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.184643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.184758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.184835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.184860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.184967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.185093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.185118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.185201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.185325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.185351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.185491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.185580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.185605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.185689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.185877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.185902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.185976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.186163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.186188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.186266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.186362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.186388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.186475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.186559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.186585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.186706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.186786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.186813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.186892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.187006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.187031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.187117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.187195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.187221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.187296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.187393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.187418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.187528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.187650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.187675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.187751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.187825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.187850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.187928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.188012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.188038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.188150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.188223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.188248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.188349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.188464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.188489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.188678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.188763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.188788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.188883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.188991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.189020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.189114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.189224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.189251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.189352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.189438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.189465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.189577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.189662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.189688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.189766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.189845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.189870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.922 qpair failed and we were unable to recover it. 00:30:15.922 [2024-11-18 02:12:50.189950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.922 [2024-11-18 02:12:50.190042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.190068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.190147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.190227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.190252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.190342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.190436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.190462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.190541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.190659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.190685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.190761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.190874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.190900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.190985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.191084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.191110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.191196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.191269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.191294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.191382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.191503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.191529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.191619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.191697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.191723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.191796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.191878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.191905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.191986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.192063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.192089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.192182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.192266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.192291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.192384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.192464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.192492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.192600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.192680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.192706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.192785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.192860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.192886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.192975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.193065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.193090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.193165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.193235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.193261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.193355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.193437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.193461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.193548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.193632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.193658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.193805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.193910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.193936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.194024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.194135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.194161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.194274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.194391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.194417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.194494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.194574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.194598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.194677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.194754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.194780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.194870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.194949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.194975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.195057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.195167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.195193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.195316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.195403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.195430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.195547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.195625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.195650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.923 [2024-11-18 02:12:50.195738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.195824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.923 [2024-11-18 02:12:50.195850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.923 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.195962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.196039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.196065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.196146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.196252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.196276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.196394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.196468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.196493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.196576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.196655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.196679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.196764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.196843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.196868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.196942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.197050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.197075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.197156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.197262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.197293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.197412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.197486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.197512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.197611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.197728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.197754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.197837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.197924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.197949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.198060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.198138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.198163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.198237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.198332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.198359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.198437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.198514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.198541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.198616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.198695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.198721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.198797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.198879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.198904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.198991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.199073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.199097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.199205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.199286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.199322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.199408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.199516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.199541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.199626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.199701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.199726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.199810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.199916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.199941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.200024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.200108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.200134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.200226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.200335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.200361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.200442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.200516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.200540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.200618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.200697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.200723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.200808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.200892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.200921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.201006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.201084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.201110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.201221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.201329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.201359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.201440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.201522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.201546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.924 qpair failed and we were unable to recover it. 00:30:15.924 [2024-11-18 02:12:50.201624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.924 [2024-11-18 02:12:50.201701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.201726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.201803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.201913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.201938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.202052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.202135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.202160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.202265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.202348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.202374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.202457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.202564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.202589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.202666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.202746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.202770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.202879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.202955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.202980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.203060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.203165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.203190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.203268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.203390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.203419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.203497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.203575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.203600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.203684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.203765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.203792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.203901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.204003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.204028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.204114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.204188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.204212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.204324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.204408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.204433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.204520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.204598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.204622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.204730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.204814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.204841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.204950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.205029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.205056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.205131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.205209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.205235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.205315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.205394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.205418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.205503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.205583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.205610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.205703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.205807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.205832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.205914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.205995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.206020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.206098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.206179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.206204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.206284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.206368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.206394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.925 [2024-11-18 02:12:50.206476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.206555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.925 [2024-11-18 02:12:50.206580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.925 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.206666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.206740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.206765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.206850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.206925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.206951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.207095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.207178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.207205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.207338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.207449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.207476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.207559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.207640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.207666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.207770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.207881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.207906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.207983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.208064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.208089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.208167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.208240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.208266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.208361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.208439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.208464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.208552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.208626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.208650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.208732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.208821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.208846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.208962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.209036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.209061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.209175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.209282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.209308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.209406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.209482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.209508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.209596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.209675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.209700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.209776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.209864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.209888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.210000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.210082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.210107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.210192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.210266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.210292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.210384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.210466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.210490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.210566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.210673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.210697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.210782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.210865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.210891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.210979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.211060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.211084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.211192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.211268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.211293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.211379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.211497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.211523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.211618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.211691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.211716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.211789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.211911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.211935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.926 qpair failed and we were unable to recover it. 00:30:15.926 [2024-11-18 02:12:50.212051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.212125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.926 [2024-11-18 02:12:50.212150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.212232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.212343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.212368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.212458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.212537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.212562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.212638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.212747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.212773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.212858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.212939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.212964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.213037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.213149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.213174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.213289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.213368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.213393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.213470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.213575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.213600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.213695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.213805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.213831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.213918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.214054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.214080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.214160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.214270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.214296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.214409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.214487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.214513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.214652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.214726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.214751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.214836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.214911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.214936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.215018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.215113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.215138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.215218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.215291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.215344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.215428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.215535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.215561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.215642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.215751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.215775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.215870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.215974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.215999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.216086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.216166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.216190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.216323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.216434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.216460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.216539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.216646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.216671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.216745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.216854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.216879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.216988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.217064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.217090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.217163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.217247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.217272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.217361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.217435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.217460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.217532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.217653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.217680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.217794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.217901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.217927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.218041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.218116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.927 [2024-11-18 02:12:50.218142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.927 qpair failed and we were unable to recover it. 00:30:15.927 [2024-11-18 02:12:50.218259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.218339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.218365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.218452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.218532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.218558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.218641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.218717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.218743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.218820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.218894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.218919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.219036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.219138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.219165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.219281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.219359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.219384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.219499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.219605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.219631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.219713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.219797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.219822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.219901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.220037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.220062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.220194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.220292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.220328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.220424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.220510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.220536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.220617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.220693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.220720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.220808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.220893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.220919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.221036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.221182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.221210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.221297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.221394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.221420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.221510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.221598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.221625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.221718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.221794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.221820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.221906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.222015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.222042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.222123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.222244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.222272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.222364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.222453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.222480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.222567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.222644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.222670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.222781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.222866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.222894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.222984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.223059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.223085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.223203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.223367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.223399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.223482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.223560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.223586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.223666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.223778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.223803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.223917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.224027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.224054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.224135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.224225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.224251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.928 qpair failed and we were unable to recover it. 00:30:15.928 [2024-11-18 02:12:50.224333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.928 [2024-11-18 02:12:50.224415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.224443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.224532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.224619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.224646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.224726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.224834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.224860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.224946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.225031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.225058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.225141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.225216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.225243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.225325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.225435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.225465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.225552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.225633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.225659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.225742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.225855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.225883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.225965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.226075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.226101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.226182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.226261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.226287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.226378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.226496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.226523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.226610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.226730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.226758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.226842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.226923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.226949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.227031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.227135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.227161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.227246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.227327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.227354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.227433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.227527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.227553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.227662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.227740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.227767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.227888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.227994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.228020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.228134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.228217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.228243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.228341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.228421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.228447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.228553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.228642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.228668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.228760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.228892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.228918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.228996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.229077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.229103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.229186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.229266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.229291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.229390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.229471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.229497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.229611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.229699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.229726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.229836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.229920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.229947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.230062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.230147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.230173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.929 qpair failed and we were unable to recover it. 00:30:15.929 [2024-11-18 02:12:50.230253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.230372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.929 [2024-11-18 02:12:50.230399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.230480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.230569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.230597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.230686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.230798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.230825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.230937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.231018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.231048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.231126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.231204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.231230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.231338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.231421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.231448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.231564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.231651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.231677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.231757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.231873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.231900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.231980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.232102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.232129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.232244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.232327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.232354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.232445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.232554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.232580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.232663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.232739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.232765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.232847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.232963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.232989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.233064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.233169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.233201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.233287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.233410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.233437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.233552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.233637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.233663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.233755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.233830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.233856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.233953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.234039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.234066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.234150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.234223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.234250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.234332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.234442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.234468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.234550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.234632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.234659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.234772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.234846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.234872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.234954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.235067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.235094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.235188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.235273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.235305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.930 [2024-11-18 02:12:50.235401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.235512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.930 [2024-11-18 02:12:50.235539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.930 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.235617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.235735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.235761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.235876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.235986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.236012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.236101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.236184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.236211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.236295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.236403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.236429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.236514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.236627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.236653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.236742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.236822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.236848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.236928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.237016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.237043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.237122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.237234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.237260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.237357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.237442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.237474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.237561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.237667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.237693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.237773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.237847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.237874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.237957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.238050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.238078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.238154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.238268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.238294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.238394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.238501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.238527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.238614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.238749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.238776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.238852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.238929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.238956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.239064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.239171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.239197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.239275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.239383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.239410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.239523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.239605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.239633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.239729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.239816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.239842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.239924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.240028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.240055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.240195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.240305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.240337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.240415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.240496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.240523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.240602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.240737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.240763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.240876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.240957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.240983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.241065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.241146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.241173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.241250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.241361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.241389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.241477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.241588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.931 [2024-11-18 02:12:50.241615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.931 qpair failed and we were unable to recover it. 00:30:15.931 [2024-11-18 02:12:50.241696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.241805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.241832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.241915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.241993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.242019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.242125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.242202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.242229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.242309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.242387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.242413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.242495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.242576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.242602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.242714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.242850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.242876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.242959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.243041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.243067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.243159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.243239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.243265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.243364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.243441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.243467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.243549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.243640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.243667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.243809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.243895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.243922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.244011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.244085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.244111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.244229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.244308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.244340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.244422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.244504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.244531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.244613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.244716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.244742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.244851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.244966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.244993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.245077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.245184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.245211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.245287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.245371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.245398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.245509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.245590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.245616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.245727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.245810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.245837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.245943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.246036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.246062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.246145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.246224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.246251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.246369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.246462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.246490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.246570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.246683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.246711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.246791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.246880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.246906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.247018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.247101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.247126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.247210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.247330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.247358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.247442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.247521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.247547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.932 qpair failed and we were unable to recover it. 00:30:15.932 [2024-11-18 02:12:50.247629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.932 [2024-11-18 02:12:50.247710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.247737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.247825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.247936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.247963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.248049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.248195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.248221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.248315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.248396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.248422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.248501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.248580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.248606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.248689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.248768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.248794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.248873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.249017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.249044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.249124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.249201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.249227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.249318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.249398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.249424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.249500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.249602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.249629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.249742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.249822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.249847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.249930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.250023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.250049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.250161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.250241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.250267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.250367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.250449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.250475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.250576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.250661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.250687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.250800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.250912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.250940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.251020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.251109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.251135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.251212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.251300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.251334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.251429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.251512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.251539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.251620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.251697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.251723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.251832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.251911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.251938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.252021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.252098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.252123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.252203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.252342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.252369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.252482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.252581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.252611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.252724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.252801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.252828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.252945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.253029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.253056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.253165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.253280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.253323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.253410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.253524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.253550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.933 [2024-11-18 02:12:50.253664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.253747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.933 [2024-11-18 02:12:50.253774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.933 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.253856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.253945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.253970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.254051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.254126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.254152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.254259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.254372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.254400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.254485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.254567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.254593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.254679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.254786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.254813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.254929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.255042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.255068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.255160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.255243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.255269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.255369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.255472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.255500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.255612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.255697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.255724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.255842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.255922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.255948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.256060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.256142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.256168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.256249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.256362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.256389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.256472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.256585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.256611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.256696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.256811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.256837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.256913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.257033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.257059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.257172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.257253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.257279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.257366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.257450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.257476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.257585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.257670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.257697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.257781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.257860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.257886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.258006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.258087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.258114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.258200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.258286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.258317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.258399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.258479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.258505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.258592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.258671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.258697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.258776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.258850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.258875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.258953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.259035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.259063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.259153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.259230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.259256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.259372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.259455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.259481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.259563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.259648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.259675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.934 qpair failed and we were unable to recover it. 00:30:15.934 [2024-11-18 02:12:50.259789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.934 [2024-11-18 02:12:50.259897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.259922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.260003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.260094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.260121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.260203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.260287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.260321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.260408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.260487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.260512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.260602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.260685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.260712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.260797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.260907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.260934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.261018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.261134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.261160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.261276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.261399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.261425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.261502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.261578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.261603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.261708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.261824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.261851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.261935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.262018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.262044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.262156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.262235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.262260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.262345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.262425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.262451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.262532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.262675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.262701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.262784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.262865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.262891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.262973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.263056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.263082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.263162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.263279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.263305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.263423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.263514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.263542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.263617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.263726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.263752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.263837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.263920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.263946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.264030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.264105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.264131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.264215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.264292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.264329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.264409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.264489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.264515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.935 qpair failed and we were unable to recover it. 00:30:15.935 [2024-11-18 02:12:50.264626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.935 [2024-11-18 02:12:50.264710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.264736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.264844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.264925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.264951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.265073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.265154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.265181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.265266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.265356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.265388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.265474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.265564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.265590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.265706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.265784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.265810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.265890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.265983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.266011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.266092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.266180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.266207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.266284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.266397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.266423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.266504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.266584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.266610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.266691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.266826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.266852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.266932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.267011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.267038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.267124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.267244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.267272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.267375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.267466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.267495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.267580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.267659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.267684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.267773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.267858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.267883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.267993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.268073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.268100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.268182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.268293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.268326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.268410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.268487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.268513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.268635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.268740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.268765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.268874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.268986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.269013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.269101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.269175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.269201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.269290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.269383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.269410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.269491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.269572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.269604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.269689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.269777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.269804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.269893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.269975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.270000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.270126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.270240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.270266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.270358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.270438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.270464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.936 qpair failed and we were unable to recover it. 00:30:15.936 [2024-11-18 02:12:50.270544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.270655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.936 [2024-11-18 02:12:50.270681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.270789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.270864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.270891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.270971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.271090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.271117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.271196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.271304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.271336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.271423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.271506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.271533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.271642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.271724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.271753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.271835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.271919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.271945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.272059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.272143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.272169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.272254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.272345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.272372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.272455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.272538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.272564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.272646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.272725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.272750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.272885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.272966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.272992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.273102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.273185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.273211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.273329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.273420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.273446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.273527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.273644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.273670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.273756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.273898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.273923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.274010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.274092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.274121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.274233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.274322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.274350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.274439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.274553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.274581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.274662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.274768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.274794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.274900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.274981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.275007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.275087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.275198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.275225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.275334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.275414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.275440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.275529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.275611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.275638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.275747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.275825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.275850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.275932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.276014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.276039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.276141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.276219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.276244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.276385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.276472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.276498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.276587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.276663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.937 [2024-11-18 02:12:50.276688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.937 qpair failed and we were unable to recover it. 00:30:15.937 [2024-11-18 02:12:50.276774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.276887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.276913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.276994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.277100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.277126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.277216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.277353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.277380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.277459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.277542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.277570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.277656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.277733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.277759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.277853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.277974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.278001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.278092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.278169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.278195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.278286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.278376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.278403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.278485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.278625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.278651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.278732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.278814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.278840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.278923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.279035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.279062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.279142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.279219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.279244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.279332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.279418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.279443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.279537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.279617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.279642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.279721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.279804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.279829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.279937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.280023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.280049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.280134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.280247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.280273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.280375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.280482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.280507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.280624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.280734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.280759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.280837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.280945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.280971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.281112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.281195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.281220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.281302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.281391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.281418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.281509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.281588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.281615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.281697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.281783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.281811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.281894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.281976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.282001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.282081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.282170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.282196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.282280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.282363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.282390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.282506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.282586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.282613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.938 qpair failed and we were unable to recover it. 00:30:15.938 [2024-11-18 02:12:50.282729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.282807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.938 [2024-11-18 02:12:50.282833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.282919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.282999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.283024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.283167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.283306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.283339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.283424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.283498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.283523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.283602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.283688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.283714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.283803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.283887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.283913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.283992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.284116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.284141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.284225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.284304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.284367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.284451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.284531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.284557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.284684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.284765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.284790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.284872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.284951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.284977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.285086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.285224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.285250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.285334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.285442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.285467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.285577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.285696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.285723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.285834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.285940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.285966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.286047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.286128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.286155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.286239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.286334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.286360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.286474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.286553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.286579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.286656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.286771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.286797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.286895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.287003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.287029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.287135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.287216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.287241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.287323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.287404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.287431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.287521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.287600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.287626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.287737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.287819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.287845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.287921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.287997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.939 [2024-11-18 02:12:50.288023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.939 qpair failed and we were unable to recover it. 00:30:15.939 [2024-11-18 02:12:50.288110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.288222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.288248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.288360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.288468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.288494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.288607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.288683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.288709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.288786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.288894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.288920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.289001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.289109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.289135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.289232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.289378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.289404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.289484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.289562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.289588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.289667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.289743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.289772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.289878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.289966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.289993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.290112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.290192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.290217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.290293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.290392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.290418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.290501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.290580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.290605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.290684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.290778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.290805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.290885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.290967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.290994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.291093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.291182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.291208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.291284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.291396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.291422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.291503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.291581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.291607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.291716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.291794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.291820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.291898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.291973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.291999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.292104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.292201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.292226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.292321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.292403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.292429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.292522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.292635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.292662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.292743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.292834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.292861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.292957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.293046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.293071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.293146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.293259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.293285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.293379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.293463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.293489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.293573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.293650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.293675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.293756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.293832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.293857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.940 qpair failed and we were unable to recover it. 00:30:15.940 [2024-11-18 02:12:50.293947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.940 [2024-11-18 02:12:50.294032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.941 [2024-11-18 02:12:50.294057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.941 qpair failed and we were unable to recover it. 00:30:15.941 [2024-11-18 02:12:50.294148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.941 [2024-11-18 02:12:50.294261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.941 [2024-11-18 02:12:50.294286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.941 qpair failed and we were unable to recover it. 00:30:15.941 [2024-11-18 02:12:50.294408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.941 [2024-11-18 02:12:50.294493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.941 [2024-11-18 02:12:50.294518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:15.941 qpair failed and we were unable to recover it. 00:30:16.217 [2024-11-18 02:12:50.294628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-18 02:12:50.294744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-18 02:12:50.294771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.217 qpair failed and we were unable to recover it. 00:30:16.217 [2024-11-18 02:12:50.294853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-18 02:12:50.294965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-18 02:12:50.294991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.217 qpair failed and we were unable to recover it. 00:30:16.217 [2024-11-18 02:12:50.295084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-18 02:12:50.295163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-18 02:12:50.295188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.217 qpair failed and we were unable to recover it. 00:30:16.217 [2024-11-18 02:12:50.295263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-18 02:12:50.295350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-18 02:12:50.295379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.217 qpair failed and we were unable to recover it. 00:30:16.217 [2024-11-18 02:12:50.295471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-18 02:12:50.295558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-18 02:12:50.295584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.217 qpair failed and we were unable to recover it. 00:30:16.217 [2024-11-18 02:12:50.295670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.295749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.295774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.295868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.295973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.296001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.296081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.296163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.296189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.296264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.296351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.296376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.296454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.296539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.296564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.296641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.296719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.296744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.296854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.296933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.296958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.297069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.297148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.297173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.297256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.297342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.297373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.297462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.297543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.297570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.297687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.297765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.297790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.297897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.298005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.298033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.298116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.298199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.298225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.298316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.298423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.298448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.298535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.298650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.298677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.298760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.298871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.298898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.298982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.299068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.299094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.299169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.299250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.299276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.299383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.299495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.299525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.299634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.299720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.299745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.299822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.299909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.299935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.300014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.300099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.300124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.300202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.300279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.300304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.300394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.300477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.300504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.300619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.300704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.300730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.300810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.300884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.300910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.300991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.301068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.301094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.301167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.301245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.301271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.218 qpair failed and we were unable to recover it. 00:30:16.218 [2024-11-18 02:12:50.301367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.218 [2024-11-18 02:12:50.301453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.301484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.301569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.301676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.301702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.301810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.301892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.301924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.302010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.302088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.302115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.302194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.302270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.302296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.302403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.302485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.302510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.302592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.302737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.302762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.302874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.302957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.302983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.303091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.303174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.303200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.303288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.303382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.303408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.303489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.303566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.303595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.303705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.303791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.303816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.303900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.304006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.304032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.304114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.304194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.304221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.304299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.304446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.304472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.304557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.304636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.304664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.304785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.304865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.304891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.304974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.305046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.305071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.305218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.305302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.305335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.305421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.305565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.305590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.305719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.305826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.305852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.305964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.306075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.306101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.306183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.306298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.306331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.306415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.306525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.306550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.306626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.306707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.306732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.306819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.306900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.306926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.307009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.307117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.307142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.307233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.307320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.307347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.219 [2024-11-18 02:12:50.307457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.307547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.219 [2024-11-18 02:12:50.307574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.219 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.307665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.307741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.307766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.307874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.307954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.307979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.308077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.308161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.308187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.308266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.308341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.308368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.308453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.308559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.308585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.308658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.308739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.308765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.308885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.308963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.308988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.309071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.309179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.309205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.309294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.309382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.309408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.309484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.309565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.309590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.309675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.309786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.309813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.309927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.310030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.310056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.310175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.310260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.310286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.310402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.310495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.310524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.310639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.310715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.310741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.310856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.310937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.310962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.311047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.311134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.311159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.311245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.311383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.311409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.311488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.311571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.311596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.311678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.311762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.311788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.311902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.311987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.312012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.312097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.312177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.312204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.312293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.312421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.312447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.312532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.312609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.312634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.312715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.312791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.312816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.312928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.313031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.313056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.313135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.313242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.313267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.220 qpair failed and we were unable to recover it. 00:30:16.220 [2024-11-18 02:12:50.313356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.220 [2024-11-18 02:12:50.313436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.313461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.313543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.313622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.313649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.313726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.313819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.313845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.313926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.314064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.314090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.314178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.314258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.314284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.314387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.314465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.314490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.314569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.314649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.314676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.314754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.314863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.314888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.314976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.315082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.315108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.315193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.315301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.315338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.315423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.315503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.315528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.315608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.315712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.315737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.315823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.315903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.315928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.316005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.316082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.316108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.316188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.316266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.316291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.316416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.316509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.316538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.316652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.316763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.316788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.316882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.316953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.316979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.317071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.317149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.317175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.317249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.317337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.317365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.317451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.317566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.317592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.317699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.317775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.317801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.317878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.317963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.317989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.318063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.318140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.318166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.318238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.318319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.318345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.318425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.318619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.318645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.318755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.318836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.318862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.319051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.319149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.319174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.221 [2024-11-18 02:12:50.319258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.319341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.221 [2024-11-18 02:12:50.319368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.221 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.319448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.319524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.319550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.319630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.319816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.319842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.319991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.320070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.320096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.320177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.320251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.320277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.320376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.320471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.320497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.320577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.320687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.320713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.320792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.320871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.320896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.320976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.321084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.321109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.321189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.321318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.321345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.321431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.321512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.321538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.321616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.321726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.321751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.321858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.321937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.321963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.322039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.322110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.322137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.322219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.322335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.322361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.322442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.322522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.322548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.322623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.322713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.322738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.322820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.322901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.322931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.323020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.323098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.323124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.323209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.323283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.323309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.323402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.323481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.323507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.323588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.323707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.323732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.323840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.323919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.323944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.324053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.324145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.324171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.324248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.324322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.222 [2024-11-18 02:12:50.324348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.222 qpair failed and we were unable to recover it. 00:30:16.222 [2024-11-18 02:12:50.324433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.324521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.324546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.324654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.324742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.324768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.324857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.324974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.325000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.325087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.325175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.325201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.325324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.325450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.325475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.325556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.325638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.325664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.325739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.325824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.325849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.325933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.326012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.326038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.326122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.326198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.326223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.326329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.326412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.326438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.326515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.326596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.326621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.326698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.326834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.326859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.326940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.327027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.327053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.327139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.327262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.327288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.327393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.327468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.327494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.327580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.327664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.327691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.327770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.327884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.327910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.327988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.328093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.328118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.328192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.328279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.328304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.328394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.328470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.328496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.328582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.328662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.328688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.328790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.328898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.328924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.328997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.329076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.329102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.329192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.329269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.329294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.329387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.329467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.329493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.329601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.329680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.329705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.329782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.329886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.329912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.329993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.330073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.330098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.223 qpair failed and we were unable to recover it. 00:30:16.223 [2024-11-18 02:12:50.330188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.330329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.223 [2024-11-18 02:12:50.330356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.330435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.330515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.330540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.330658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.330763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.330788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.330877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.330990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.331016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.331104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.331182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.331208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.331287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.331373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.331399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.331484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.331559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.331584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.331663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.331739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.331764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.331845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.331923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.331948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.332024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.332160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.332186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.332299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.332388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.332413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.332493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.332571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.332597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.332688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.332774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.332799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.332885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.332967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.332992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.333072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.333158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.333183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.333292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.333373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.333403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.333484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.333562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.333587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.333667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.333740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.333765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.333849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.333929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.333956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.334040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.334119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.334144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.334224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.334339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.334366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.334455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.334530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.334556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.334636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.334747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.334773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.334860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.334980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.335005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.335087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.335199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.335225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.335338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.335423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.335450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.335539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.335649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.335674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.335759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.335874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.335900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.336010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.336084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.224 [2024-11-18 02:12:50.336109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.224 qpair failed and we were unable to recover it. 00:30:16.224 [2024-11-18 02:12:50.336216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.336300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.336333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.336423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.336504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.336530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.336617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.336688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.336714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.336820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.336904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.336930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.337007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.337085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.337111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.337190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.337278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.337303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.337428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.337510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.337536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.337616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.337700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.337725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.337807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.337885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.337910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.337983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.338058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.338083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.338171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.338242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.338268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.338355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.338436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.338462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.338549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.338624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.338649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.338759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.338834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.338860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.338942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.339018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.339043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.339116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.339224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.339250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.339337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.339422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.339448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.339538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.339616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.339642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.339723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.339798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.339824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.339901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.340011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.340037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.340173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.340287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.340317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.340405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.340488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.340515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.340595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.340714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.340740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.340820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.340904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.340934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.341042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.341124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.341149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.341229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.341338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.341364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.341442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.341554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.341580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.341691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.341779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.341805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.225 [2024-11-18 02:12:50.341878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.341952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.225 [2024-11-18 02:12:50.341978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.225 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.342059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.342133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.342159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.342242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.342323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.342349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.342427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.342504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.342529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.342670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.342744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.342769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.342881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.342998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.343023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.343114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.343197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.343222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.343334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.343452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.343477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.343590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.343671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.343698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.343790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.343869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.343898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.344013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.344123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.344148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.344234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.344314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.344340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.344424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.344499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.344524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.344640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.344716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.344746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.344861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.344938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.344963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.345043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.345137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.345161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.345244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.345325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.345352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.345443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.345520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.345545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.345652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.345731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.345756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.345833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.345915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.345945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.346021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.346107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.346132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.346213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.346307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.346345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.346436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.346540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.346566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.346644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.346720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.346744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.346831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.346903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.346928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.226 qpair failed and we were unable to recover it. 00:30:16.226 [2024-11-18 02:12:50.347006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.226 [2024-11-18 02:12:50.347082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.347109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.347186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.347301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.347333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.347410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.347497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.347523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.347601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.347678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.347703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.347840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.347922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.347947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.348034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.348110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.348136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.348244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.348342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.348368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.348451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.348559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.348584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.348662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.348745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.348771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.348887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.348969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.348994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.349074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.349150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.349175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.349283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.349368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.349395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.349507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.349596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.349621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.349699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.349804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.349829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.349919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.349997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.350022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.350105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.350186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.350211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.350301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.350383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.350408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.350502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.350576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.350601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.227 [2024-11-18 02:12:50.350707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.350795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.227 [2024-11-18 02:12:50.350821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.227 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.350905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.351013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.351039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.351124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.351239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.351264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.351350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.351429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.351454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.351533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.351690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.351715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.351826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.351901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.351926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.352009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.352086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.352111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.352188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.352306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.352338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.352425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.352509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.352534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.352652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.352760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.352785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.352864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.352942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.352968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.353047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.353150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.353176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.353250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.353327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.353354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.353438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.353523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.353548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.353659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.353737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.353763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.353871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.353988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.354013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.354098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.354183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.354209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.354286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.354379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.354406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.354489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.354575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.354601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.354681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.354785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.354811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.354889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.354969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.354996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.355114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.355192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.355217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.355304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.355390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.355415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.355525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.355605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.355634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.355728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.355838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.355863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.355945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.356054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.228 [2024-11-18 02:12:50.356079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.228 qpair failed and we were unable to recover it. 00:30:16.228 [2024-11-18 02:12:50.356162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.356240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.356265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.356351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.356437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.356467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.356545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.356621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.356646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.356726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.356800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.356825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.356903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.356980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.357006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.357087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.357197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.357222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.357308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.357402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.357428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.357520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.357596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.357622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.357708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.357822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.357846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.357931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.358009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.358035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.358117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.358192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.358218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.358301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.358397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.358423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.358505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.358597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.358622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.358717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.358833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.358858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.358937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.359014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.359039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.359118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.359195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.359220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.359335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.359419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.359446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.359524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.359612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.359637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.359722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.359834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.359861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.359941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.360050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.360075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.360153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.360262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.360288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.360386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.360464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.229 [2024-11-18 02:12:50.360489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.229 qpair failed and we were unable to recover it. 00:30:16.229 [2024-11-18 02:12:50.360579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.360660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.360685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.360772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.360884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.360910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.360993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.361100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.361126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.361203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.361285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.361315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.361395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.361472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.361497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.361570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.361644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.361669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.361746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.361835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.361861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.361956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.362034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.362060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.362143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.362232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.362257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.362351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.362458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.362484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.362560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.362668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.362693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.362774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.362855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.362880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.362967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.363058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.363083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.363172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.363255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.363280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.363392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.363469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.363494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 02:12:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:16.230 [2024-11-18 02:12:50.363580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.363662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.363688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 02:12:50 -- common/autotest_common.sh@862 -- # return 0 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.363774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 02:12:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:16.230 [2024-11-18 02:12:50.363852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.363877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.363961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 02:12:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:16.230 [2024-11-18 02:12:50.364038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.364063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 02:12:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.230 [2024-11-18 02:12:50.364152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.364234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.364260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.364379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.364465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.364495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.364569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.364677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.364702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.364783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.364861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.230 [2024-11-18 02:12:50.364886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.230 qpair failed and we were unable to recover it. 00:30:16.230 [2024-11-18 02:12:50.364970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.365049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.365074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.365193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.365280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.365305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.365394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.365476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.365501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.365591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.365675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.365702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.365781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.365856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.365881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.365990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.366066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.366092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.366180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.366255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.366280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.366379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.366463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.366489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.366587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.366671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.366697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.366782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.366860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.366885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.366977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.367054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.367081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.367172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.367286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.367328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.367414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.367496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.367523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.367639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.367743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.367769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.367849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.367931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.367957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.368067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.368157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.368182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.368260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.368348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.368373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.368487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.368567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.368592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.368689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.368770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.368796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.368884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.368961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.368987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.231 qpair failed and we were unable to recover it. 00:30:16.231 [2024-11-18 02:12:50.369069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.231 [2024-11-18 02:12:50.369152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.369179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.369290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.369373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.369400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.369487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.369571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.369597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.369677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.369763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.369789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.369865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.369940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.369965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.370044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.370124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.370151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.370265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.370379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.370405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.370488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.370565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.370591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.370683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.370777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.370818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.370907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.371012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.371040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.371121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.371207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.371233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.371318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.371421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.371448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.371539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.371612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.371640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.371721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.371813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.371839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.371933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.372043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.372069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.372150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.372261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.372289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3004000b90 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.372380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.372469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.372495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.372577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.372660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.372685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.372778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.372865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.372892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.373007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.373112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.373137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.373215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.373294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.232 [2024-11-18 02:12:50.373326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.232 qpair failed and we were unable to recover it. 00:30:16.232 [2024-11-18 02:12:50.373405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.373486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.373511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.373590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.373682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.373708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.373798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.373883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.373909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.373994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.374106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.374130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.374205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.374323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.374350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.374427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.374506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.374531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.374624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.374724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.374750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.374836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.374913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.374951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.375031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.375115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.375140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.375253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.375341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.375369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.375481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.375563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.375589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.375668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.375748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.375773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.375866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.375953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.375978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.376073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.376156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.376181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.376292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.376404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.376430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.376507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.376615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.376641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.376723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.376814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.376839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.376931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.377005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.377035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.377138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.377213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.377238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.377335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.377411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.377437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.233 qpair failed and we were unable to recover it. 00:30:16.233 [2024-11-18 02:12:50.377517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.233 [2024-11-18 02:12:50.377592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.377630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.377712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.377791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.377826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.377945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.378024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.378049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.378130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.378237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.378262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.378370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.378450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.378476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.378555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.378641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.378666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.378767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.378852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.378880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.378955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.379039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.379065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.379167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.379248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.379273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.379386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.379464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.379490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.379567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.379648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.379674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.379754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.379837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.379863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.379951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.380035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.380060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.380138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.380219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.380244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.380350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.380426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.380452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.380529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.380676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.380702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.380780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.380865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.380891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.380971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.381082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.381108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.381193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.381271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.381297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.381383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.381469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.381495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.381575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.381685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.381711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.234 [2024-11-18 02:12:50.381827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.381936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.234 [2024-11-18 02:12:50.381961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.234 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.382042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 02:12:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:16.235 [2024-11-18 02:12:50.382125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.382150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.382231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 02:12:50 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:16.235 [2024-11-18 02:12:50.382316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.382342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 02:12:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:16.235 [2024-11-18 02:12:50.382419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.382496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 02:12:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.235 [2024-11-18 02:12:50.382523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.382602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.382688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.382714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.382791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.382898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.382923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.383010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.383101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.383127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.383239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.383344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.383371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.383459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.383542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.383567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.383657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.383777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.383803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.383922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.383998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.384023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.384102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.384208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.384239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.384331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.384439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.384464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.384553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.384635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.384661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.384738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.384813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.384838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.384913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.385002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.385027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.385104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.385177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.385207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.385331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.385410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.385435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.385515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.385596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.385622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.385705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.385775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.385800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.385912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.386021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.386047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.235 qpair failed and we were unable to recover it. 00:30:16.235 [2024-11-18 02:12:50.386135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.235 [2024-11-18 02:12:50.386211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.386236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.386324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.386406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.386432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.386509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.386583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.386609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.386686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.386768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.386793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.386875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.386987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.387013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.387090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.387173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.387198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.387287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.387374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.387400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.387487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.387571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.387597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.387676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.387757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.387782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.387862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.387952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.387978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.388057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.388139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.388166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.388272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.388367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.388394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.388479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.388555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.388581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.388664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.388743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.388769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.388845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.388926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.388962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.389042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.389117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.389143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.389228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.389323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.389360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.389447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.389551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.389577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.389676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.389788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.389813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.389893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.390002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.390027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.390137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.390218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.390245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.390330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.390406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.390432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.390545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.390649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.390675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.390750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.390868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.390894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.390984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.391059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.391085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.236 qpair failed and we were unable to recover it. 00:30:16.236 [2024-11-18 02:12:50.391166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.236 [2024-11-18 02:12:50.391279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.391304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16ee390 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.391355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16fbe00 (9): Bad file descriptor 00:30:16.237 [2024-11-18 02:12:50.391480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.391578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.391610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.391708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.391787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.391813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.391958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.392050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.392076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.392155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.392232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.392259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.392359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.392474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.392501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.392594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.392677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.392714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.392789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.392872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.392899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.392979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.393083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.393109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.393189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.393268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.393295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.393401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.393484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.393511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.393607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.393704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.393731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.393816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.393904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.393931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.394047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.394139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.394165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.394246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.394359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.394387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.394467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.394552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.394578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.394707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.394790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.394816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.394906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.394979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.395005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.395092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.395175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.395202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.395278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.395375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.395402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.395481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.395569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.395596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.395701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.395791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.395817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.395940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.396027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.237 [2024-11-18 02:12:50.396053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.237 qpair failed and we were unable to recover it. 00:30:16.237 [2024-11-18 02:12:50.396134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.396278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.396305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.396401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.396494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.396520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.396604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.396685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.396711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.396825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.396911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.396938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.397018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.397131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.397158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.397245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.397340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.397367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.397451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.397543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.397570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.397655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.397746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.397772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.397876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.397954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.397980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.398058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.398141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.398168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.398287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.398383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.398410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.398496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.398585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.398612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.398708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.398797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.398824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.398914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.399031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.399058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.399140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.399226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.399252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.399357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.399437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.399463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.399548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.399629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.399663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.399780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.399861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.399888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.399973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.400050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.400076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.238 [2024-11-18 02:12:50.400158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.400249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.238 [2024-11-18 02:12:50.400277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.238 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.400379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.400494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.400520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.400610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.400730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.400756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.400841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.400924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.400952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.401075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.401155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.401181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.401265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.401359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.401387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.401470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.401545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.401571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.401655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.401774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.401800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.401878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.401963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.401990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.402080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.402175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.402202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.402290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.402395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.402422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.402530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.402642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.402668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.402758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.402848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.402883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.402964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.403057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.403083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.403174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.403271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.403299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.403411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.403488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.403514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.403633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.403722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.403749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.403864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.403945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.403971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.404066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.404150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.404177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.404265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.404361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.404389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.404472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.404555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.239 [2024-11-18 02:12:50.404582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.239 qpair failed and we were unable to recover it. 00:30:16.239 [2024-11-18 02:12:50.404704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.404816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.404842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.404952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.405039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.405065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.405155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.405239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.405265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.405382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.405467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.405494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.405572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.405691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.405718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.405808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.405897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.405923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.406015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.406107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.406134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.406245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.406344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.406372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.406501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.406584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.406610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.406699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.406778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.406803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.406891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.406973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.407000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.407093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.407169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.407195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.407276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.407376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.407404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 Malloc0 00:30:16.240 [2024-11-18 02:12:50.407483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.407577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.407604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.407691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.407774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.407800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 02:12:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.407895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.407981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 02:12:50 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:16.240 [2024-11-18 02:12:50.408008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 02:12:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:16.240 [2024-11-18 02:12:50.408120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.408207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 02:12:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.240 [2024-11-18 02:12:50.408233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.408335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.408417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.408454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.408537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.408629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.408655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.240 [2024-11-18 02:12:50.408737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.408814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.240 [2024-11-18 02:12:50.408840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.240 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.408952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.409038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.409065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.409148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.409240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.409267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.409360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.409455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.409482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.409563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.409689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.409715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.409798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.409880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.409907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.410002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.410085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.410112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.410227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.410331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.410362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.410447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.410534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.410562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.410650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.410738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.410764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.410880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.411025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.411051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.411160] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:16.241 [2024-11-18 02:12:50.411167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.411272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.411296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.411382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.411460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.411485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.411567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.411658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.411695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.411806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.411919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.411945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.412027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.412105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.412131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.412243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.412339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.412367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.412457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.412539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.412565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.412650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.412735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.412765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.412871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.412951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.412977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.413061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.413145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.413171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.413251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.413374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.413402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.413494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.413575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.413601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.241 qpair failed and we were unable to recover it. 00:30:16.241 [2024-11-18 02:12:50.413718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.413805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.241 [2024-11-18 02:12:50.413831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.413922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.414031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.414057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.414170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.414265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.414291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.414383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.414464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.414491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.414585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.414667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.414692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.414786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.414863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.414894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.414983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.415061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.415087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.415172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.415262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.415287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.415394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.415520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.415551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.415715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.415800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.415828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.415920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.416005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.416032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.416122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.416207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.416233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.416360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.416440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.416466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.416551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.416668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.416695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.416790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.416876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.416902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.416990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.417071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.417102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.417218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.417297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.417328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.417418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.417505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.417531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.417626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.417702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.417728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.417839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.417917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.417943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.418028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.418115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.418140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.418256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.418344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.418371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.418463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.418552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.418577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.418663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.418744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.418770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.418882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.418989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.419014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.419104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.419214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.419240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.419339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 02:12:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:16.242 [2024-11-18 02:12:50.419416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.419442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 [2024-11-18 02:12:50.419522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 02:12:50 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:16.242 [2024-11-18 02:12:50.419600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 [2024-11-18 02:12:50.419626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.242 qpair failed and we were unable to recover it. 00:30:16.242 02:12:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:16.242 [2024-11-18 02:12:50.419708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.242 02:12:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.243 [2024-11-18 02:12:50.419819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.419845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.419963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.420051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.420077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.420168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.420278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.420304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.420401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.420482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.420509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.420591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.420671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.420697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.420776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.420857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.420883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.421025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.421107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.421133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.421229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.421341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.421368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.421448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.421529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.421555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.421677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.421789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.421815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.421899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.421977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.422004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.422110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.422219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.422245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.422340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.422421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.422447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.422535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.422625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.422651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.422760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.422842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.422869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.422953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.423031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.423057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.423138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.423221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.423247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.423356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.423471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.423497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.423586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.423663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.423689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.423775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.423885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.423911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.423993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.424072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.424098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.424190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.424271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.424297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.424395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.424476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.424502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.424610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.424696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.424722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.424836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.424916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.424941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.425050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.425163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.425188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.243 [2024-11-18 02:12:50.425264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.425341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.243 [2024-11-18 02:12:50.425368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.243 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.425469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.425545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.425571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.425661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.425745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.425773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.425882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.425958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.425985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.426070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.426192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.426218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.426333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.426417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.426444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.426547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.426628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.426654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.426739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.426826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.426851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.426933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.427016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.427041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.427150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.427232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.427258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.427379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.427470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 02:12:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:16.244 [2024-11-18 02:12:50.427496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.427590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 02:12:50 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:16.244 [2024-11-18 02:12:50.427680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.427707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 02:12:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:16.244 [2024-11-18 02:12:50.427790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.427873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 02:12:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.244 [2024-11-18 02:12:50.427898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.427978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.428057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.428083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.428188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.428272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.428298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.428404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.428485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.428511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.428590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.428669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.428694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.428775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.428859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.428885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.428960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.429036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.429062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.429143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.429221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.429247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.429339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.429457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.429489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.429571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.429673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.429698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.429786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.429864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.429891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.429982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.430063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.430088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.244 [2024-11-18 02:12:50.430206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.430323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.244 [2024-11-18 02:12:50.430350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.244 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.430431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.430565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.430590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ffc000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.430675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.430759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.430788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.430883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.430967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.430993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.431075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.431183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.431209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.431335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.431418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.431445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.431529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.431622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.431654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.431738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.431820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.431846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.431937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.432025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.432051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.432138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.432245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.432271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.432395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.432480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.432507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.432661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.432779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.432806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.432923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.433022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.433051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.433133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.433216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.433242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.433337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.433417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.433444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.433527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.433616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.433642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.433720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.433791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.433817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.433908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.433987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.434013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.434093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.434167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.434193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.434288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.434374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.434400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.434478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.434561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.434586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.434699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.434806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.434831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.434944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.435033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.435059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.435139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.435222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.435248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.435340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.435429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.435456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 02:12:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:16.245 [2024-11-18 02:12:50.435540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 02:12:50 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:16.245 [2024-11-18 02:12:50.435647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.435674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 qpair failed and we were unable to recover it. 00:30:16.245 [2024-11-18 02:12:50.435759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 02:12:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:16.245 [2024-11-18 02:12:50.435843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.245 [2024-11-18 02:12:50.435870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.245 02:12:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.435980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.436066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.436092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.436175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.436255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.436282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.436369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.436458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.436483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.436569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.436649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.436675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.436787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.436899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.436924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.437006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.437083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.437109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.437197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.437307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.437338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.437426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.437506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.437532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.437626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.437766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.437792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.437877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.437988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.438014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.438093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.438199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.438225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.438305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.438470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.438497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.438580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.438658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.438684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.438767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.438853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.438880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.438997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.439075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.439101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.439211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.439289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.246 [2024-11-18 02:12:50.439324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ff8000b90 with addr=10.0.0.2, port=4420 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.439412] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:16.246 [2024-11-18 02:12:50.441833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.246 [2024-11-18 02:12:50.441931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.246 [2024-11-18 02:12:50.441959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.246 [2024-11-18 02:12:50.441974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.246 [2024-11-18 02:12:50.441987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.246 [2024-11-18 02:12:50.442021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 02:12:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:16.246 02:12:50 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:16.246 02:12:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:16.246 02:12:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.246 02:12:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:16.246 [2024-11-18 02:12:50.451679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.246 02:12:50 -- host/target_disconnect.sh@58 -- # wait 1336912 00:30:16.246 [2024-11-18 02:12:50.451769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.246 [2024-11-18 02:12:50.451799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.246 [2024-11-18 02:12:50.451816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.246 [2024-11-18 02:12:50.451828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.246 [2024-11-18 02:12:50.451860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.461725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.246 [2024-11-18 02:12:50.461813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.246 [2024-11-18 02:12:50.461841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.246 [2024-11-18 02:12:50.461855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.246 [2024-11-18 02:12:50.461868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.246 [2024-11-18 02:12:50.461898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.471815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.246 [2024-11-18 02:12:50.471904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.246 [2024-11-18 02:12:50.471930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.246 [2024-11-18 02:12:50.471944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.246 [2024-11-18 02:12:50.471957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.246 [2024-11-18 02:12:50.471987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.246 qpair failed and we were unable to recover it. 00:30:16.246 [2024-11-18 02:12:50.481758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.246 [2024-11-18 02:12:50.481846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.246 [2024-11-18 02:12:50.481876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.246 [2024-11-18 02:12:50.481891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.246 [2024-11-18 02:12:50.481904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.247 [2024-11-18 02:12:50.481934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.247 qpair failed and we were unable to recover it. 00:30:16.247 [2024-11-18 02:12:50.491828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.247 [2024-11-18 02:12:50.491917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.247 [2024-11-18 02:12:50.491949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.247 [2024-11-18 02:12:50.491964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.247 [2024-11-18 02:12:50.491977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.247 [2024-11-18 02:12:50.492007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.247 qpair failed and we were unable to recover it. 00:30:16.247 [2024-11-18 02:12:50.501749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.247 [2024-11-18 02:12:50.501834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.247 [2024-11-18 02:12:50.501861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.247 [2024-11-18 02:12:50.501875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.247 [2024-11-18 02:12:50.501888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.247 [2024-11-18 02:12:50.501917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.247 qpair failed and we were unable to recover it. 00:30:16.247 [2024-11-18 02:12:50.511760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.247 [2024-11-18 02:12:50.511853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.247 [2024-11-18 02:12:50.511880] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.247 [2024-11-18 02:12:50.511894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.247 [2024-11-18 02:12:50.511907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.247 [2024-11-18 02:12:50.511938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.247 qpair failed and we were unable to recover it. 00:30:16.247 [2024-11-18 02:12:50.521917] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.247 [2024-11-18 02:12:50.522053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.247 [2024-11-18 02:12:50.522080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.247 [2024-11-18 02:12:50.522094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.247 [2024-11-18 02:12:50.522106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.247 [2024-11-18 02:12:50.522137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.247 qpair failed and we were unable to recover it. 00:30:16.247 [2024-11-18 02:12:50.531862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.247 [2024-11-18 02:12:50.531948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.247 [2024-11-18 02:12:50.531974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.247 [2024-11-18 02:12:50.531988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.247 [2024-11-18 02:12:50.532007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.247 [2024-11-18 02:12:50.532038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.247 qpair failed and we were unable to recover it. 00:30:16.247 [2024-11-18 02:12:50.541893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.247 [2024-11-18 02:12:50.541972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.247 [2024-11-18 02:12:50.541999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.247 [2024-11-18 02:12:50.542013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.247 [2024-11-18 02:12:50.542026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.247 [2024-11-18 02:12:50.542067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.247 qpair failed and we were unable to recover it. 00:30:16.247 [2024-11-18 02:12:50.551917] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.247 [2024-11-18 02:12:50.552036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.247 [2024-11-18 02:12:50.552062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.247 [2024-11-18 02:12:50.552076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.247 [2024-11-18 02:12:50.552089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.247 [2024-11-18 02:12:50.552119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.247 qpair failed and we were unable to recover it. 00:30:16.247 [2024-11-18 02:12:50.561916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.247 [2024-11-18 02:12:50.562000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.247 [2024-11-18 02:12:50.562027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.247 [2024-11-18 02:12:50.562041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.247 [2024-11-18 02:12:50.562054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.247 [2024-11-18 02:12:50.562083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.247 qpair failed and we were unable to recover it. 00:30:16.247 [2024-11-18 02:12:50.572013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.247 [2024-11-18 02:12:50.572102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.247 [2024-11-18 02:12:50.572129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.247 [2024-11-18 02:12:50.572143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.247 [2024-11-18 02:12:50.572156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.247 [2024-11-18 02:12:50.572186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.247 qpair failed and we were unable to recover it. 00:30:16.247 [2024-11-18 02:12:50.582002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.247 [2024-11-18 02:12:50.582099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.247 [2024-11-18 02:12:50.582129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.247 [2024-11-18 02:12:50.582145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.247 [2024-11-18 02:12:50.582159] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.247 [2024-11-18 02:12:50.582190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.247 qpair failed and we were unable to recover it. 00:30:16.247 [2024-11-18 02:12:50.592076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.247 [2024-11-18 02:12:50.592191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.247 [2024-11-18 02:12:50.592218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.247 [2024-11-18 02:12:50.592232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.247 [2024-11-18 02:12:50.592244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.247 [2024-11-18 02:12:50.592274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.247 qpair failed and we were unable to recover it. 00:30:16.509 [2024-11-18 02:12:50.602070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.509 [2024-11-18 02:12:50.602163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.509 [2024-11-18 02:12:50.602190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.509 [2024-11-18 02:12:50.602206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.509 [2024-11-18 02:12:50.602220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.510 [2024-11-18 02:12:50.602265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.612067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.612159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.612185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.612200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.612213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.510 [2024-11-18 02:12:50.612243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.622093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.622178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.622207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.622222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.622241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.510 [2024-11-18 02:12:50.622272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.632225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.632325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.632355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.632369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.632381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.510 [2024-11-18 02:12:50.632413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.642169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.642260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.642287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.642302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.642327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.510 [2024-11-18 02:12:50.642359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.652260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.652389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.652416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.652430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.652442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.510 [2024-11-18 02:12:50.652473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.662205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.662296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.662329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.662348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.662360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ff8000b90 00:30:16.510 [2024-11-18 02:12:50.662390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.672262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.672373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.672408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.672428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.672441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.510 [2024-11-18 02:12:50.672475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.682279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.682372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.682399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.682413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.682426] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.510 [2024-11-18 02:12:50.682457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.692323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.692416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.692444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.692458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.692471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.510 [2024-11-18 02:12:50.692503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.702344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.702432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.702459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.702473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.702486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.510 [2024-11-18 02:12:50.702518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.712529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.712652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.712678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.712699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.712713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.510 [2024-11-18 02:12:50.712743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.722408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.722503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.722533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.722547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.722561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.510 [2024-11-18 02:12:50.722592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.510 [2024-11-18 02:12:50.732533] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.510 [2024-11-18 02:12:50.732638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.510 [2024-11-18 02:12:50.732664] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.510 [2024-11-18 02:12:50.732678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.510 [2024-11-18 02:12:50.732691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.510 [2024-11-18 02:12:50.732735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.510 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.742454] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.742581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.742607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.742622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.742634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.742665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.752600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.752693] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.752720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.752734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.752747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.752775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.762610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.762741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.762768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.762782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.762795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.762837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.772560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.772644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.772674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.772693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.772706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.772738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.782569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.782666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.782692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.782707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.782720] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.782750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.792625] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.792713] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.792739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.792753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.792766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.792796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.802615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.802704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.802730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.802751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.802764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.802796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.812653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.812741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.812767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.812780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.812793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.812823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.822687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.822771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.822797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.822811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.822825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.822856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.832837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.832968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.832993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.833007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.833020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.833049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.842790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.842879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.842905] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.842919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.842931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.842962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.852863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.852955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.852981] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.852995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.853008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.853038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.862825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.511 [2024-11-18 02:12:50.862909] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.511 [2024-11-18 02:12:50.862935] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.511 [2024-11-18 02:12:50.862949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.511 [2024-11-18 02:12:50.862961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.511 [2024-11-18 02:12:50.862990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.511 qpair failed and we were unable to recover it. 00:30:16.511 [2024-11-18 02:12:50.872883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.512 [2024-11-18 02:12:50.872998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.512 [2024-11-18 02:12:50.873023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.512 [2024-11-18 02:12:50.873037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.512 [2024-11-18 02:12:50.873050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.512 [2024-11-18 02:12:50.873080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.512 qpair failed and we were unable to recover it. 00:30:16.512 [2024-11-18 02:12:50.882969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.512 [2024-11-18 02:12:50.883056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.512 [2024-11-18 02:12:50.883082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.512 [2024-11-18 02:12:50.883096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.512 [2024-11-18 02:12:50.883108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.512 [2024-11-18 02:12:50.883139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.512 qpair failed and we were unable to recover it. 00:30:16.512 [2024-11-18 02:12:50.892904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.512 [2024-11-18 02:12:50.892993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.512 [2024-11-18 02:12:50.893024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.512 [2024-11-18 02:12:50.893039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.512 [2024-11-18 02:12:50.893052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.512 [2024-11-18 02:12:50.893080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.512 qpair failed and we were unable to recover it. 00:30:16.512 [2024-11-18 02:12:50.903037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.512 [2024-11-18 02:12:50.903168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.512 [2024-11-18 02:12:50.903194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.512 [2024-11-18 02:12:50.903208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.512 [2024-11-18 02:12:50.903221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.512 [2024-11-18 02:12:50.903263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.512 qpair failed and we were unable to recover it. 00:30:16.772 [2024-11-18 02:12:50.912975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.772 [2024-11-18 02:12:50.913069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.772 [2024-11-18 02:12:50.913096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.772 [2024-11-18 02:12:50.913110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.772 [2024-11-18 02:12:50.913123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.772 [2024-11-18 02:12:50.913153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.772 qpair failed and we were unable to recover it. 00:30:16.772 [2024-11-18 02:12:50.922972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.772 [2024-11-18 02:12:50.923067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.772 [2024-11-18 02:12:50.923093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.772 [2024-11-18 02:12:50.923107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.772 [2024-11-18 02:12:50.923120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.772 [2024-11-18 02:12:50.923150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.772 qpair failed and we were unable to recover it. 00:30:16.772 [2024-11-18 02:12:50.933041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:50.933124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:50.933149] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:50.933163] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:50.933176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:50.933212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:50.943038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:50.943119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:50.943148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:50.943163] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:50.943177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:50.943208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:50.953099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:50.953190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:50.953221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:50.953237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:50.953250] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:50.953280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:50.963099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:50.963192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:50.963219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:50.963233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:50.963245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:50.963275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:50.973215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:50.973352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:50.973380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:50.973394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:50.973408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:50.973437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:50.983159] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:50.983241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:50.983272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:50.983288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:50.983300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:50.983341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:50.993223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:50.993324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:50.993351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:50.993365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:50.993377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:50.993408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:51.003232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:51.003331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:51.003358] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:51.003372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:51.003384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:51.003413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:51.013240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:51.013333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:51.013360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:51.013374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:51.013386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:51.013415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:51.023291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:51.023413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:51.023438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:51.023452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:51.023465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:51.023501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:51.033440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:51.033533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:51.033559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:51.033573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:51.033586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:51.033629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:51.043338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:51.043425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:51.043450] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:51.043464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:51.043477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:51.043507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:51.053451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:51.053536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.773 [2024-11-18 02:12:51.053562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.773 [2024-11-18 02:12:51.053576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.773 [2024-11-18 02:12:51.053589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.773 [2024-11-18 02:12:51.053619] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.773 qpair failed and we were unable to recover it. 00:30:16.773 [2024-11-18 02:12:51.063386] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.773 [2024-11-18 02:12:51.063466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.774 [2024-11-18 02:12:51.063492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.774 [2024-11-18 02:12:51.063506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.774 [2024-11-18 02:12:51.063519] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.774 [2024-11-18 02:12:51.063550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.774 qpair failed and we were unable to recover it. 00:30:16.774 [2024-11-18 02:12:51.073429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.774 [2024-11-18 02:12:51.073524] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.774 [2024-11-18 02:12:51.073550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.774 [2024-11-18 02:12:51.073564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.774 [2024-11-18 02:12:51.073578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.774 [2024-11-18 02:12:51.073608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.774 qpair failed and we were unable to recover it. 00:30:16.774 [2024-11-18 02:12:51.083470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.774 [2024-11-18 02:12:51.083551] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.774 [2024-11-18 02:12:51.083576] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.774 [2024-11-18 02:12:51.083590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.774 [2024-11-18 02:12:51.083602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.774 [2024-11-18 02:12:51.083631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.774 qpair failed and we were unable to recover it. 00:30:16.774 [2024-11-18 02:12:51.093505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.774 [2024-11-18 02:12:51.093636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.774 [2024-11-18 02:12:51.093661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.774 [2024-11-18 02:12:51.093675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.774 [2024-11-18 02:12:51.093688] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.774 [2024-11-18 02:12:51.093717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.774 qpair failed and we were unable to recover it. 00:30:16.774 [2024-11-18 02:12:51.103523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.774 [2024-11-18 02:12:51.103648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.774 [2024-11-18 02:12:51.103673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.774 [2024-11-18 02:12:51.103687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.774 [2024-11-18 02:12:51.103700] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.774 [2024-11-18 02:12:51.103728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.774 qpair failed and we were unable to recover it. 00:30:16.774 [2024-11-18 02:12:51.113556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.774 [2024-11-18 02:12:51.113692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.774 [2024-11-18 02:12:51.113718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.774 [2024-11-18 02:12:51.113732] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.774 [2024-11-18 02:12:51.113750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.774 [2024-11-18 02:12:51.113780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.774 qpair failed and we were unable to recover it. 00:30:16.774 [2024-11-18 02:12:51.123647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.774 [2024-11-18 02:12:51.123741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.774 [2024-11-18 02:12:51.123767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.774 [2024-11-18 02:12:51.123781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.774 [2024-11-18 02:12:51.123793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.774 [2024-11-18 02:12:51.123836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.774 qpair failed and we were unable to recover it. 00:30:16.774 [2024-11-18 02:12:51.133669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.774 [2024-11-18 02:12:51.133754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.774 [2024-11-18 02:12:51.133780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.774 [2024-11-18 02:12:51.133794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.774 [2024-11-18 02:12:51.133807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.774 [2024-11-18 02:12:51.133847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.774 qpair failed and we were unable to recover it. 00:30:16.774 [2024-11-18 02:12:51.143636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.774 [2024-11-18 02:12:51.143752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.774 [2024-11-18 02:12:51.143778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.774 [2024-11-18 02:12:51.143792] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.774 [2024-11-18 02:12:51.143804] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.774 [2024-11-18 02:12:51.143834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.774 qpair failed and we were unable to recover it. 00:30:16.774 [2024-11-18 02:12:51.153738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.774 [2024-11-18 02:12:51.153830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.774 [2024-11-18 02:12:51.153857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.774 [2024-11-18 02:12:51.153871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.774 [2024-11-18 02:12:51.153884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.774 [2024-11-18 02:12:51.153926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.774 qpair failed and we were unable to recover it. 00:30:16.774 [2024-11-18 02:12:51.163795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.774 [2024-11-18 02:12:51.163894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.774 [2024-11-18 02:12:51.163921] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.774 [2024-11-18 02:12:51.163936] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.774 [2024-11-18 02:12:51.163952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.774 [2024-11-18 02:12:51.163985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.774 qpair failed and we were unable to recover it. 00:30:16.774 [2024-11-18 02:12:51.173715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.774 [2024-11-18 02:12:51.173801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.774 [2024-11-18 02:12:51.173830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.774 [2024-11-18 02:12:51.173846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.774 [2024-11-18 02:12:51.173860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:16.774 [2024-11-18 02:12:51.173890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.774 qpair failed and we were unable to recover it. 00:30:17.038 [2024-11-18 02:12:51.183764] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.038 [2024-11-18 02:12:51.183877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.038 [2024-11-18 02:12:51.183904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.038 [2024-11-18 02:12:51.183918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.038 [2024-11-18 02:12:51.183931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.038 [2024-11-18 02:12:51.183960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.038 qpair failed and we were unable to recover it. 00:30:17.038 [2024-11-18 02:12:51.193808] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.038 [2024-11-18 02:12:51.193902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.038 [2024-11-18 02:12:51.193928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.038 [2024-11-18 02:12:51.193942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.038 [2024-11-18 02:12:51.193955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.038 [2024-11-18 02:12:51.193984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.038 qpair failed and we were unable to recover it. 00:30:17.038 [2024-11-18 02:12:51.203795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.038 [2024-11-18 02:12:51.203885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.038 [2024-11-18 02:12:51.203910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.038 [2024-11-18 02:12:51.203931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.038 [2024-11-18 02:12:51.203945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.038 [2024-11-18 02:12:51.203975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.038 qpair failed and we were unable to recover it. 00:30:17.038 [2024-11-18 02:12:51.213850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.038 [2024-11-18 02:12:51.213942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.038 [2024-11-18 02:12:51.213969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.038 [2024-11-18 02:12:51.213983] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.038 [2024-11-18 02:12:51.213995] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.038 [2024-11-18 02:12:51.214038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.038 qpair failed and we were unable to recover it. 00:30:17.038 [2024-11-18 02:12:51.223860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.038 [2024-11-18 02:12:51.223952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.038 [2024-11-18 02:12:51.223978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.038 [2024-11-18 02:12:51.223992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.038 [2024-11-18 02:12:51.224005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.038 [2024-11-18 02:12:51.224033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.038 qpair failed and we were unable to recover it. 00:30:17.038 [2024-11-18 02:12:51.233933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.038 [2024-11-18 02:12:51.234020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.038 [2024-11-18 02:12:51.234046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.038 [2024-11-18 02:12:51.234060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.038 [2024-11-18 02:12:51.234073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.038 [2024-11-18 02:12:51.234102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.038 qpair failed and we were unable to recover it. 00:30:17.038 [2024-11-18 02:12:51.243954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.038 [2024-11-18 02:12:51.244039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.038 [2024-11-18 02:12:51.244065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.038 [2024-11-18 02:12:51.244078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.038 [2024-11-18 02:12:51.244091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.038 [2024-11-18 02:12:51.244121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.038 qpair failed and we were unable to recover it. 00:30:17.038 [2024-11-18 02:12:51.253969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.038 [2024-11-18 02:12:51.254060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.038 [2024-11-18 02:12:51.254085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.038 [2024-11-18 02:12:51.254099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.038 [2024-11-18 02:12:51.254112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.038 [2024-11-18 02:12:51.254142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.038 qpair failed and we were unable to recover it. 00:30:17.038 [2024-11-18 02:12:51.263963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.038 [2024-11-18 02:12:51.264050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.038 [2024-11-18 02:12:51.264075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.038 [2024-11-18 02:12:51.264089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.038 [2024-11-18 02:12:51.264102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.038 [2024-11-18 02:12:51.264131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.038 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.274015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.274102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.274128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.274142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.274155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.274185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.284116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.284207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.284236] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.284251] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.284263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.284295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.294059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.294172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.294198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.294222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.294237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.294265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.304127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.304237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.304263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.304277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.304289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.304325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.314124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.314231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.314257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.314271] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.314284] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.314323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.324129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.324217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.324243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.324257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.324270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.324301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.334180] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.334318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.334348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.334364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.334377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.334408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.344225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.344317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.344344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.344358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.344371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.344413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.354264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.354361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.354387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.354401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.354414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.354456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.364281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.364406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.364432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.364446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.364459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.364490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.374294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.374387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.374413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.374427] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.374441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.374470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.384368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.384452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.384482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.384497] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.384510] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.384542] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.394371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.394464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.394490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.039 [2024-11-18 02:12:51.394504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.039 [2024-11-18 02:12:51.394517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.039 [2024-11-18 02:12:51.394546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.039 qpair failed and we were unable to recover it. 00:30:17.039 [2024-11-18 02:12:51.404385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.039 [2024-11-18 02:12:51.404472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.039 [2024-11-18 02:12:51.404498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.040 [2024-11-18 02:12:51.404512] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.040 [2024-11-18 02:12:51.404525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.040 [2024-11-18 02:12:51.404555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.040 qpair failed and we were unable to recover it. 00:30:17.040 [2024-11-18 02:12:51.414415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.040 [2024-11-18 02:12:51.414498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.040 [2024-11-18 02:12:51.414523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.040 [2024-11-18 02:12:51.414536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.040 [2024-11-18 02:12:51.414548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.040 [2024-11-18 02:12:51.414576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.040 qpair failed and we were unable to recover it. 00:30:17.040 [2024-11-18 02:12:51.424450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.040 [2024-11-18 02:12:51.424531] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.040 [2024-11-18 02:12:51.424560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.040 [2024-11-18 02:12:51.424574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.040 [2024-11-18 02:12:51.424587] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.040 [2024-11-18 02:12:51.424623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.040 qpair failed and we were unable to recover it. 00:30:17.040 [2024-11-18 02:12:51.434469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.040 [2024-11-18 02:12:51.434551] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.040 [2024-11-18 02:12:51.434577] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.040 [2024-11-18 02:12:51.434591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.040 [2024-11-18 02:12:51.434604] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.040 [2024-11-18 02:12:51.434634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.040 qpair failed and we were unable to recover it. 00:30:17.301 [2024-11-18 02:12:51.444549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.301 [2024-11-18 02:12:51.444670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.301 [2024-11-18 02:12:51.444697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.301 [2024-11-18 02:12:51.444712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.301 [2024-11-18 02:12:51.444726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.301 [2024-11-18 02:12:51.444755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.301 qpair failed and we were unable to recover it. 00:30:17.301 [2024-11-18 02:12:51.454669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.454791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.454818] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.454832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.454845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.454874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.464575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.464655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.464681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.464694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.464707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.464736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.474623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.474751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.474787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.474803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.474816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.474846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.484617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.484701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.484728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.484742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.484755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.484787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.494681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.494767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.494793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.494807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.494820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.494850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.504666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.504756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.504782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.504795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.504808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.504837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.514700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.514791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.514817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.514831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.514844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.514879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.524716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.524799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.524824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.524837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.524850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.524881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.534781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.534867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.534893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.534908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.534921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.534950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.544772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.544866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.544891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.544905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.544918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.544947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.554863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.554984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.555013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.555029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.555042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.555071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.564825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.564953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.564984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.564998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.565012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.565041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.574868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.302 [2024-11-18 02:12:51.574952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.302 [2024-11-18 02:12:51.574978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.302 [2024-11-18 02:12:51.574992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.302 [2024-11-18 02:12:51.575005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.302 [2024-11-18 02:12:51.575036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.302 qpair failed and we were unable to recover it. 00:30:17.302 [2024-11-18 02:12:51.584877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.303 [2024-11-18 02:12:51.584973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.303 [2024-11-18 02:12:51.584999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.303 [2024-11-18 02:12:51.585013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.303 [2024-11-18 02:12:51.585025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.303 [2024-11-18 02:12:51.585061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.303 qpair failed and we were unable to recover it. 00:30:17.303 [2024-11-18 02:12:51.594929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.303 [2024-11-18 02:12:51.595015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.303 [2024-11-18 02:12:51.595043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.303 [2024-11-18 02:12:51.595058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.303 [2024-11-18 02:12:51.595071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.303 [2024-11-18 02:12:51.595103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.303 qpair failed and we were unable to recover it. 00:30:17.303 [2024-11-18 02:12:51.604954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.303 [2024-11-18 02:12:51.605043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.303 [2024-11-18 02:12:51.605070] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.303 [2024-11-18 02:12:51.605084] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.303 [2024-11-18 02:12:51.605102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.303 [2024-11-18 02:12:51.605133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.303 qpair failed and we were unable to recover it. 00:30:17.303 [2024-11-18 02:12:51.615046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.303 [2024-11-18 02:12:51.615128] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.303 [2024-11-18 02:12:51.615154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.303 [2024-11-18 02:12:51.615169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.303 [2024-11-18 02:12:51.615181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.303 [2024-11-18 02:12:51.615211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.303 qpair failed and we were unable to recover it. 00:30:17.303 [2024-11-18 02:12:51.624982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.303 [2024-11-18 02:12:51.625064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.303 [2024-11-18 02:12:51.625090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.303 [2024-11-18 02:12:51.625105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.303 [2024-11-18 02:12:51.625118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.303 [2024-11-18 02:12:51.625147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.303 qpair failed and we were unable to recover it. 00:30:17.303 [2024-11-18 02:12:51.635034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.303 [2024-11-18 02:12:51.635120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.303 [2024-11-18 02:12:51.635146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.303 [2024-11-18 02:12:51.635160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.303 [2024-11-18 02:12:51.635173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.303 [2024-11-18 02:12:51.635203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.303 qpair failed and we were unable to recover it. 00:30:17.303 [2024-11-18 02:12:51.645059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.303 [2024-11-18 02:12:51.645163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.303 [2024-11-18 02:12:51.645189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.303 [2024-11-18 02:12:51.645202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.303 [2024-11-18 02:12:51.645215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.303 [2024-11-18 02:12:51.645246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.303 qpair failed and we were unable to recover it. 00:30:17.303 [2024-11-18 02:12:51.655102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.303 [2024-11-18 02:12:51.655192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.303 [2024-11-18 02:12:51.655218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.303 [2024-11-18 02:12:51.655232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.303 [2024-11-18 02:12:51.655244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.303 [2024-11-18 02:12:51.655274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.303 qpair failed and we were unable to recover it. 00:30:17.303 [2024-11-18 02:12:51.665138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.303 [2024-11-18 02:12:51.665219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.303 [2024-11-18 02:12:51.665245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.303 [2024-11-18 02:12:51.665259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.303 [2024-11-18 02:12:51.665272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.303 [2024-11-18 02:12:51.665300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.303 qpair failed and we were unable to recover it. 00:30:17.303 [2024-11-18 02:12:51.675160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.303 [2024-11-18 02:12:51.675253] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.303 [2024-11-18 02:12:51.675278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.303 [2024-11-18 02:12:51.675292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.303 [2024-11-18 02:12:51.675306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.303 [2024-11-18 02:12:51.675344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.303 qpair failed and we were unable to recover it. 00:30:17.303 [2024-11-18 02:12:51.685197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.303 [2024-11-18 02:12:51.685309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.303 [2024-11-18 02:12:51.685341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.303 [2024-11-18 02:12:51.685355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.303 [2024-11-18 02:12:51.685368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.303 [2024-11-18 02:12:51.685397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.303 qpair failed and we were unable to recover it. 00:30:17.303 [2024-11-18 02:12:51.695264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.303 [2024-11-18 02:12:51.695405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.303 [2024-11-18 02:12:51.695432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.303 [2024-11-18 02:12:51.695445] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.303 [2024-11-18 02:12:51.695464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.303 [2024-11-18 02:12:51.695493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.303 qpair failed and we were unable to recover it. 00:30:17.563 [2024-11-18 02:12:51.705235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.563 [2024-11-18 02:12:51.705329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.563 [2024-11-18 02:12:51.705356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.563 [2024-11-18 02:12:51.705370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.563 [2024-11-18 02:12:51.705384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.563 [2024-11-18 02:12:51.705415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-11-18 02:12:51.715376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.563 [2024-11-18 02:12:51.715478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.563 [2024-11-18 02:12:51.715503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.563 [2024-11-18 02:12:51.715517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.563 [2024-11-18 02:12:51.715530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.563 [2024-11-18 02:12:51.715559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-11-18 02:12:51.725294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.563 [2024-11-18 02:12:51.725390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.563 [2024-11-18 02:12:51.725416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.563 [2024-11-18 02:12:51.725429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.563 [2024-11-18 02:12:51.725442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.563 [2024-11-18 02:12:51.725471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-11-18 02:12:51.735330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.563 [2024-11-18 02:12:51.735414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.563 [2024-11-18 02:12:51.735439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.563 [2024-11-18 02:12:51.735454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.563 [2024-11-18 02:12:51.735467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.563 [2024-11-18 02:12:51.735496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-11-18 02:12:51.745474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.563 [2024-11-18 02:12:51.745561] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.563 [2024-11-18 02:12:51.745587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.563 [2024-11-18 02:12:51.745600] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.563 [2024-11-18 02:12:51.745614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.563 [2024-11-18 02:12:51.745643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-11-18 02:12:51.755374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.563 [2024-11-18 02:12:51.755465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.563 [2024-11-18 02:12:51.755491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.755505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.755518] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.755547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.765397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.765483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.765509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.765524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.765536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.765565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.775455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.775585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.775610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.775623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.775636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.775665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.785522] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.785626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.785686] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.785716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.785732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.785774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.795523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.795605] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.795631] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.795645] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.795657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.795699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.805566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.805654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.805681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.805695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.805708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.805737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.815543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.815638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.815664] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.815678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.815691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.815721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.825582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.825663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.825689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.825703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.825715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.825745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.835623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.835709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.835735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.835749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.835762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.835791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.845645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.845745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.845771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.845785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.845798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.845826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.855654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.855755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.855780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.855794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.855807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.855838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.865710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.865791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.865817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.865830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.865843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.865873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.875766] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.875854] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.875884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.875899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.875912] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.875941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-11-18 02:12:51.885795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.564 [2024-11-18 02:12:51.885893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.564 [2024-11-18 02:12:51.885918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.564 [2024-11-18 02:12:51.885932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.564 [2024-11-18 02:12:51.885945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.564 [2024-11-18 02:12:51.885975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-11-18 02:12:51.895852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.565 [2024-11-18 02:12:51.895937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.565 [2024-11-18 02:12:51.895961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.565 [2024-11-18 02:12:51.895975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.565 [2024-11-18 02:12:51.895988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.565 [2024-11-18 02:12:51.896019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-11-18 02:12:51.905921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.565 [2024-11-18 02:12:51.906004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.565 [2024-11-18 02:12:51.906030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.565 [2024-11-18 02:12:51.906044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.565 [2024-11-18 02:12:51.906057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.565 [2024-11-18 02:12:51.906085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-11-18 02:12:51.915877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.565 [2024-11-18 02:12:51.915966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.565 [2024-11-18 02:12:51.915991] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.565 [2024-11-18 02:12:51.916005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.565 [2024-11-18 02:12:51.916017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.565 [2024-11-18 02:12:51.916046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-11-18 02:12:51.925921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.565 [2024-11-18 02:12:51.926007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.565 [2024-11-18 02:12:51.926032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.565 [2024-11-18 02:12:51.926047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.565 [2024-11-18 02:12:51.926059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.565 [2024-11-18 02:12:51.926099] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-11-18 02:12:51.935906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.565 [2024-11-18 02:12:51.936024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.565 [2024-11-18 02:12:51.936050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.565 [2024-11-18 02:12:51.936064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.565 [2024-11-18 02:12:51.936076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.565 [2024-11-18 02:12:51.936106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-11-18 02:12:51.945940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.565 [2024-11-18 02:12:51.946029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.565 [2024-11-18 02:12:51.946055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.565 [2024-11-18 02:12:51.946069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.565 [2024-11-18 02:12:51.946081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.565 [2024-11-18 02:12:51.946111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-11-18 02:12:51.956015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.565 [2024-11-18 02:12:51.956152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.565 [2024-11-18 02:12:51.956177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.565 [2024-11-18 02:12:51.956190] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.565 [2024-11-18 02:12:51.956202] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.565 [2024-11-18 02:12:51.956233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.824 [2024-11-18 02:12:51.965990] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.824 [2024-11-18 02:12:51.966109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.824 [2024-11-18 02:12:51.966141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.824 [2024-11-18 02:12:51.966156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.824 [2024-11-18 02:12:51.966169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.824 [2024-11-18 02:12:51.966199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.824 qpair failed and we were unable to recover it. 00:30:17.824 [2024-11-18 02:12:51.976033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.824 [2024-11-18 02:12:51.976121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.824 [2024-11-18 02:12:51.976146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.824 [2024-11-18 02:12:51.976160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.824 [2024-11-18 02:12:51.976173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.824 [2024-11-18 02:12:51.976203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.824 qpair failed and we were unable to recover it. 00:30:17.824 [2024-11-18 02:12:51.986046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:51.986143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:51.986169] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:51.986183] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:51.986195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:51.986224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:51.996084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:51.996167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:51.996193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:51.996207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:51.996219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:51.996249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:52.006160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:52.006250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:52.006276] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:52.006290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:52.006303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:52.006358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:52.016221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:52.016317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:52.016343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:52.016357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:52.016370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:52.016400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:52.026165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:52.026243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:52.026268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:52.026282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:52.026294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:52.026333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:52.036209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:52.036301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:52.036334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:52.036349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:52.036362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:52.036391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:52.046217] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:52.046308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:52.046340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:52.046355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:52.046368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:52.046398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:52.056248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:52.056342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:52.056374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:52.056389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:52.056402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:52.056432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:52.066286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:52.066379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:52.066405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:52.066419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:52.066431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:52.066461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:52.076346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:52.076469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:52.076494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:52.076508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:52.076521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:52.076550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:52.086344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:52.086432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:52.086456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:52.086470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:52.086483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:52.086512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:52.096376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:52.096470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:52.096499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:52.096513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:52.096534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:52.096565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:52.106392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:52.106480] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.825 [2024-11-18 02:12:52.106507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.825 [2024-11-18 02:12:52.106521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.825 [2024-11-18 02:12:52.106534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.825 [2024-11-18 02:12:52.106574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.825 qpair failed and we were unable to recover it. 00:30:17.825 [2024-11-18 02:12:52.116507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.825 [2024-11-18 02:12:52.116596] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.826 [2024-11-18 02:12:52.116621] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.826 [2024-11-18 02:12:52.116635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.826 [2024-11-18 02:12:52.116648] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.826 [2024-11-18 02:12:52.116677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.826 qpair failed and we were unable to recover it. 00:30:17.826 [2024-11-18 02:12:52.126451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.826 [2024-11-18 02:12:52.126539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.826 [2024-11-18 02:12:52.126565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.826 [2024-11-18 02:12:52.126579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.826 [2024-11-18 02:12:52.126592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.826 [2024-11-18 02:12:52.126622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.826 qpair failed and we were unable to recover it. 00:30:17.826 [2024-11-18 02:12:52.136480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.826 [2024-11-18 02:12:52.136564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.826 [2024-11-18 02:12:52.136591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.826 [2024-11-18 02:12:52.136605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.826 [2024-11-18 02:12:52.136618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.826 [2024-11-18 02:12:52.136669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.826 qpair failed and we were unable to recover it. 00:30:17.826 [2024-11-18 02:12:52.146589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.826 [2024-11-18 02:12:52.146719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.826 [2024-11-18 02:12:52.146746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.826 [2024-11-18 02:12:52.146759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.826 [2024-11-18 02:12:52.146772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.826 [2024-11-18 02:12:52.146802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.826 qpair failed and we were unable to recover it. 00:30:17.826 [2024-11-18 02:12:52.156658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.826 [2024-11-18 02:12:52.156752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.826 [2024-11-18 02:12:52.156778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.826 [2024-11-18 02:12:52.156793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.826 [2024-11-18 02:12:52.156806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.826 [2024-11-18 02:12:52.156834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.826 qpair failed and we were unable to recover it. 00:30:17.826 [2024-11-18 02:12:52.166607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.826 [2024-11-18 02:12:52.166731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.826 [2024-11-18 02:12:52.166757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.826 [2024-11-18 02:12:52.166771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.826 [2024-11-18 02:12:52.166784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.826 [2024-11-18 02:12:52.166814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.826 qpair failed and we were unable to recover it. 00:30:17.826 [2024-11-18 02:12:52.176648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.826 [2024-11-18 02:12:52.176744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.826 [2024-11-18 02:12:52.176771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.826 [2024-11-18 02:12:52.176785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.826 [2024-11-18 02:12:52.176798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.826 [2024-11-18 02:12:52.176827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.826 qpair failed and we were unable to recover it. 00:30:17.826 [2024-11-18 02:12:52.186710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.826 [2024-11-18 02:12:52.186827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.826 [2024-11-18 02:12:52.186853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.826 [2024-11-18 02:12:52.186867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.826 [2024-11-18 02:12:52.186885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.826 [2024-11-18 02:12:52.186927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.826 qpair failed and we were unable to recover it. 00:30:17.826 [2024-11-18 02:12:52.196773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.826 [2024-11-18 02:12:52.196904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.826 [2024-11-18 02:12:52.196929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.826 [2024-11-18 02:12:52.196943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.826 [2024-11-18 02:12:52.196955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.826 [2024-11-18 02:12:52.196985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.826 qpair failed and we were unable to recover it. 00:30:17.826 [2024-11-18 02:12:52.206694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.826 [2024-11-18 02:12:52.206780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.826 [2024-11-18 02:12:52.206806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.826 [2024-11-18 02:12:52.206820] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.826 [2024-11-18 02:12:52.206833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.826 [2024-11-18 02:12:52.206862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.826 qpair failed and we were unable to recover it. 00:30:17.826 [2024-11-18 02:12:52.216747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:17.826 [2024-11-18 02:12:52.216841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:17.826 [2024-11-18 02:12:52.216869] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:17.826 [2024-11-18 02:12:52.216884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:17.826 [2024-11-18 02:12:52.216897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:17.826 [2024-11-18 02:12:52.216927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.826 qpair failed and we were unable to recover it. 00:30:18.087 [2024-11-18 02:12:52.226728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.087 [2024-11-18 02:12:52.226812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.087 [2024-11-18 02:12:52.226839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.087 [2024-11-18 02:12:52.226854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.087 [2024-11-18 02:12:52.226870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.087 [2024-11-18 02:12:52.226901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.087 qpair failed and we were unable to recover it. 00:30:18.087 [2024-11-18 02:12:52.236801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.087 [2024-11-18 02:12:52.236913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.087 [2024-11-18 02:12:52.236940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.087 [2024-11-18 02:12:52.236954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.087 [2024-11-18 02:12:52.236967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.087 [2024-11-18 02:12:52.236995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.087 qpair failed and we were unable to recover it. 00:30:18.087 [2024-11-18 02:12:52.246809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.087 [2024-11-18 02:12:52.246894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.087 [2024-11-18 02:12:52.246920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.087 [2024-11-18 02:12:52.246935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.087 [2024-11-18 02:12:52.246947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.087 [2024-11-18 02:12:52.246976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.087 qpair failed and we were unable to recover it. 00:30:18.087 [2024-11-18 02:12:52.256838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.087 [2024-11-18 02:12:52.256920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.087 [2024-11-18 02:12:52.256946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.087 [2024-11-18 02:12:52.256960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.087 [2024-11-18 02:12:52.256973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.087 [2024-11-18 02:12:52.257001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.087 qpair failed and we were unable to recover it. 00:30:18.087 [2024-11-18 02:12:52.266845] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.087 [2024-11-18 02:12:52.266930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.087 [2024-11-18 02:12:52.266955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.087 [2024-11-18 02:12:52.266969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.087 [2024-11-18 02:12:52.266981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.087 [2024-11-18 02:12:52.267011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.087 qpair failed and we were unable to recover it. 00:30:18.087 [2024-11-18 02:12:52.276893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.087 [2024-11-18 02:12:52.276985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.087 [2024-11-18 02:12:52.277011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.087 [2024-11-18 02:12:52.277031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.087 [2024-11-18 02:12:52.277045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.087 [2024-11-18 02:12:52.277074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.087 qpair failed and we were unable to recover it. 00:30:18.087 [2024-11-18 02:12:52.286905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.087 [2024-11-18 02:12:52.287005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.087 [2024-11-18 02:12:52.287030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.087 [2024-11-18 02:12:52.287044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.087 [2024-11-18 02:12:52.287057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.287086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.296938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.297026] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.297051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.297065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.297078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.297106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.307094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.307186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.307212] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.307226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.307238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.307267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.317000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.317087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.317113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.317127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.317139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.317170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.327107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.327191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.327216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.327230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.327244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.327274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.337053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.337177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.337202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.337217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.337229] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.337258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.347074] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.347160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.347186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.347201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.347214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.347243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.357128] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.357222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.357248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.357262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.357275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.357303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.367182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.367293] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.367326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.367348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.367361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.367391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.377207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.377335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.377361] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.377375] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.377388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.377418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.387214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.387300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.387334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.387349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.387361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.387390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.397359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.397447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.397474] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.397488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.397501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.397543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.407273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.407364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.407391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.407405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.407417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.407447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.088 [2024-11-18 02:12:52.417265] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.088 [2024-11-18 02:12:52.417384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.088 [2024-11-18 02:12:52.417409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.088 [2024-11-18 02:12:52.417423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.088 [2024-11-18 02:12:52.417435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.088 [2024-11-18 02:12:52.417463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.088 qpair failed and we were unable to recover it. 00:30:18.089 [2024-11-18 02:12:52.427299] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.089 [2024-11-18 02:12:52.427397] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.089 [2024-11-18 02:12:52.427422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.089 [2024-11-18 02:12:52.427436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.089 [2024-11-18 02:12:52.427449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.089 [2024-11-18 02:12:52.427480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.089 qpair failed and we were unable to recover it. 00:30:18.089 [2024-11-18 02:12:52.437372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.089 [2024-11-18 02:12:52.437475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.089 [2024-11-18 02:12:52.437501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.089 [2024-11-18 02:12:52.437515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.089 [2024-11-18 02:12:52.437528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.089 [2024-11-18 02:12:52.437557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.089 qpair failed and we were unable to recover it. 00:30:18.089 [2024-11-18 02:12:52.447481] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.089 [2024-11-18 02:12:52.447572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.089 [2024-11-18 02:12:52.447597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.089 [2024-11-18 02:12:52.447611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.089 [2024-11-18 02:12:52.447624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.089 [2024-11-18 02:12:52.447653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.089 qpair failed and we were unable to recover it. 00:30:18.089 [2024-11-18 02:12:52.457448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.089 [2024-11-18 02:12:52.457541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.089 [2024-11-18 02:12:52.457572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.089 [2024-11-18 02:12:52.457587] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.089 [2024-11-18 02:12:52.457601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.089 [2024-11-18 02:12:52.457629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.089 qpair failed and we were unable to recover it. 00:30:18.089 [2024-11-18 02:12:52.467525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.089 [2024-11-18 02:12:52.467610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.089 [2024-11-18 02:12:52.467636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.089 [2024-11-18 02:12:52.467650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.089 [2024-11-18 02:12:52.467663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.089 [2024-11-18 02:12:52.467692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.089 qpair failed and we were unable to recover it. 00:30:18.089 [2024-11-18 02:12:52.477509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.089 [2024-11-18 02:12:52.477639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.089 [2024-11-18 02:12:52.477665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.089 [2024-11-18 02:12:52.477680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.089 [2024-11-18 02:12:52.477693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.089 [2024-11-18 02:12:52.477722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.089 qpair failed and we were unable to recover it. 00:30:18.089 [2024-11-18 02:12:52.487552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.089 [2024-11-18 02:12:52.487645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.089 [2024-11-18 02:12:52.487671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.089 [2024-11-18 02:12:52.487686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.089 [2024-11-18 02:12:52.487699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.089 [2024-11-18 02:12:52.487733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.089 qpair failed and we were unable to recover it. 00:30:18.350 [2024-11-18 02:12:52.497534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.350 [2024-11-18 02:12:52.497618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.350 [2024-11-18 02:12:52.497645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.350 [2024-11-18 02:12:52.497659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.350 [2024-11-18 02:12:52.497672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.350 [2024-11-18 02:12:52.497708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.350 qpair failed and we were unable to recover it. 00:30:18.350 [2024-11-18 02:12:52.507570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.350 [2024-11-18 02:12:52.507686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.350 [2024-11-18 02:12:52.507713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.350 [2024-11-18 02:12:52.507727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.350 [2024-11-18 02:12:52.507739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.350 [2024-11-18 02:12:52.507781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.350 qpair failed and we were unable to recover it. 00:30:18.350 [2024-11-18 02:12:52.517588] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.350 [2024-11-18 02:12:52.517708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.350 [2024-11-18 02:12:52.517736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.350 [2024-11-18 02:12:52.517753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.350 [2024-11-18 02:12:52.517766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.350 [2024-11-18 02:12:52.517796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.350 qpair failed and we were unable to recover it. 00:30:18.350 [2024-11-18 02:12:52.527796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.350 [2024-11-18 02:12:52.527930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.350 [2024-11-18 02:12:52.527956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.350 [2024-11-18 02:12:52.527971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.350 [2024-11-18 02:12:52.527984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.528015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.537687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.537771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.537797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.537811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.537824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.537853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.547782] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.547866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.547897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.547912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.547925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.547954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.557773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.557862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.557888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.557902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.557914] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.557944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.567810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.567911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.567936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.567950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.567963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.567993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.577754] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.577847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.577873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.577887] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.577899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.577930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.587809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.587934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.587959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.587973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.587986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.588021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.597818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.597904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.597929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.597943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.597956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.597985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.607881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.607970] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.607999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.608018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.608032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.608062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.617948] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.618064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.618090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.618104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.618118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.618147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.627907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.627998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.628023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.628037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.628050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.628080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.637969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.638061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.638087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.638102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.638115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.638144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.647965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.648050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.648077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.648091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.648104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.648134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.351 [2024-11-18 02:12:52.658080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.351 [2024-11-18 02:12:52.658164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.351 [2024-11-18 02:12:52.658190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.351 [2024-11-18 02:12:52.658204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.351 [2024-11-18 02:12:52.658217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.351 [2024-11-18 02:12:52.658258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.351 qpair failed and we were unable to recover it. 00:30:18.352 [2024-11-18 02:12:52.668105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.352 [2024-11-18 02:12:52.668197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.352 [2024-11-18 02:12:52.668222] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.352 [2024-11-18 02:12:52.668236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.352 [2024-11-18 02:12:52.668249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.352 [2024-11-18 02:12:52.668280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.352 qpair failed and we were unable to recover it. 00:30:18.352 [2024-11-18 02:12:52.678048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.352 [2024-11-18 02:12:52.678161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.352 [2024-11-18 02:12:52.678186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.352 [2024-11-18 02:12:52.678200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.352 [2024-11-18 02:12:52.678218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.352 [2024-11-18 02:12:52.678248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.352 qpair failed and we were unable to recover it. 00:30:18.352 [2024-11-18 02:12:52.688095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.352 [2024-11-18 02:12:52.688206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.352 [2024-11-18 02:12:52.688232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.352 [2024-11-18 02:12:52.688246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.352 [2024-11-18 02:12:52.688259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.352 [2024-11-18 02:12:52.688289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.352 qpair failed and we were unable to recover it. 00:30:18.352 [2024-11-18 02:12:52.698159] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.352 [2024-11-18 02:12:52.698270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.352 [2024-11-18 02:12:52.698296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.352 [2024-11-18 02:12:52.698318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.352 [2024-11-18 02:12:52.698334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.352 [2024-11-18 02:12:52.698364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.352 qpair failed and we were unable to recover it. 00:30:18.352 [2024-11-18 02:12:52.708223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.352 [2024-11-18 02:12:52.708318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.352 [2024-11-18 02:12:52.708345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.352 [2024-11-18 02:12:52.708359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.352 [2024-11-18 02:12:52.708371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.352 [2024-11-18 02:12:52.708413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.352 qpair failed and we were unable to recover it. 00:30:18.352 [2024-11-18 02:12:52.718204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.352 [2024-11-18 02:12:52.718308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.352 [2024-11-18 02:12:52.718341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.352 [2024-11-18 02:12:52.718355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.352 [2024-11-18 02:12:52.718367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.352 [2024-11-18 02:12:52.718399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.352 qpair failed and we were unable to recover it. 00:30:18.352 [2024-11-18 02:12:52.728224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.352 [2024-11-18 02:12:52.728350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.352 [2024-11-18 02:12:52.728376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.352 [2024-11-18 02:12:52.728390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.352 [2024-11-18 02:12:52.728402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.352 [2024-11-18 02:12:52.728431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.352 qpair failed and we were unable to recover it. 00:30:18.352 [2024-11-18 02:12:52.738247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.352 [2024-11-18 02:12:52.738347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.352 [2024-11-18 02:12:52.738374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.352 [2024-11-18 02:12:52.738388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.352 [2024-11-18 02:12:52.738403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.352 [2024-11-18 02:12:52.738433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.352 qpair failed and we were unable to recover it. 00:30:18.352 [2024-11-18 02:12:52.748253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.352 [2024-11-18 02:12:52.748341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.352 [2024-11-18 02:12:52.748367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.352 [2024-11-18 02:12:52.748381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.352 [2024-11-18 02:12:52.748394] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.352 [2024-11-18 02:12:52.748424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.352 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.758340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.758428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.758456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.614 [2024-11-18 02:12:52.758470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.614 [2024-11-18 02:12:52.758483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.614 [2024-11-18 02:12:52.758525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.614 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.768328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.768415] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.768441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.614 [2024-11-18 02:12:52.768462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.614 [2024-11-18 02:12:52.768475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.614 [2024-11-18 02:12:52.768505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.614 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.778352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.778443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.778472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.614 [2024-11-18 02:12:52.778491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.614 [2024-11-18 02:12:52.778504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.614 [2024-11-18 02:12:52.778534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.614 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.788429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.788541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.788567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.614 [2024-11-18 02:12:52.788582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.614 [2024-11-18 02:12:52.788595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.614 [2024-11-18 02:12:52.788624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.614 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.798447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.798562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.798588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.614 [2024-11-18 02:12:52.798602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.614 [2024-11-18 02:12:52.798615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.614 [2024-11-18 02:12:52.798644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.614 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.808426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.808515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.808540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.614 [2024-11-18 02:12:52.808554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.614 [2024-11-18 02:12:52.808566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.614 [2024-11-18 02:12:52.808596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.614 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.818484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.818603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.818628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.614 [2024-11-18 02:12:52.818642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.614 [2024-11-18 02:12:52.818655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.614 [2024-11-18 02:12:52.818684] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.614 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.828490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.828580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.828605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.614 [2024-11-18 02:12:52.828619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.614 [2024-11-18 02:12:52.828632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.614 [2024-11-18 02:12:52.828660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.614 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.838640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.838730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.838758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.614 [2024-11-18 02:12:52.838773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.614 [2024-11-18 02:12:52.838786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.614 [2024-11-18 02:12:52.838816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.614 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.848609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.848716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.848741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.614 [2024-11-18 02:12:52.848755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.614 [2024-11-18 02:12:52.848768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.614 [2024-11-18 02:12:52.848798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.614 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.858573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.858676] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.858702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.614 [2024-11-18 02:12:52.858722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.614 [2024-11-18 02:12:52.858736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.614 [2024-11-18 02:12:52.858765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.614 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.868662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.868746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.868771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.614 [2024-11-18 02:12:52.868785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.614 [2024-11-18 02:12:52.868798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.614 [2024-11-18 02:12:52.868829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.614 qpair failed and we were unable to recover it. 00:30:18.614 [2024-11-18 02:12:52.878736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.614 [2024-11-18 02:12:52.878862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.614 [2024-11-18 02:12:52.878887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.878901] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.878914] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.878943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:52.888663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:52.888752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:52.888777] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.888791] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.888803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.888833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:52.898778] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:52.898886] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:52.898911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.898926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.898939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.898967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:52.908738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:52.908820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:52.908845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.908859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.908871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.908902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:52.918753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:52.918855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:52.918881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.918895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.918908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.918937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:52.928836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:52.928928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:52.928958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.928974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.928987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.929017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:52.938905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:52.938996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:52.939022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.939037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.939050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.939091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:52.948939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:52.949018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:52.949049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.949064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.949077] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.949119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:52.958897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:52.959022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:52.959048] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.959062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.959075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.959104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:52.968899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:52.968988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:52.969013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.969027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.969039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.969069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:52.979048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:52.979138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:52.979167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.979182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.979195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.979224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:52.988998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:52.989087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:52.989113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.989127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.989140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.989175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:52.999138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:52.999268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:52.999294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:52.999308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:52.999329] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.615 [2024-11-18 02:12:52.999358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.615 qpair failed and we were unable to recover it. 00:30:18.615 [2024-11-18 02:12:53.009094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.615 [2024-11-18 02:12:53.009185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.615 [2024-11-18 02:12:53.009211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.615 [2024-11-18 02:12:53.009225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.615 [2024-11-18 02:12:53.009238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.616 [2024-11-18 02:12:53.009267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.616 qpair failed and we were unable to recover it. 00:30:18.876 [2024-11-18 02:12:53.019070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.876 [2024-11-18 02:12:53.019162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.876 [2024-11-18 02:12:53.019193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.876 [2024-11-18 02:12:53.019209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.876 [2024-11-18 02:12:53.019222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.876 [2024-11-18 02:12:53.019252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-11-18 02:12:53.029083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.876 [2024-11-18 02:12:53.029209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.876 [2024-11-18 02:12:53.029235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.876 [2024-11-18 02:12:53.029249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.876 [2024-11-18 02:12:53.029262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.876 [2024-11-18 02:12:53.029291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-11-18 02:12:53.039139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.876 [2024-11-18 02:12:53.039256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.876 [2024-11-18 02:12:53.039288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.876 [2024-11-18 02:12:53.039304] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.876 [2024-11-18 02:12:53.039325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.876 [2024-11-18 02:12:53.039356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-11-18 02:12:53.049229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.876 [2024-11-18 02:12:53.049337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.876 [2024-11-18 02:12:53.049363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.876 [2024-11-18 02:12:53.049377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.876 [2024-11-18 02:12:53.049390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.876 [2024-11-18 02:12:53.049431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-11-18 02:12:53.059268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.876 [2024-11-18 02:12:53.059403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.876 [2024-11-18 02:12:53.059430] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.876 [2024-11-18 02:12:53.059444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.876 [2024-11-18 02:12:53.059458] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.876 [2024-11-18 02:12:53.059499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-11-18 02:12:53.069219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.876 [2024-11-18 02:12:53.069322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.876 [2024-11-18 02:12:53.069352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.876 [2024-11-18 02:12:53.069367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.876 [2024-11-18 02:12:53.069380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.876 [2024-11-18 02:12:53.069411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-11-18 02:12:53.079276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.876 [2024-11-18 02:12:53.079387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.876 [2024-11-18 02:12:53.079414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.876 [2024-11-18 02:12:53.079428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.876 [2024-11-18 02:12:53.079441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.876 [2024-11-18 02:12:53.079476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-11-18 02:12:53.089286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.876 [2024-11-18 02:12:53.089387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.876 [2024-11-18 02:12:53.089414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.876 [2024-11-18 02:12:53.089427] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.876 [2024-11-18 02:12:53.089441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.876 [2024-11-18 02:12:53.089471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-11-18 02:12:53.099321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.876 [2024-11-18 02:12:53.099408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.876 [2024-11-18 02:12:53.099434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.876 [2024-11-18 02:12:53.099448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.876 [2024-11-18 02:12:53.099460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.876 [2024-11-18 02:12:53.099490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-11-18 02:12:53.109323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.876 [2024-11-18 02:12:53.109450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.876 [2024-11-18 02:12:53.109476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.876 [2024-11-18 02:12:53.109490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.876 [2024-11-18 02:12:53.109503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.876 [2024-11-18 02:12:53.109532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-11-18 02:12:53.119377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.876 [2024-11-18 02:12:53.119478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.876 [2024-11-18 02:12:53.119504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.876 [2024-11-18 02:12:53.119518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.876 [2024-11-18 02:12:53.119531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.876 [2024-11-18 02:12:53.119560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.129430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.129549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.129580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.129595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.129608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.129639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.139457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.139538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.139565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.139579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.139592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.139620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.149478] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.149566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.149591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.149605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.149618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.149649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.159623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.159719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.159744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.159758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.159771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.159800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.169505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.169593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.169618] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.169632] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.169650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.169680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.179550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.179667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.179693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.179706] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.179719] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.179747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.189579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.189660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.189684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.189698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.189711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.189740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.199619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.199711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.199739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.199755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.199768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.199799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.209723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.209807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.209833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.209847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.209860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.209889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.219682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.219816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.219842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.219856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.219869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.219898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.229735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.229835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.229861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.229875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.229888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.229918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.239726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.239821] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.239847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.239861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.239874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.239904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.249840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.877 [2024-11-18 02:12:53.249922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.877 [2024-11-18 02:12:53.249948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.877 [2024-11-18 02:12:53.249962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.877 [2024-11-18 02:12:53.249975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.877 [2024-11-18 02:12:53.250019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-11-18 02:12:53.259889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.878 [2024-11-18 02:12:53.259980] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.878 [2024-11-18 02:12:53.260006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.878 [2024-11-18 02:12:53.260019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.878 [2024-11-18 02:12:53.260039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.878 [2024-11-18 02:12:53.260071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-11-18 02:12:53.269793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:18.878 [2024-11-18 02:12:53.269882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:18.878 [2024-11-18 02:12:53.269907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:18.878 [2024-11-18 02:12:53.269921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:18.878 [2024-11-18 02:12:53.269934] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:18.878 [2024-11-18 02:12:53.269964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.878 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-18 02:12:53.279898] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.137 [2024-11-18 02:12:53.280009] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.137 [2024-11-18 02:12:53.280035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.137 [2024-11-18 02:12:53.280049] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.137 [2024-11-18 02:12:53.280062] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.137 [2024-11-18 02:12:53.280092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-18 02:12:53.289914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.137 [2024-11-18 02:12:53.290004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.137 [2024-11-18 02:12:53.290034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.137 [2024-11-18 02:12:53.290054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.137 [2024-11-18 02:12:53.290067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.137 [2024-11-18 02:12:53.290097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-18 02:12:53.299995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.137 [2024-11-18 02:12:53.300092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.137 [2024-11-18 02:12:53.300118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.137 [2024-11-18 02:12:53.300132] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.137 [2024-11-18 02:12:53.300145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.137 [2024-11-18 02:12:53.300186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-18 02:12:53.309953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.137 [2024-11-18 02:12:53.310047] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.137 [2024-11-18 02:12:53.310072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.137 [2024-11-18 02:12:53.310086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.137 [2024-11-18 02:12:53.310098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.137 [2024-11-18 02:12:53.310127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-18 02:12:53.319999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.320085] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.320110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.320124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.320137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.320166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.330013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.330100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.330129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.330144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.330157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.330189] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.340139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.340229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.340255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.340269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.340282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.340321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.350057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.350136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.350162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.350182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.350196] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.350227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.360115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.360237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.360263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.360277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.360290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.360327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.370173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.370307] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.370341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.370356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.370368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.370399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.380157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.380245] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.380270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.380284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.380296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.380334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.390179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.390263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.390289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.390303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.390323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.390356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.400333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.400439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.400464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.400478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.400492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.400521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.410265] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.410410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.410436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.410450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.410462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.410491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.420268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.420360] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.420385] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.420398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.420410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.420438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.430336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.430423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.430452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.430467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.430480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.430509] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.440356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.440485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.440516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.138 [2024-11-18 02:12:53.440531] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.138 [2024-11-18 02:12:53.440544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.138 [2024-11-18 02:12:53.440575] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-18 02:12:53.450387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.138 [2024-11-18 02:12:53.450482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.138 [2024-11-18 02:12:53.450508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.139 [2024-11-18 02:12:53.450522] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.139 [2024-11-18 02:12:53.450534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.139 [2024-11-18 02:12:53.450565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-18 02:12:53.460506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.139 [2024-11-18 02:12:53.460591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.139 [2024-11-18 02:12:53.460617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.139 [2024-11-18 02:12:53.460631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.139 [2024-11-18 02:12:53.460644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.139 [2024-11-18 02:12:53.460674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-18 02:12:53.470419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.139 [2024-11-18 02:12:53.470503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.139 [2024-11-18 02:12:53.470530] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.139 [2024-11-18 02:12:53.470544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.139 [2024-11-18 02:12:53.470557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.139 [2024-11-18 02:12:53.470586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-18 02:12:53.480511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.139 [2024-11-18 02:12:53.480599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.139 [2024-11-18 02:12:53.480626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.139 [2024-11-18 02:12:53.480640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.139 [2024-11-18 02:12:53.480653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.139 [2024-11-18 02:12:53.480682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-18 02:12:53.490470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.139 [2024-11-18 02:12:53.490555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.139 [2024-11-18 02:12:53.490581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.139 [2024-11-18 02:12:53.490595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.139 [2024-11-18 02:12:53.490607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.139 [2024-11-18 02:12:53.490636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-18 02:12:53.500553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.139 [2024-11-18 02:12:53.500640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.139 [2024-11-18 02:12:53.500670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.139 [2024-11-18 02:12:53.500684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.139 [2024-11-18 02:12:53.500697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.139 [2024-11-18 02:12:53.500728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-18 02:12:53.510566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.139 [2024-11-18 02:12:53.510651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.139 [2024-11-18 02:12:53.510677] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.139 [2024-11-18 02:12:53.510690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.139 [2024-11-18 02:12:53.510703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.139 [2024-11-18 02:12:53.510733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-18 02:12:53.520601] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.139 [2024-11-18 02:12:53.520686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.139 [2024-11-18 02:12:53.520711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.139 [2024-11-18 02:12:53.520726] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.139 [2024-11-18 02:12:53.520738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.139 [2024-11-18 02:12:53.520768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-18 02:12:53.530605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.139 [2024-11-18 02:12:53.530692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.139 [2024-11-18 02:12:53.530724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.139 [2024-11-18 02:12:53.530739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.139 [2024-11-18 02:12:53.530752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.139 [2024-11-18 02:12:53.530783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.399 [2024-11-18 02:12:53.540633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.399 [2024-11-18 02:12:53.540726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.399 [2024-11-18 02:12:53.540756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.399 [2024-11-18 02:12:53.540773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.399 [2024-11-18 02:12:53.540787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.399 [2024-11-18 02:12:53.540818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.399 qpair failed and we were unable to recover it. 00:30:19.399 [2024-11-18 02:12:53.550667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.399 [2024-11-18 02:12:53.550754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.399 [2024-11-18 02:12:53.550780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.399 [2024-11-18 02:12:53.550794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.399 [2024-11-18 02:12:53.550807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.399 [2024-11-18 02:12:53.550836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.399 qpair failed and we were unable to recover it. 00:30:19.399 [2024-11-18 02:12:53.560732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.399 [2024-11-18 02:12:53.560863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.399 [2024-11-18 02:12:53.560888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.399 [2024-11-18 02:12:53.560903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.399 [2024-11-18 02:12:53.560916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.560945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.570720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.570825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.570852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.570866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.570878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.570914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.580774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.580857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.580882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.580896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.580909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.580938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.590809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.590894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.590921] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.590934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.590948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.590977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.600812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.600927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.600952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.600966] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.600979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.601009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.610861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.610950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.610976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.610990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.611002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.611032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.620877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.620956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.620991] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.621006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.621019] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.621048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.631000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.631136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.631162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.631176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.631188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.631218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.640957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.641082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.641108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.641122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.641134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.641164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.650965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.651052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.651078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.651092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.651105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.651135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.660994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.661107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.661133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.661147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.661165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.661194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.671010] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.671112] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.671137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.671151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.671164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.671195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.681065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.681159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.681184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.681198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.681211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.681240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.400 qpair failed and we were unable to recover it. 00:30:19.400 [2024-11-18 02:12:53.691081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.400 [2024-11-18 02:12:53.691173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.400 [2024-11-18 02:12:53.691198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.400 [2024-11-18 02:12:53.691212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.400 [2024-11-18 02:12:53.691224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.400 [2024-11-18 02:12:53.691255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.401 qpair failed and we were unable to recover it. 00:30:19.401 [2024-11-18 02:12:53.701093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.401 [2024-11-18 02:12:53.701183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.401 [2024-11-18 02:12:53.701208] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.401 [2024-11-18 02:12:53.701223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.401 [2024-11-18 02:12:53.701235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.401 [2024-11-18 02:12:53.701276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.401 qpair failed and we were unable to recover it. 00:30:19.401 [2024-11-18 02:12:53.711121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.401 [2024-11-18 02:12:53.711212] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.401 [2024-11-18 02:12:53.711238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.401 [2024-11-18 02:12:53.711252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.401 [2024-11-18 02:12:53.711265] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.401 [2024-11-18 02:12:53.711294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.401 qpair failed and we were unable to recover it. 00:30:19.401 [2024-11-18 02:12:53.721163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.401 [2024-11-18 02:12:53.721257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.401 [2024-11-18 02:12:53.721283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.401 [2024-11-18 02:12:53.721297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.401 [2024-11-18 02:12:53.721316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.401 [2024-11-18 02:12:53.721348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.401 qpair failed and we were unable to recover it. 00:30:19.401 [2024-11-18 02:12:53.731233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.401 [2024-11-18 02:12:53.731324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.401 [2024-11-18 02:12:53.731350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.401 [2024-11-18 02:12:53.731364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.401 [2024-11-18 02:12:53.731377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.401 [2024-11-18 02:12:53.731408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.401 qpair failed and we were unable to recover it. 00:30:19.401 [2024-11-18 02:12:53.741234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.401 [2024-11-18 02:12:53.741324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.401 [2024-11-18 02:12:53.741351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.401 [2024-11-18 02:12:53.741365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.401 [2024-11-18 02:12:53.741378] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.401 [2024-11-18 02:12:53.741407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.401 qpair failed and we were unable to recover it. 00:30:19.401 [2024-11-18 02:12:53.751229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.401 [2024-11-18 02:12:53.751324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.401 [2024-11-18 02:12:53.751350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.401 [2024-11-18 02:12:53.751364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.401 [2024-11-18 02:12:53.751382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.401 [2024-11-18 02:12:53.751413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.401 qpair failed and we were unable to recover it. 00:30:19.401 [2024-11-18 02:12:53.761293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.401 [2024-11-18 02:12:53.761442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.401 [2024-11-18 02:12:53.761468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.401 [2024-11-18 02:12:53.761483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.401 [2024-11-18 02:12:53.761496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.401 [2024-11-18 02:12:53.761524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.401 qpair failed and we were unable to recover it. 00:30:19.401 [2024-11-18 02:12:53.771327] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.401 [2024-11-18 02:12:53.771432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.401 [2024-11-18 02:12:53.771458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.401 [2024-11-18 02:12:53.771472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.401 [2024-11-18 02:12:53.771484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.401 [2024-11-18 02:12:53.771513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.401 qpair failed and we were unable to recover it. 00:30:19.401 [2024-11-18 02:12:53.781333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.401 [2024-11-18 02:12:53.781470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.401 [2024-11-18 02:12:53.781495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.401 [2024-11-18 02:12:53.781509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.401 [2024-11-18 02:12:53.781522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.401 [2024-11-18 02:12:53.781552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.401 qpair failed and we were unable to recover it. 00:30:19.401 [2024-11-18 02:12:53.791383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.401 [2024-11-18 02:12:53.791484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.401 [2024-11-18 02:12:53.791510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.401 [2024-11-18 02:12:53.791524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.401 [2024-11-18 02:12:53.791537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.401 [2024-11-18 02:12:53.791567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.401 qpair failed and we were unable to recover it. 00:30:19.661 [2024-11-18 02:12:53.801478] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.661 [2024-11-18 02:12:53.801578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.661 [2024-11-18 02:12:53.801605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.661 [2024-11-18 02:12:53.801619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.661 [2024-11-18 02:12:53.801632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.661 [2024-11-18 02:12:53.801661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.661 qpair failed and we were unable to recover it. 00:30:19.661 [2024-11-18 02:12:53.811404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.661 [2024-11-18 02:12:53.811490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.661 [2024-11-18 02:12:53.811516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.661 [2024-11-18 02:12:53.811530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.661 [2024-11-18 02:12:53.811542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.661 [2024-11-18 02:12:53.811572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.661 qpair failed and we were unable to recover it. 00:30:19.661 [2024-11-18 02:12:53.821482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.661 [2024-11-18 02:12:53.821599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.661 [2024-11-18 02:12:53.821625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.661 [2024-11-18 02:12:53.821639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.661 [2024-11-18 02:12:53.821652] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.661 [2024-11-18 02:12:53.821680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.661 qpair failed and we were unable to recover it. 00:30:19.661 [2024-11-18 02:12:53.831577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.661 [2024-11-18 02:12:53.831656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.661 [2024-11-18 02:12:53.831682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.661 [2024-11-18 02:12:53.831696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.661 [2024-11-18 02:12:53.831709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.661 [2024-11-18 02:12:53.831737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.661 qpair failed and we were unable to recover it. 00:30:19.661 [2024-11-18 02:12:53.841608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.661 [2024-11-18 02:12:53.841703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.661 [2024-11-18 02:12:53.841732] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.661 [2024-11-18 02:12:53.841756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.661 [2024-11-18 02:12:53.841770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.661 [2024-11-18 02:12:53.841814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.661 qpair failed and we were unable to recover it. 00:30:19.661 [2024-11-18 02:12:53.851553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.661 [2024-11-18 02:12:53.851646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.661 [2024-11-18 02:12:53.851672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.661 [2024-11-18 02:12:53.851686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.661 [2024-11-18 02:12:53.851699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.661 [2024-11-18 02:12:53.851730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.661 qpair failed and we were unable to recover it. 00:30:19.661 [2024-11-18 02:12:53.861596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.661 [2024-11-18 02:12:53.861682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.661 [2024-11-18 02:12:53.861709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.661 [2024-11-18 02:12:53.861723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.661 [2024-11-18 02:12:53.861736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.661 [2024-11-18 02:12:53.861766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.661 qpair failed and we were unable to recover it. 00:30:19.661 [2024-11-18 02:12:53.871561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.661 [2024-11-18 02:12:53.871671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.661 [2024-11-18 02:12:53.871697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.661 [2024-11-18 02:12:53.871711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.661 [2024-11-18 02:12:53.871725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.661 [2024-11-18 02:12:53.871755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.661 qpair failed and we were unable to recover it. 00:30:19.661 [2024-11-18 02:12:53.881610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.661 [2024-11-18 02:12:53.881705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.661 [2024-11-18 02:12:53.881731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.661 [2024-11-18 02:12:53.881745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.661 [2024-11-18 02:12:53.881758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.661 [2024-11-18 02:12:53.881789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.661 qpair failed and we were unable to recover it. 00:30:19.661 [2024-11-18 02:12:53.891627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.661 [2024-11-18 02:12:53.891742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.661 [2024-11-18 02:12:53.891768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.661 [2024-11-18 02:12:53.891782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.661 [2024-11-18 02:12:53.891795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.661 [2024-11-18 02:12:53.891824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.661 qpair failed and we were unable to recover it. 00:30:19.661 [2024-11-18 02:12:53.901647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.661 [2024-11-18 02:12:53.901740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.661 [2024-11-18 02:12:53.901765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.661 [2024-11-18 02:12:53.901779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.661 [2024-11-18 02:12:53.901792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:53.901822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:53.911677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:53.911762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:53.911788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:53.911805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:53.911818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:53.911847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:53.921730] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:53.921849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:53.921874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:53.921888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:53.921901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:53.921930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:53.931743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:53.931837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:53.931863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:53.931884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:53.931897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:53.931926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:53.941792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:53.941891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:53.941917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:53.941931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:53.941943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:53.941972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:53.951823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:53.951910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:53.951938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:53.951958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:53.951972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:53.952002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:53.961837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:53.961961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:53.961987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:53.962001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:53.962014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:53.962043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:53.971874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:53.972008] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:53.972034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:53.972047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:53.972060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:53.972089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:53.981958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:53.982044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:53.982070] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:53.982085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:53.982097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:53.982125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:53.991911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:53.991993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:53.992018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:53.992032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:53.992045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:53.992074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:54.001959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:54.002050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:54.002078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:54.002097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:54.002110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:54.002140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:54.011962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:54.012049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:54.012076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:54.012090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:54.012103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:54.012132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:54.022066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:54.022153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:54.022184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:54.022199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:54.022211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:54.022240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:54.032082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.662 [2024-11-18 02:12:54.032165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.662 [2024-11-18 02:12:54.032190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.662 [2024-11-18 02:12:54.032205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.662 [2024-11-18 02:12:54.032217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.662 [2024-11-18 02:12:54.032249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.662 qpair failed and we were unable to recover it. 00:30:19.662 [2024-11-18 02:12:54.042137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.663 [2024-11-18 02:12:54.042224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.663 [2024-11-18 02:12:54.042250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.663 [2024-11-18 02:12:54.042265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.663 [2024-11-18 02:12:54.042277] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.663 [2024-11-18 02:12:54.042327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.663 qpair failed and we were unable to recover it. 00:30:19.663 [2024-11-18 02:12:54.052084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.663 [2024-11-18 02:12:54.052175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.663 [2024-11-18 02:12:54.052204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.663 [2024-11-18 02:12:54.052219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.663 [2024-11-18 02:12:54.052232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.663 [2024-11-18 02:12:54.052263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.663 qpair failed and we were unable to recover it. 00:30:19.663 [2024-11-18 02:12:54.062221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.663 [2024-11-18 02:12:54.062303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.663 [2024-11-18 02:12:54.062337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.663 [2024-11-18 02:12:54.062351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.663 [2024-11-18 02:12:54.062365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.663 [2024-11-18 02:12:54.062401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.663 qpair failed and we were unable to recover it. 00:30:19.922 [2024-11-18 02:12:54.072104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.922 [2024-11-18 02:12:54.072183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.922 [2024-11-18 02:12:54.072209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.922 [2024-11-18 02:12:54.072224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.922 [2024-11-18 02:12:54.072237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.922 [2024-11-18 02:12:54.072268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.922 qpair failed and we were unable to recover it. 00:30:19.922 [2024-11-18 02:12:54.082172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.922 [2024-11-18 02:12:54.082260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.922 [2024-11-18 02:12:54.082285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.922 [2024-11-18 02:12:54.082299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.922 [2024-11-18 02:12:54.082319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.922 [2024-11-18 02:12:54.082352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.922 qpair failed and we were unable to recover it. 00:30:19.922 [2024-11-18 02:12:54.092286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.922 [2024-11-18 02:12:54.092384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.922 [2024-11-18 02:12:54.092410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.922 [2024-11-18 02:12:54.092424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.922 [2024-11-18 02:12:54.092437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.922 [2024-11-18 02:12:54.092478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.922 qpair failed and we were unable to recover it. 00:30:19.922 [2024-11-18 02:12:54.102216] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.922 [2024-11-18 02:12:54.102301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.922 [2024-11-18 02:12:54.102336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.922 [2024-11-18 02:12:54.102351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.922 [2024-11-18 02:12:54.102364] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.922 [2024-11-18 02:12:54.102394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.922 qpair failed and we were unable to recover it. 00:30:19.922 [2024-11-18 02:12:54.112265] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.922 [2024-11-18 02:12:54.112369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.922 [2024-11-18 02:12:54.112401] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.922 [2024-11-18 02:12:54.112416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.922 [2024-11-18 02:12:54.112428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.922 [2024-11-18 02:12:54.112469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.922 qpair failed and we were unable to recover it. 00:30:19.922 [2024-11-18 02:12:54.122302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.922 [2024-11-18 02:12:54.122403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.922 [2024-11-18 02:12:54.122428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.922 [2024-11-18 02:12:54.122442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.922 [2024-11-18 02:12:54.122455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.922 [2024-11-18 02:12:54.122485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.922 qpair failed and we were unable to recover it. 00:30:19.922 [2024-11-18 02:12:54.132284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.132376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.132403] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.132417] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.132430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.132458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.142351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.142442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.142467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.142481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.142494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.142525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.152347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.152434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.152460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.152474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.152487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.152522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.162387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.162514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.162539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.162553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.162566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.162595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.172419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.172506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.172531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.172546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.172558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.172587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.182448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.182535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.182560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.182574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.182586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.182616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.192453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.192578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.192604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.192618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.192631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.192660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.202634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.202761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.202786] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.202800] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.202813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.202843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.212552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.212648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.212673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.212687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.212700] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.212729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.222613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.222732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.222757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.222771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.222784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.222814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.232581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.232662] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.232688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.232702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.232714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.232744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.242628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.242714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.242739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.242753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.242773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.242802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.252656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.252750] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.252778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.923 [2024-11-18 02:12:54.252793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.923 [2024-11-18 02:12:54.252805] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.923 [2024-11-18 02:12:54.252835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.923 qpair failed and we were unable to recover it. 00:30:19.923 [2024-11-18 02:12:54.262668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.923 [2024-11-18 02:12:54.262759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.923 [2024-11-18 02:12:54.262785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.924 [2024-11-18 02:12:54.262798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.924 [2024-11-18 02:12:54.262812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.924 [2024-11-18 02:12:54.262841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.924 qpair failed and we were unable to recover it. 00:30:19.924 [2024-11-18 02:12:54.272714] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.924 [2024-11-18 02:12:54.272818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.924 [2024-11-18 02:12:54.272843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.924 [2024-11-18 02:12:54.272857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.924 [2024-11-18 02:12:54.272870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.924 [2024-11-18 02:12:54.272901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.924 qpair failed and we were unable to recover it. 00:30:19.924 [2024-11-18 02:12:54.282737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.924 [2024-11-18 02:12:54.282823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.924 [2024-11-18 02:12:54.282848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.924 [2024-11-18 02:12:54.282862] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.924 [2024-11-18 02:12:54.282875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.924 [2024-11-18 02:12:54.282905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.924 qpair failed and we were unable to recover it. 00:30:19.924 [2024-11-18 02:12:54.292851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.924 [2024-11-18 02:12:54.292986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.924 [2024-11-18 02:12:54.293012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.924 [2024-11-18 02:12:54.293026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.924 [2024-11-18 02:12:54.293038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.924 [2024-11-18 02:12:54.293081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.924 qpair failed and we were unable to recover it. 00:30:19.924 [2024-11-18 02:12:54.302797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.924 [2024-11-18 02:12:54.302878] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.924 [2024-11-18 02:12:54.302903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.924 [2024-11-18 02:12:54.302917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.924 [2024-11-18 02:12:54.302930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.924 [2024-11-18 02:12:54.302971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.924 qpair failed and we were unable to recover it. 00:30:19.924 [2024-11-18 02:12:54.312797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.924 [2024-11-18 02:12:54.312885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.924 [2024-11-18 02:12:54.312911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.924 [2024-11-18 02:12:54.312926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.924 [2024-11-18 02:12:54.312937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.924 [2024-11-18 02:12:54.312965] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.924 qpair failed and we were unable to recover it. 00:30:19.924 [2024-11-18 02:12:54.322939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.924 [2024-11-18 02:12:54.323044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.924 [2024-11-18 02:12:54.323073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.924 [2024-11-18 02:12:54.323088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.924 [2024-11-18 02:12:54.323101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:19.924 [2024-11-18 02:12:54.323131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:19.924 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-18 02:12:54.332959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.183 [2024-11-18 02:12:54.333049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.183 [2024-11-18 02:12:54.333076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.183 [2024-11-18 02:12:54.333097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.183 [2024-11-18 02:12:54.333111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.183 [2024-11-18 02:12:54.333152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-18 02:12:54.342884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.183 [2024-11-18 02:12:54.342964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.183 [2024-11-18 02:12:54.342990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.183 [2024-11-18 02:12:54.343004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.183 [2024-11-18 02:12:54.343016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.183 [2024-11-18 02:12:54.343046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.352959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.353073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.353100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.353113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.353126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.353154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.362973] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.363061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.363086] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.363100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.363113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.363142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.373003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.373090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.373116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.373129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.373142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.373173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.383009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.383098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.383123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.383137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.383150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.383181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.393051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.393133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.393159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.393174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.393188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.393216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.403082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.403170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.403196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.403210] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.403223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.403253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.413161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.413262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.413288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.413302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.413340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.413370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.423150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.423263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.423287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.423329] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.423342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.423371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.433160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.433283] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.433321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.433340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.433354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.433383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.443246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.443367] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.443392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.443407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.443420] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.443450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.453354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.453443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.453469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.453482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.453495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.453524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.463347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.463434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.463460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.463474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.463487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.463518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.473262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.184 [2024-11-18 02:12:54.473375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.184 [2024-11-18 02:12:54.473402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.184 [2024-11-18 02:12:54.473416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.184 [2024-11-18 02:12:54.473429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.184 [2024-11-18 02:12:54.473459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-18 02:12:54.483337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.185 [2024-11-18 02:12:54.483441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.185 [2024-11-18 02:12:54.483467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.185 [2024-11-18 02:12:54.483480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.185 [2024-11-18 02:12:54.483493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.185 [2024-11-18 02:12:54.483523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-18 02:12:54.493356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.185 [2024-11-18 02:12:54.493441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.185 [2024-11-18 02:12:54.493467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.185 [2024-11-18 02:12:54.493480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.185 [2024-11-18 02:12:54.493493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.185 [2024-11-18 02:12:54.493523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-18 02:12:54.503351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.185 [2024-11-18 02:12:54.503437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.185 [2024-11-18 02:12:54.503462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.185 [2024-11-18 02:12:54.503475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.185 [2024-11-18 02:12:54.503488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.185 [2024-11-18 02:12:54.503519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-18 02:12:54.513439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.185 [2024-11-18 02:12:54.513526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.185 [2024-11-18 02:12:54.513557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.185 [2024-11-18 02:12:54.513572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.185 [2024-11-18 02:12:54.513584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.185 [2024-11-18 02:12:54.513613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-18 02:12:54.523469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.185 [2024-11-18 02:12:54.523555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.185 [2024-11-18 02:12:54.523580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.185 [2024-11-18 02:12:54.523594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.185 [2024-11-18 02:12:54.523607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.185 [2024-11-18 02:12:54.523636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-18 02:12:54.533459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.185 [2024-11-18 02:12:54.533547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.185 [2024-11-18 02:12:54.533572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.185 [2024-11-18 02:12:54.533586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.185 [2024-11-18 02:12:54.533599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.185 [2024-11-18 02:12:54.533628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-18 02:12:54.543516] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.185 [2024-11-18 02:12:54.543605] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.185 [2024-11-18 02:12:54.543630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.185 [2024-11-18 02:12:54.543644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.185 [2024-11-18 02:12:54.543657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.185 [2024-11-18 02:12:54.543686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-18 02:12:54.553503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.185 [2024-11-18 02:12:54.553586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.185 [2024-11-18 02:12:54.553612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.185 [2024-11-18 02:12:54.553626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.185 [2024-11-18 02:12:54.553638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.185 [2024-11-18 02:12:54.553674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-18 02:12:54.563565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.185 [2024-11-18 02:12:54.563656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.185 [2024-11-18 02:12:54.563681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.185 [2024-11-18 02:12:54.563695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.185 [2024-11-18 02:12:54.563708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.185 [2024-11-18 02:12:54.563736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-18 02:12:54.573639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.185 [2024-11-18 02:12:54.573728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.185 [2024-11-18 02:12:54.573754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.185 [2024-11-18 02:12:54.573767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.185 [2024-11-18 02:12:54.573780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.185 [2024-11-18 02:12:54.573809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-18 02:12:54.583718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.185 [2024-11-18 02:12:54.583805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.185 [2024-11-18 02:12:54.583834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.185 [2024-11-18 02:12:54.583848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.185 [2024-11-18 02:12:54.583861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.185 [2024-11-18 02:12:54.583903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.593735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.446 [2024-11-18 02:12:54.593829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.446 [2024-11-18 02:12:54.593855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.446 [2024-11-18 02:12:54.593870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.446 [2024-11-18 02:12:54.593883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.446 [2024-11-18 02:12:54.593912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.603696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.446 [2024-11-18 02:12:54.603789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.446 [2024-11-18 02:12:54.603821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.446 [2024-11-18 02:12:54.603836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.446 [2024-11-18 02:12:54.603849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.446 [2024-11-18 02:12:54.603878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.613720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.446 [2024-11-18 02:12:54.613804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.446 [2024-11-18 02:12:54.613830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.446 [2024-11-18 02:12:54.613844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.446 [2024-11-18 02:12:54.613857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.446 [2024-11-18 02:12:54.613888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.623787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.446 [2024-11-18 02:12:54.623891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.446 [2024-11-18 02:12:54.623917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.446 [2024-11-18 02:12:54.623931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.446 [2024-11-18 02:12:54.623943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.446 [2024-11-18 02:12:54.623973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.633753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.446 [2024-11-18 02:12:54.633835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.446 [2024-11-18 02:12:54.633861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.446 [2024-11-18 02:12:54.633875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.446 [2024-11-18 02:12:54.633889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.446 [2024-11-18 02:12:54.633931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.643820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.446 [2024-11-18 02:12:54.643917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.446 [2024-11-18 02:12:54.643944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.446 [2024-11-18 02:12:54.643958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.446 [2024-11-18 02:12:54.643971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.446 [2024-11-18 02:12:54.644006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.653818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.446 [2024-11-18 02:12:54.653927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.446 [2024-11-18 02:12:54.653952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.446 [2024-11-18 02:12:54.653966] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.446 [2024-11-18 02:12:54.653980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.446 [2024-11-18 02:12:54.654010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.663864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.446 [2024-11-18 02:12:54.663947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.446 [2024-11-18 02:12:54.663973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.446 [2024-11-18 02:12:54.663987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.446 [2024-11-18 02:12:54.664000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.446 [2024-11-18 02:12:54.664028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.673890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.446 [2024-11-18 02:12:54.673977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.446 [2024-11-18 02:12:54.674004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.446 [2024-11-18 02:12:54.674018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.446 [2024-11-18 02:12:54.674031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.446 [2024-11-18 02:12:54.674061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.683903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.446 [2024-11-18 02:12:54.683991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.446 [2024-11-18 02:12:54.684016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.446 [2024-11-18 02:12:54.684030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.446 [2024-11-18 02:12:54.684042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.446 [2024-11-18 02:12:54.684071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.693969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.446 [2024-11-18 02:12:54.694089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.446 [2024-11-18 02:12:54.694120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.446 [2024-11-18 02:12:54.694135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.446 [2024-11-18 02:12:54.694148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.446 [2024-11-18 02:12:54.694177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.704043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.446 [2024-11-18 02:12:54.704135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.446 [2024-11-18 02:12:54.704161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.446 [2024-11-18 02:12:54.704175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.446 [2024-11-18 02:12:54.704188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.446 [2024-11-18 02:12:54.704216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-11-18 02:12:54.713982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.714079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.714108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.714124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.714137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.714167] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.724030] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.724142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.724169] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.724183] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.724197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.724228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.734080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.734174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.734201] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.734215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.734234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.734264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.744157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.744280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.744306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.744332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.744346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.744375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.754126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.754220] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.754245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.754259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.754272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.754300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.764184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.764275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.764301] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.764331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.764345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.764377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.774193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.774277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.774302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.774326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.774340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.774369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.784191] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.784284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.784317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.784334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.784346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.784377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.794198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.794279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.794305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.794328] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.794342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.794372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.804289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.804390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.804416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.804430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.804443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.804473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.814276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.814375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.814401] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.814414] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.814427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.814458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.824321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.824408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.824433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.824447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.824466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.824496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.834359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.834444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.447 [2024-11-18 02:12:54.834469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.447 [2024-11-18 02:12:54.834483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.447 [2024-11-18 02:12:54.834497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.447 [2024-11-18 02:12:54.834526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-11-18 02:12:54.844404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.447 [2024-11-18 02:12:54.844515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.448 [2024-11-18 02:12:54.844541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.448 [2024-11-18 02:12:54.844555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.448 [2024-11-18 02:12:54.844568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.448 [2024-11-18 02:12:54.844597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.709 [2024-11-18 02:12:54.854460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.709 [2024-11-18 02:12:54.854558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.709 [2024-11-18 02:12:54.854591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.709 [2024-11-18 02:12:54.854605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.709 [2024-11-18 02:12:54.854618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.709 [2024-11-18 02:12:54.854649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.709 qpair failed and we were unable to recover it. 00:30:20.709 [2024-11-18 02:12:54.864510] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.709 [2024-11-18 02:12:54.864600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.709 [2024-11-18 02:12:54.864626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.709 [2024-11-18 02:12:54.864640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.709 [2024-11-18 02:12:54.864653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.709 [2024-11-18 02:12:54.864684] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.709 qpair failed and we were unable to recover it. 00:30:20.709 [2024-11-18 02:12:54.874546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.709 [2024-11-18 02:12:54.874687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.709 [2024-11-18 02:12:54.874714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.709 [2024-11-18 02:12:54.874728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.709 [2024-11-18 02:12:54.874741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.709 [2024-11-18 02:12:54.874771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.709 qpair failed and we were unable to recover it. 00:30:20.709 [2024-11-18 02:12:54.884490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.709 [2024-11-18 02:12:54.884586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.709 [2024-11-18 02:12:54.884611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.709 [2024-11-18 02:12:54.884624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.709 [2024-11-18 02:12:54.884637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.709 [2024-11-18 02:12:54.884666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.709 qpair failed and we were unable to recover it. 00:30:20.709 [2024-11-18 02:12:54.894650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.709 [2024-11-18 02:12:54.894734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.709 [2024-11-18 02:12:54.894760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.709 [2024-11-18 02:12:54.894774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.709 [2024-11-18 02:12:54.894787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.709 [2024-11-18 02:12:54.894828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.709 qpair failed and we were unable to recover it. 00:30:20.709 [2024-11-18 02:12:54.904566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.709 [2024-11-18 02:12:54.904653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:54.904682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:54.904698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:54.904711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:54.904741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:54.914663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:54.914744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:54.914770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:54.914791] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:54.914804] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:54.914835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:54.924613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:54.924727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:54.924753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:54.924767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:54.924780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:54.924811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:54.934595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:54.934690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:54.934716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:54.934730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:54.934742] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:54.934773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:54.944632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:54.944721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:54.944746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:54.944759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:54.944772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:54.944801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:54.954659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:54.954740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:54.954769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:54.954784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:54.954797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:54.954825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:54.964732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:54.964824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:54.964849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:54.964863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:54.964876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:54.964907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:54.974788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:54.974924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:54.974953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:54.974970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:54.974984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:54.975013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:54.984803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:54.984893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:54.984919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:54.984932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:54.984945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:54.984975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:54.994781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:54.994870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:54.994895] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:54.994909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:54.994922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:54.994950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:55.004899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:55.004990] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:55.005021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:55.005036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:55.005049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:55.005078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:55.014877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:55.014958] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:55.014984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:55.014998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:55.015011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:55.015040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:55.024876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:55.024955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:55.024981] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.710 [2024-11-18 02:12:55.024995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.710 [2024-11-18 02:12:55.025008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.710 [2024-11-18 02:12:55.025037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.710 qpair failed and we were unable to recover it. 00:30:20.710 [2024-11-18 02:12:55.035001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.710 [2024-11-18 02:12:55.035082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.710 [2024-11-18 02:12:55.035108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.711 [2024-11-18 02:12:55.035122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.711 [2024-11-18 02:12:55.035134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.711 [2024-11-18 02:12:55.035164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.711 qpair failed and we were unable to recover it. 00:30:20.711 [2024-11-18 02:12:55.044947] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.711 [2024-11-18 02:12:55.045040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.711 [2024-11-18 02:12:55.045065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.711 [2024-11-18 02:12:55.045079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.711 [2024-11-18 02:12:55.045092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.711 [2024-11-18 02:12:55.045121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.711 qpair failed and we were unable to recover it. 00:30:20.711 [2024-11-18 02:12:55.055001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.711 [2024-11-18 02:12:55.055108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.711 [2024-11-18 02:12:55.055134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.711 [2024-11-18 02:12:55.055148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.711 [2024-11-18 02:12:55.055161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.711 [2024-11-18 02:12:55.055190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.711 qpair failed and we were unable to recover it. 00:30:20.711 [2024-11-18 02:12:55.065071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.711 [2024-11-18 02:12:55.065158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.711 [2024-11-18 02:12:55.065184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.711 [2024-11-18 02:12:55.065198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.711 [2024-11-18 02:12:55.065210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.711 [2024-11-18 02:12:55.065239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.711 qpair failed and we were unable to recover it. 00:30:20.711 [2024-11-18 02:12:55.075044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.711 [2024-11-18 02:12:55.075166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.711 [2024-11-18 02:12:55.075191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.711 [2024-11-18 02:12:55.075206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.711 [2024-11-18 02:12:55.075218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.711 [2024-11-18 02:12:55.075248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.711 qpair failed and we were unable to recover it. 00:30:20.711 [2024-11-18 02:12:55.085064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.711 [2024-11-18 02:12:55.085152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.711 [2024-11-18 02:12:55.085178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.711 [2024-11-18 02:12:55.085192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.711 [2024-11-18 02:12:55.085205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.711 [2024-11-18 02:12:55.085245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.711 qpair failed and we were unable to recover it. 00:30:20.711 [2024-11-18 02:12:55.095079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.711 [2024-11-18 02:12:55.095161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.711 [2024-11-18 02:12:55.095194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.711 [2024-11-18 02:12:55.095209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.711 [2024-11-18 02:12:55.095222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.711 [2024-11-18 02:12:55.095251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.711 qpair failed and we were unable to recover it. 00:30:20.711 [2024-11-18 02:12:55.105117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.711 [2024-11-18 02:12:55.105199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.711 [2024-11-18 02:12:55.105224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.711 [2024-11-18 02:12:55.105239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.711 [2024-11-18 02:12:55.105251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.711 [2024-11-18 02:12:55.105280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.711 qpair failed and we were unable to recover it. 00:30:20.973 [2024-11-18 02:12:55.115123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.973 [2024-11-18 02:12:55.115211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.973 [2024-11-18 02:12:55.115238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.973 [2024-11-18 02:12:55.115259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.973 [2024-11-18 02:12:55.115273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.973 [2024-11-18 02:12:55.115303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.973 qpair failed and we were unable to recover it. 00:30:20.973 [2024-11-18 02:12:55.125276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.973 [2024-11-18 02:12:55.125371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.973 [2024-11-18 02:12:55.125397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.973 [2024-11-18 02:12:55.125411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.973 [2024-11-18 02:12:55.125424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.973 [2024-11-18 02:12:55.125453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.973 qpair failed and we were unable to recover it. 00:30:20.973 [2024-11-18 02:12:55.135240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.973 [2024-11-18 02:12:55.135334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.973 [2024-11-18 02:12:55.135360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.973 [2024-11-18 02:12:55.135374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.973 [2024-11-18 02:12:55.135387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.973 [2024-11-18 02:12:55.135427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.973 qpair failed and we were unable to recover it. 00:30:20.973 [2024-11-18 02:12:55.145245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.973 [2024-11-18 02:12:55.145341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.973 [2024-11-18 02:12:55.145368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.973 [2024-11-18 02:12:55.145381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.973 [2024-11-18 02:12:55.145395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.973 [2024-11-18 02:12:55.145424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.973 qpair failed and we were unable to recover it. 00:30:20.973 [2024-11-18 02:12:55.155291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.155419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.155445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.155459] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.155472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.155503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.165348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.165434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.165461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.165481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.165494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.165524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.175326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.175412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.175437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.175451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.175464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.175496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.185337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.185424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.185455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.185470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.185483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.185512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.195372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.195495] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.195520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.195533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.195547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.195578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.205464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.205549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.205578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.205592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.205606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.205635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.215440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.215527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.215553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.215567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.215579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.215609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.225444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.225525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.225550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.225564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.225583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.225612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.235505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.235620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.235645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.235658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.235671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.235702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.245519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.245609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.245634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.245648] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.245661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.245692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.255619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.255706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.255731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.255745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.255759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.255788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.265584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.265672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.265698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.265712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.265725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.265754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.275577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.275670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.275696] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.974 [2024-11-18 02:12:55.275710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.974 [2024-11-18 02:12:55.275723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.974 [2024-11-18 02:12:55.275751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.974 qpair failed and we were unable to recover it. 00:30:20.974 [2024-11-18 02:12:55.285644] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.974 [2024-11-18 02:12:55.285734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.974 [2024-11-18 02:12:55.285760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.975 [2024-11-18 02:12:55.285773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.975 [2024-11-18 02:12:55.285787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.975 [2024-11-18 02:12:55.285817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.975 qpair failed and we were unable to recover it. 00:30:20.975 [2024-11-18 02:12:55.295715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.975 [2024-11-18 02:12:55.295825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.975 [2024-11-18 02:12:55.295850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.975 [2024-11-18 02:12:55.295864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.975 [2024-11-18 02:12:55.295877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.975 [2024-11-18 02:12:55.295906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.975 qpair failed and we were unable to recover it. 00:30:20.975 [2024-11-18 02:12:55.305708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.975 [2024-11-18 02:12:55.305811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.975 [2024-11-18 02:12:55.305837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.975 [2024-11-18 02:12:55.305851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.975 [2024-11-18 02:12:55.305864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.975 [2024-11-18 02:12:55.305892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.975 qpair failed and we were unable to recover it. 00:30:20.975 [2024-11-18 02:12:55.315835] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.975 [2024-11-18 02:12:55.315918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.975 [2024-11-18 02:12:55.315943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.975 [2024-11-18 02:12:55.315957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.975 [2024-11-18 02:12:55.315975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.975 [2024-11-18 02:12:55.316004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.975 qpair failed and we were unable to recover it. 00:30:20.975 [2024-11-18 02:12:55.325787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.975 [2024-11-18 02:12:55.325887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.975 [2024-11-18 02:12:55.325912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.975 [2024-11-18 02:12:55.325926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.975 [2024-11-18 02:12:55.325939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.975 [2024-11-18 02:12:55.325968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.975 qpair failed and we were unable to recover it. 00:30:20.975 [2024-11-18 02:12:55.335756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.975 [2024-11-18 02:12:55.335849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.975 [2024-11-18 02:12:55.335874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.975 [2024-11-18 02:12:55.335888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.975 [2024-11-18 02:12:55.335901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.975 [2024-11-18 02:12:55.335930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.975 qpair failed and we were unable to recover it. 00:30:20.975 [2024-11-18 02:12:55.345817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.975 [2024-11-18 02:12:55.345905] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.975 [2024-11-18 02:12:55.345934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.975 [2024-11-18 02:12:55.345949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.975 [2024-11-18 02:12:55.345962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.975 [2024-11-18 02:12:55.345993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.975 qpair failed and we were unable to recover it. 00:30:20.975 [2024-11-18 02:12:55.355822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.975 [2024-11-18 02:12:55.355911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.975 [2024-11-18 02:12:55.355936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.975 [2024-11-18 02:12:55.355950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.975 [2024-11-18 02:12:55.355963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.975 [2024-11-18 02:12:55.355993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.975 qpair failed and we were unable to recover it. 00:30:20.975 [2024-11-18 02:12:55.365890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.975 [2024-11-18 02:12:55.366007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.975 [2024-11-18 02:12:55.366032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.975 [2024-11-18 02:12:55.366046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.975 [2024-11-18 02:12:55.366059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:20.975 [2024-11-18 02:12:55.366087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:20.975 qpair failed and we were unable to recover it. 00:30:21.236 [2024-11-18 02:12:55.375877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.236 [2024-11-18 02:12:55.375964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.236 [2024-11-18 02:12:55.375990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.236 [2024-11-18 02:12:55.376004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.236 [2024-11-18 02:12:55.376017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.236 [2024-11-18 02:12:55.376047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.236 qpair failed and we were unable to recover it. 00:30:21.236 [2024-11-18 02:12:55.385918] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.236 [2024-11-18 02:12:55.386017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.236 [2024-11-18 02:12:55.386046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.236 [2024-11-18 02:12:55.386063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.236 [2024-11-18 02:12:55.386076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.236 [2024-11-18 02:12:55.386106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.236 qpair failed and we were unable to recover it. 00:30:21.236 [2024-11-18 02:12:55.395944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.236 [2024-11-18 02:12:55.396026] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.236 [2024-11-18 02:12:55.396052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.236 [2024-11-18 02:12:55.396066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.236 [2024-11-18 02:12:55.396079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.236 [2024-11-18 02:12:55.396110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.236 qpair failed and we were unable to recover it. 00:30:21.236 [2024-11-18 02:12:55.405999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.236 [2024-11-18 02:12:55.406083] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.236 [2024-11-18 02:12:55.406109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.236 [2024-11-18 02:12:55.406130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.236 [2024-11-18 02:12:55.406144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.236 [2024-11-18 02:12:55.406173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.236 qpair failed and we were unable to recover it. 00:30:21.236 [2024-11-18 02:12:55.416019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.236 [2024-11-18 02:12:55.416107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.236 [2024-11-18 02:12:55.416133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.236 [2024-11-18 02:12:55.416147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.236 [2024-11-18 02:12:55.416160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.236 [2024-11-18 02:12:55.416191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.236 qpair failed and we were unable to recover it. 00:30:21.236 [2024-11-18 02:12:55.426110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.236 [2024-11-18 02:12:55.426206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.236 [2024-11-18 02:12:55.426230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.236 [2024-11-18 02:12:55.426243] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.236 [2024-11-18 02:12:55.426255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.236 [2024-11-18 02:12:55.426283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.236 qpair failed and we were unable to recover it. 00:30:21.236 [2024-11-18 02:12:55.436071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.236 [2024-11-18 02:12:55.436163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.236 [2024-11-18 02:12:55.436188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.236 [2024-11-18 02:12:55.436202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.236 [2024-11-18 02:12:55.436215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.236 [2024-11-18 02:12:55.436244] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.236 qpair failed and we were unable to recover it. 00:30:21.236 [2024-11-18 02:12:55.446106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.236 [2024-11-18 02:12:55.446217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.236 [2024-11-18 02:12:55.446243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.236 [2024-11-18 02:12:55.446257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.236 [2024-11-18 02:12:55.446270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.236 [2024-11-18 02:12:55.446299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.236 qpair failed and we were unable to recover it. 00:30:21.236 [2024-11-18 02:12:55.456125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.456207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.456233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.456246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.456259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.456289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.466156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.466239] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.466265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.466279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.466292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.466328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.476185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.476267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.476292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.476306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.476328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.476358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.486232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.486326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.486353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.486367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.486379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.486408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.496272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.496369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.496395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.496415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.496429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.496458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.506289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.506390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.506421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.506442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.506456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.506489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.516329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.516412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.516439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.516453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.516466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.516498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.526384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.526476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.526502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.526516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.526529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.526559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.536461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.536586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.536612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.536627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.536639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.536669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.546400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.546489] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.546514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.546528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.546540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.546569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.556512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.556598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.556623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.556636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.556649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.556678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.566469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.566553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.566579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.566593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.566606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.566634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.576584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.576712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.576737] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.576751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.237 [2024-11-18 02:12:55.576764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.237 [2024-11-18 02:12:55.576794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.237 qpair failed and we were unable to recover it. 00:30:21.237 [2024-11-18 02:12:55.586510] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.237 [2024-11-18 02:12:55.586599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.237 [2024-11-18 02:12:55.586629] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.237 [2024-11-18 02:12:55.586644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.238 [2024-11-18 02:12:55.586656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.238 [2024-11-18 02:12:55.586685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.238 qpair failed and we were unable to recover it. 00:30:21.238 [2024-11-18 02:12:55.596539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.238 [2024-11-18 02:12:55.596621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.238 [2024-11-18 02:12:55.596646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.238 [2024-11-18 02:12:55.596660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.238 [2024-11-18 02:12:55.596673] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.238 [2024-11-18 02:12:55.596703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.238 qpair failed and we were unable to recover it. 00:30:21.238 [2024-11-18 02:12:55.606667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.238 [2024-11-18 02:12:55.606759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.238 [2024-11-18 02:12:55.606785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.238 [2024-11-18 02:12:55.606799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.238 [2024-11-18 02:12:55.606812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.238 [2024-11-18 02:12:55.606841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.238 qpair failed and we were unable to recover it. 00:30:21.238 [2024-11-18 02:12:55.616672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.238 [2024-11-18 02:12:55.616775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.238 [2024-11-18 02:12:55.616800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.238 [2024-11-18 02:12:55.616814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.238 [2024-11-18 02:12:55.616829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.238 [2024-11-18 02:12:55.616872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.238 qpair failed and we were unable to recover it. 00:30:21.238 [2024-11-18 02:12:55.626707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.238 [2024-11-18 02:12:55.626791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.238 [2024-11-18 02:12:55.626817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.238 [2024-11-18 02:12:55.626832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.238 [2024-11-18 02:12:55.626844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.238 [2024-11-18 02:12:55.626879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.238 qpair failed and we were unable to recover it. 00:30:21.238 [2024-11-18 02:12:55.636641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.238 [2024-11-18 02:12:55.636728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.238 [2024-11-18 02:12:55.636758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.238 [2024-11-18 02:12:55.636775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.238 [2024-11-18 02:12:55.636788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3004000b90 00:30:21.238 [2024-11-18 02:12:55.636818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.238 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-18 02:12:55.646697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.496 [2024-11-18 02:12:55.646788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.496 [2024-11-18 02:12:55.646820] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.496 [2024-11-18 02:12:55.646837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.496 [2024-11-18 02:12:55.646851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x16ee390 00:30:21.496 [2024-11-18 02:12:55.646882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-18 02:12:55.656705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.496 [2024-11-18 02:12:55.656796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.496 [2024-11-18 02:12:55.656827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.496 [2024-11-18 02:12:55.656843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.496 [2024-11-18 02:12:55.656857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x16ee390 00:30:21.496 [2024-11-18 02:12:55.656887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:21.496 qpair failed and we were unable to recover it. 00:30:21.496 [2024-11-18 02:12:55.657004] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:21.496 A controller has encountered a failure and is being reset. 00:30:21.496 Controller properly reset. 00:30:21.496 Initializing NVMe Controllers 00:30:21.496 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:21.496 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:21.496 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:21.497 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:21.497 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:21.497 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:21.497 Initialization complete. Launching workers. 00:30:21.497 Starting thread on core 1 00:30:21.497 Starting thread on core 2 00:30:21.497 Starting thread on core 3 00:30:21.497 Starting thread on core 0 00:30:21.497 02:12:55 -- host/target_disconnect.sh@59 -- # sync 00:30:21.497 00:30:21.497 real 0m11.613s 00:30:21.497 user 0m21.594s 00:30:21.497 sys 0m5.205s 00:30:21.497 02:12:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:21.497 02:12:55 -- common/autotest_common.sh@10 -- # set +x 00:30:21.497 ************************************ 00:30:21.497 END TEST nvmf_target_disconnect_tc2 00:30:21.497 ************************************ 00:30:21.497 02:12:55 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:21.497 02:12:55 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:21.497 02:12:55 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:21.497 02:12:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:21.497 02:12:55 -- nvmf/common.sh@116 -- # sync 00:30:21.497 02:12:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:21.497 02:12:55 -- nvmf/common.sh@119 -- # set +e 00:30:21.497 02:12:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:21.497 02:12:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:21.497 rmmod nvme_tcp 00:30:21.497 rmmod nvme_fabrics 00:30:21.497 rmmod nvme_keyring 00:30:21.497 02:12:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:21.497 02:12:55 -- nvmf/common.sh@123 -- # set -e 00:30:21.497 02:12:55 -- nvmf/common.sh@124 -- # return 0 00:30:21.497 02:12:55 -- nvmf/common.sh@477 -- # '[' -n 1337455 ']' 00:30:21.497 02:12:55 -- nvmf/common.sh@478 -- # killprocess 1337455 00:30:21.497 02:12:55 -- common/autotest_common.sh@936 -- # '[' -z 1337455 ']' 00:30:21.497 02:12:55 -- common/autotest_common.sh@940 -- # kill -0 1337455 00:30:21.497 02:12:55 -- common/autotest_common.sh@941 -- # uname 00:30:21.497 02:12:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:21.497 02:12:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1337455 00:30:21.497 02:12:55 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:21.497 02:12:55 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:21.497 02:12:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1337455' 00:30:21.497 killing process with pid 1337455 00:30:21.497 02:12:55 -- common/autotest_common.sh@955 -- # kill 1337455 00:30:21.497 02:12:55 -- common/autotest_common.sh@960 -- # wait 1337455 00:30:21.755 02:12:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:21.756 02:12:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:21.756 02:12:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:21.756 02:12:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:21.756 02:12:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:21.756 02:12:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:21.756 02:12:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:21.756 02:12:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:24.288 02:12:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:24.288 00:30:24.288 real 0m16.531s 00:30:24.288 user 0m48.307s 00:30:24.288 sys 0m7.191s 00:30:24.288 02:12:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:24.288 02:12:58 -- common/autotest_common.sh@10 -- # set +x 00:30:24.288 ************************************ 00:30:24.288 END TEST nvmf_target_disconnect 00:30:24.288 ************************************ 00:30:24.288 02:12:58 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:24.288 02:12:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:24.288 02:12:58 -- common/autotest_common.sh@10 -- # set +x 00:30:24.288 02:12:58 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:24.288 00:30:24.288 real 22m53.240s 00:30:24.288 user 66m27.987s 00:30:24.288 sys 5m23.999s 00:30:24.288 02:12:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:24.288 02:12:58 -- common/autotest_common.sh@10 -- # set +x 00:30:24.288 ************************************ 00:30:24.288 END TEST nvmf_tcp 00:30:24.288 ************************************ 00:30:24.288 02:12:58 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:24.288 02:12:58 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:24.288 02:12:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:24.288 02:12:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:24.288 02:12:58 -- common/autotest_common.sh@10 -- # set +x 00:30:24.288 ************************************ 00:30:24.288 START TEST spdkcli_nvmf_tcp 00:30:24.288 ************************************ 00:30:24.288 02:12:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:24.288 * Looking for test storage... 00:30:24.288 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:24.288 02:12:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:24.288 02:12:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:24.288 02:12:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:24.288 02:12:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:24.288 02:12:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:24.288 02:12:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:24.288 02:12:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:24.288 02:12:58 -- scripts/common.sh@335 -- # IFS=.-: 00:30:24.288 02:12:58 -- scripts/common.sh@335 -- # read -ra ver1 00:30:24.288 02:12:58 -- scripts/common.sh@336 -- # IFS=.-: 00:30:24.288 02:12:58 -- scripts/common.sh@336 -- # read -ra ver2 00:30:24.288 02:12:58 -- scripts/common.sh@337 -- # local 'op=<' 00:30:24.288 02:12:58 -- scripts/common.sh@339 -- # ver1_l=2 00:30:24.288 02:12:58 -- scripts/common.sh@340 -- # ver2_l=1 00:30:24.289 02:12:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:24.289 02:12:58 -- scripts/common.sh@343 -- # case "$op" in 00:30:24.289 02:12:58 -- scripts/common.sh@344 -- # : 1 00:30:24.289 02:12:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:24.289 02:12:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:24.289 02:12:58 -- scripts/common.sh@364 -- # decimal 1 00:30:24.289 02:12:58 -- scripts/common.sh@352 -- # local d=1 00:30:24.289 02:12:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:24.289 02:12:58 -- scripts/common.sh@354 -- # echo 1 00:30:24.289 02:12:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:24.289 02:12:58 -- scripts/common.sh@365 -- # decimal 2 00:30:24.289 02:12:58 -- scripts/common.sh@352 -- # local d=2 00:30:24.289 02:12:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:24.289 02:12:58 -- scripts/common.sh@354 -- # echo 2 00:30:24.289 02:12:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:24.289 02:12:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:24.289 02:12:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:24.289 02:12:58 -- scripts/common.sh@367 -- # return 0 00:30:24.289 02:12:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:24.289 02:12:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:24.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:24.289 --rc genhtml_branch_coverage=1 00:30:24.289 --rc genhtml_function_coverage=1 00:30:24.289 --rc genhtml_legend=1 00:30:24.289 --rc geninfo_all_blocks=1 00:30:24.289 --rc geninfo_unexecuted_blocks=1 00:30:24.289 00:30:24.289 ' 00:30:24.289 02:12:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:24.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:24.289 --rc genhtml_branch_coverage=1 00:30:24.289 --rc genhtml_function_coverage=1 00:30:24.289 --rc genhtml_legend=1 00:30:24.289 --rc geninfo_all_blocks=1 00:30:24.289 --rc geninfo_unexecuted_blocks=1 00:30:24.289 00:30:24.289 ' 00:30:24.289 02:12:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:24.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:24.289 --rc genhtml_branch_coverage=1 00:30:24.289 --rc genhtml_function_coverage=1 00:30:24.289 --rc genhtml_legend=1 00:30:24.289 --rc geninfo_all_blocks=1 00:30:24.289 --rc geninfo_unexecuted_blocks=1 00:30:24.289 00:30:24.289 ' 00:30:24.289 02:12:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:24.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:24.289 --rc genhtml_branch_coverage=1 00:30:24.289 --rc genhtml_function_coverage=1 00:30:24.289 --rc genhtml_legend=1 00:30:24.289 --rc geninfo_all_blocks=1 00:30:24.289 --rc geninfo_unexecuted_blocks=1 00:30:24.289 00:30:24.289 ' 00:30:24.289 02:12:58 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:24.289 02:12:58 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:24.289 02:12:58 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:24.289 02:12:58 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:24.289 02:12:58 -- nvmf/common.sh@7 -- # uname -s 00:30:24.289 02:12:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:24.289 02:12:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:24.289 02:12:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:24.289 02:12:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:24.289 02:12:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:24.289 02:12:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:24.289 02:12:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:24.289 02:12:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:24.289 02:12:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:24.289 02:12:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:24.289 02:12:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:24.289 02:12:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:24.289 02:12:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:24.289 02:12:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:24.289 02:12:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:24.289 02:12:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:24.289 02:12:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:24.289 02:12:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:24.289 02:12:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:24.289 02:12:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:24.289 02:12:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:24.289 02:12:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:24.289 02:12:58 -- paths/export.sh@5 -- # export PATH 00:30:24.289 02:12:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:24.289 02:12:58 -- nvmf/common.sh@46 -- # : 0 00:30:24.289 02:12:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:24.289 02:12:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:24.289 02:12:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:24.289 02:12:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:24.289 02:12:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:24.289 02:12:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:24.289 02:12:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:24.289 02:12:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:24.289 02:12:58 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:24.289 02:12:58 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:24.289 02:12:58 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:24.289 02:12:58 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:24.289 02:12:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:24.289 02:12:58 -- common/autotest_common.sh@10 -- # set +x 00:30:24.289 02:12:58 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:24.289 02:12:58 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1338686 00:30:24.289 02:12:58 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:24.289 02:12:58 -- spdkcli/common.sh@34 -- # waitforlisten 1338686 00:30:24.289 02:12:58 -- common/autotest_common.sh@829 -- # '[' -z 1338686 ']' 00:30:24.289 02:12:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:24.289 02:12:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:24.289 02:12:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:24.289 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:24.289 02:12:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:24.289 02:12:58 -- common/autotest_common.sh@10 -- # set +x 00:30:24.289 [2024-11-18 02:12:58.370562] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:24.289 [2024-11-18 02:12:58.370658] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1338686 ] 00:30:24.289 EAL: No free 2048 kB hugepages reported on node 1 00:30:24.289 [2024-11-18 02:12:58.429655] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:24.289 [2024-11-18 02:12:58.516020] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:24.289 [2024-11-18 02:12:58.516246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:24.289 [2024-11-18 02:12:58.516253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:25.225 02:12:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:25.225 02:12:59 -- common/autotest_common.sh@862 -- # return 0 00:30:25.225 02:12:59 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:25.225 02:12:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:25.225 02:12:59 -- common/autotest_common.sh@10 -- # set +x 00:30:25.225 02:12:59 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:25.225 02:12:59 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:25.225 02:12:59 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:25.225 02:12:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:25.225 02:12:59 -- common/autotest_common.sh@10 -- # set +x 00:30:25.225 02:12:59 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:25.225 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:25.225 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:25.225 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:25.225 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:25.225 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:25.225 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:25.225 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:25.225 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:25.225 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:25.225 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:25.226 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:25.226 ' 00:30:25.485 [2024-11-18 02:12:59.761714] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:28.021 [2024-11-18 02:13:01.967058] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:28.959 [2024-11-18 02:13:03.219588] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:31.492 [2024-11-18 02:13:05.542938] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:33.397 [2024-11-18 02:13:07.545495] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:34.777 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:34.777 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:34.777 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:34.777 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:34.777 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:34.777 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:34.777 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:34.777 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:34.777 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:34.777 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:34.777 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:34.777 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:34.777 02:13:09 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:34.777 02:13:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:34.777 02:13:09 -- common/autotest_common.sh@10 -- # set +x 00:30:35.036 02:13:09 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:35.036 02:13:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:35.036 02:13:09 -- common/autotest_common.sh@10 -- # set +x 00:30:35.036 02:13:09 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:35.036 02:13:09 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:35.294 02:13:09 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:35.294 02:13:09 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:35.294 02:13:09 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:35.295 02:13:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:35.295 02:13:09 -- common/autotest_common.sh@10 -- # set +x 00:30:35.295 02:13:09 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:35.295 02:13:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:35.295 02:13:09 -- common/autotest_common.sh@10 -- # set +x 00:30:35.295 02:13:09 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:35.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:35.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:35.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:35.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:35.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:35.295 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:35.295 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:35.295 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:35.295 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:35.295 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:35.295 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:35.295 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:35.295 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:35.295 ' 00:30:40.573 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:30:40.573 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:30:40.573 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:40.573 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:30:40.573 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:30:40.573 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:30:40.573 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:30:40.573 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:40.573 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:30:40.573 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:30:40.573 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:30:40.573 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:30:40.573 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:30:40.573 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:30:40.832 02:13:14 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:30:40.832 02:13:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:40.832 02:13:14 -- common/autotest_common.sh@10 -- # set +x 00:30:40.832 02:13:15 -- spdkcli/nvmf.sh@90 -- # killprocess 1338686 00:30:40.832 02:13:15 -- common/autotest_common.sh@936 -- # '[' -z 1338686 ']' 00:30:40.832 02:13:15 -- common/autotest_common.sh@940 -- # kill -0 1338686 00:30:40.832 02:13:15 -- common/autotest_common.sh@941 -- # uname 00:30:40.832 02:13:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:40.832 02:13:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1338686 00:30:40.832 02:13:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:40.832 02:13:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:40.832 02:13:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1338686' 00:30:40.832 killing process with pid 1338686 00:30:40.832 02:13:15 -- common/autotest_common.sh@955 -- # kill 1338686 00:30:40.832 [2024-11-18 02:13:15.064328] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:40.832 02:13:15 -- common/autotest_common.sh@960 -- # wait 1338686 00:30:41.091 02:13:15 -- spdkcli/nvmf.sh@1 -- # cleanup 00:30:41.091 02:13:15 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:30:41.091 02:13:15 -- spdkcli/common.sh@13 -- # '[' -n 1338686 ']' 00:30:41.091 02:13:15 -- spdkcli/common.sh@14 -- # killprocess 1338686 00:30:41.091 02:13:15 -- common/autotest_common.sh@936 -- # '[' -z 1338686 ']' 00:30:41.091 02:13:15 -- common/autotest_common.sh@940 -- # kill -0 1338686 00:30:41.091 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1338686) - No such process 00:30:41.091 02:13:15 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1338686 is not found' 00:30:41.091 Process with pid 1338686 is not found 00:30:41.091 02:13:15 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:30:41.091 02:13:15 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:30:41.091 02:13:15 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:30:41.091 00:30:41.091 real 0m17.105s 00:30:41.091 user 0m36.644s 00:30:41.091 sys 0m0.800s 00:30:41.091 02:13:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:41.091 02:13:15 -- common/autotest_common.sh@10 -- # set +x 00:30:41.091 ************************************ 00:30:41.091 END TEST spdkcli_nvmf_tcp 00:30:41.091 ************************************ 00:30:41.091 02:13:15 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:41.091 02:13:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:41.091 02:13:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:41.091 02:13:15 -- common/autotest_common.sh@10 -- # set +x 00:30:41.091 ************************************ 00:30:41.091 START TEST nvmf_identify_passthru 00:30:41.091 ************************************ 00:30:41.091 02:13:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:41.091 * Looking for test storage... 00:30:41.091 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:41.091 02:13:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:41.091 02:13:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:41.091 02:13:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:41.091 02:13:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:41.091 02:13:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:41.091 02:13:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:41.091 02:13:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:41.091 02:13:15 -- scripts/common.sh@335 -- # IFS=.-: 00:30:41.091 02:13:15 -- scripts/common.sh@335 -- # read -ra ver1 00:30:41.091 02:13:15 -- scripts/common.sh@336 -- # IFS=.-: 00:30:41.091 02:13:15 -- scripts/common.sh@336 -- # read -ra ver2 00:30:41.091 02:13:15 -- scripts/common.sh@337 -- # local 'op=<' 00:30:41.091 02:13:15 -- scripts/common.sh@339 -- # ver1_l=2 00:30:41.091 02:13:15 -- scripts/common.sh@340 -- # ver2_l=1 00:30:41.091 02:13:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:41.091 02:13:15 -- scripts/common.sh@343 -- # case "$op" in 00:30:41.091 02:13:15 -- scripts/common.sh@344 -- # : 1 00:30:41.091 02:13:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:41.091 02:13:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:41.091 02:13:15 -- scripts/common.sh@364 -- # decimal 1 00:30:41.091 02:13:15 -- scripts/common.sh@352 -- # local d=1 00:30:41.091 02:13:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:41.091 02:13:15 -- scripts/common.sh@354 -- # echo 1 00:30:41.091 02:13:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:41.091 02:13:15 -- scripts/common.sh@365 -- # decimal 2 00:30:41.091 02:13:15 -- scripts/common.sh@352 -- # local d=2 00:30:41.091 02:13:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:41.092 02:13:15 -- scripts/common.sh@354 -- # echo 2 00:30:41.092 02:13:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:41.092 02:13:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:41.092 02:13:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:41.092 02:13:15 -- scripts/common.sh@367 -- # return 0 00:30:41.092 02:13:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:41.092 02:13:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:41.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:41.092 --rc genhtml_branch_coverage=1 00:30:41.092 --rc genhtml_function_coverage=1 00:30:41.092 --rc genhtml_legend=1 00:30:41.092 --rc geninfo_all_blocks=1 00:30:41.092 --rc geninfo_unexecuted_blocks=1 00:30:41.092 00:30:41.092 ' 00:30:41.092 02:13:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:41.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:41.092 --rc genhtml_branch_coverage=1 00:30:41.092 --rc genhtml_function_coverage=1 00:30:41.092 --rc genhtml_legend=1 00:30:41.092 --rc geninfo_all_blocks=1 00:30:41.092 --rc geninfo_unexecuted_blocks=1 00:30:41.092 00:30:41.092 ' 00:30:41.092 02:13:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:41.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:41.092 --rc genhtml_branch_coverage=1 00:30:41.092 --rc genhtml_function_coverage=1 00:30:41.092 --rc genhtml_legend=1 00:30:41.092 --rc geninfo_all_blocks=1 00:30:41.092 --rc geninfo_unexecuted_blocks=1 00:30:41.092 00:30:41.092 ' 00:30:41.092 02:13:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:41.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:41.092 --rc genhtml_branch_coverage=1 00:30:41.092 --rc genhtml_function_coverage=1 00:30:41.092 --rc genhtml_legend=1 00:30:41.092 --rc geninfo_all_blocks=1 00:30:41.092 --rc geninfo_unexecuted_blocks=1 00:30:41.092 00:30:41.092 ' 00:30:41.092 02:13:15 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:41.092 02:13:15 -- nvmf/common.sh@7 -- # uname -s 00:30:41.092 02:13:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:41.092 02:13:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:41.092 02:13:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:41.092 02:13:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:41.092 02:13:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:41.092 02:13:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:41.092 02:13:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:41.092 02:13:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:41.092 02:13:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:41.092 02:13:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:41.092 02:13:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:41.092 02:13:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:41.092 02:13:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:41.092 02:13:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:41.092 02:13:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:41.092 02:13:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:41.092 02:13:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:41.092 02:13:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:41.092 02:13:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:41.092 02:13:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:41.092 02:13:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:41.092 02:13:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:41.092 02:13:15 -- paths/export.sh@5 -- # export PATH 00:30:41.092 02:13:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:41.092 02:13:15 -- nvmf/common.sh@46 -- # : 0 00:30:41.092 02:13:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:41.092 02:13:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:41.092 02:13:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:41.092 02:13:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:41.092 02:13:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:41.092 02:13:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:41.092 02:13:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:41.092 02:13:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:41.092 02:13:15 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:41.092 02:13:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:41.092 02:13:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:41.092 02:13:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:41.092 02:13:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:41.092 02:13:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:41.092 02:13:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:41.092 02:13:15 -- paths/export.sh@5 -- # export PATH 00:30:41.092 02:13:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:41.092 02:13:15 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:30:41.092 02:13:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:41.092 02:13:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:41.092 02:13:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:41.092 02:13:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:41.092 02:13:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:41.092 02:13:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:41.092 02:13:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:41.092 02:13:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:41.092 02:13:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:41.092 02:13:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:41.092 02:13:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:41.092 02:13:15 -- common/autotest_common.sh@10 -- # set +x 00:30:43.623 02:13:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:43.623 02:13:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:43.623 02:13:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:43.623 02:13:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:43.623 02:13:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:43.623 02:13:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:43.623 02:13:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:43.623 02:13:17 -- nvmf/common.sh@294 -- # net_devs=() 00:30:43.623 02:13:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:43.623 02:13:17 -- nvmf/common.sh@295 -- # e810=() 00:30:43.623 02:13:17 -- nvmf/common.sh@295 -- # local -ga e810 00:30:43.623 02:13:17 -- nvmf/common.sh@296 -- # x722=() 00:30:43.623 02:13:17 -- nvmf/common.sh@296 -- # local -ga x722 00:30:43.623 02:13:17 -- nvmf/common.sh@297 -- # mlx=() 00:30:43.623 02:13:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:43.623 02:13:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:43.623 02:13:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:43.623 02:13:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:43.623 02:13:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:43.623 02:13:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:43.623 02:13:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:43.623 02:13:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:43.623 02:13:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:43.623 02:13:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:43.623 02:13:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:43.623 02:13:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:43.623 02:13:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:43.623 02:13:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:43.623 02:13:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:43.623 02:13:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:43.623 02:13:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:43.623 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:43.623 02:13:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:43.623 02:13:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:43.623 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:43.623 02:13:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:43.623 02:13:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:43.623 02:13:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:43.623 02:13:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:43.623 02:13:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:43.623 02:13:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:43.623 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:43.623 02:13:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:43.623 02:13:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:43.623 02:13:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:43.623 02:13:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:43.623 02:13:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:43.623 02:13:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:43.623 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:43.623 02:13:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:43.623 02:13:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:43.623 02:13:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:43.623 02:13:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:43.623 02:13:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:43.623 02:13:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:43.623 02:13:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:43.623 02:13:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:43.623 02:13:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:43.623 02:13:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:43.623 02:13:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:43.623 02:13:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:43.623 02:13:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:43.623 02:13:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:43.623 02:13:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:43.623 02:13:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:43.623 02:13:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:43.623 02:13:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:43.623 02:13:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:43.623 02:13:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:43.624 02:13:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:43.624 02:13:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:43.624 02:13:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:43.624 02:13:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:43.624 02:13:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:43.624 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:43.624 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.395 ms 00:30:43.624 00:30:43.624 --- 10.0.0.2 ping statistics --- 00:30:43.624 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:43.624 rtt min/avg/max/mdev = 0.395/0.395/0.395/0.000 ms 00:30:43.624 02:13:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:43.624 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:43.624 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.246 ms 00:30:43.624 00:30:43.624 --- 10.0.0.1 ping statistics --- 00:30:43.624 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:43.624 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:30:43.624 02:13:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:43.624 02:13:17 -- nvmf/common.sh@410 -- # return 0 00:30:43.624 02:13:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:43.624 02:13:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:43.624 02:13:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:43.624 02:13:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:43.624 02:13:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:43.624 02:13:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:43.624 02:13:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:43.624 02:13:17 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:30:43.624 02:13:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:43.624 02:13:17 -- common/autotest_common.sh@10 -- # set +x 00:30:43.624 02:13:17 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:30:43.624 02:13:17 -- common/autotest_common.sh@1519 -- # bdfs=() 00:30:43.624 02:13:17 -- common/autotest_common.sh@1519 -- # local bdfs 00:30:43.624 02:13:17 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:30:43.624 02:13:17 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:30:43.624 02:13:17 -- common/autotest_common.sh@1508 -- # bdfs=() 00:30:43.624 02:13:17 -- common/autotest_common.sh@1508 -- # local bdfs 00:30:43.624 02:13:17 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:30:43.624 02:13:17 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:30:43.624 02:13:17 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:30:43.624 02:13:17 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:30:43.624 02:13:17 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:30:43.624 02:13:17 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:30:43.624 02:13:17 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:30:43.624 02:13:17 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:30:43.624 02:13:17 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:43.624 02:13:17 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:30:43.624 02:13:17 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:30:43.624 EAL: No free 2048 kB hugepages reported on node 1 00:30:47.805 02:13:21 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:30:47.805 02:13:21 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:47.805 02:13:21 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:30:47.805 02:13:21 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:30:47.805 EAL: No free 2048 kB hugepages reported on node 1 00:30:51.989 02:13:26 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:30:51.989 02:13:26 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:30:51.989 02:13:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:51.989 02:13:26 -- common/autotest_common.sh@10 -- # set +x 00:30:51.989 02:13:26 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:30:51.989 02:13:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:51.989 02:13:26 -- common/autotest_common.sh@10 -- # set +x 00:30:51.989 02:13:26 -- target/identify_passthru.sh@31 -- # nvmfpid=1343417 00:30:51.989 02:13:26 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:30:51.989 02:13:26 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:30:51.989 02:13:26 -- target/identify_passthru.sh@35 -- # waitforlisten 1343417 00:30:51.989 02:13:26 -- common/autotest_common.sh@829 -- # '[' -z 1343417 ']' 00:30:51.989 02:13:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:51.989 02:13:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:51.989 02:13:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:51.989 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:51.989 02:13:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:51.989 02:13:26 -- common/autotest_common.sh@10 -- # set +x 00:30:51.989 [2024-11-18 02:13:26.158777] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:51.989 [2024-11-18 02:13:26.158870] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:51.989 EAL: No free 2048 kB hugepages reported on node 1 00:30:51.989 [2024-11-18 02:13:26.229807] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:51.989 [2024-11-18 02:13:26.318546] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:51.989 [2024-11-18 02:13:26.318706] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:51.989 [2024-11-18 02:13:26.318731] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:51.989 [2024-11-18 02:13:26.318744] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:51.989 [2024-11-18 02:13:26.318812] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:51.989 [2024-11-18 02:13:26.318938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:51.989 [2024-11-18 02:13:26.319008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:51.989 [2024-11-18 02:13:26.319010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:51.989 02:13:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:51.989 02:13:26 -- common/autotest_common.sh@862 -- # return 0 00:30:51.989 02:13:26 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:30:51.989 02:13:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:51.989 02:13:26 -- common/autotest_common.sh@10 -- # set +x 00:30:51.989 INFO: Log level set to 20 00:30:51.989 INFO: Requests: 00:30:51.989 { 00:30:51.989 "jsonrpc": "2.0", 00:30:51.989 "method": "nvmf_set_config", 00:30:51.989 "id": 1, 00:30:51.989 "params": { 00:30:51.989 "admin_cmd_passthru": { 00:30:51.989 "identify_ctrlr": true 00:30:51.989 } 00:30:51.989 } 00:30:51.989 } 00:30:51.989 00:30:52.247 INFO: response: 00:30:52.247 { 00:30:52.247 "jsonrpc": "2.0", 00:30:52.247 "id": 1, 00:30:52.247 "result": true 00:30:52.247 } 00:30:52.247 00:30:52.247 02:13:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:52.247 02:13:26 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:30:52.247 02:13:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:52.247 02:13:26 -- common/autotest_common.sh@10 -- # set +x 00:30:52.247 INFO: Setting log level to 20 00:30:52.247 INFO: Setting log level to 20 00:30:52.247 INFO: Log level set to 20 00:30:52.247 INFO: Log level set to 20 00:30:52.247 INFO: Requests: 00:30:52.247 { 00:30:52.247 "jsonrpc": "2.0", 00:30:52.247 "method": "framework_start_init", 00:30:52.247 "id": 1 00:30:52.247 } 00:30:52.247 00:30:52.247 INFO: Requests: 00:30:52.247 { 00:30:52.247 "jsonrpc": "2.0", 00:30:52.247 "method": "framework_start_init", 00:30:52.247 "id": 1 00:30:52.247 } 00:30:52.247 00:30:52.247 [2024-11-18 02:13:26.502661] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:30:52.247 INFO: response: 00:30:52.247 { 00:30:52.247 "jsonrpc": "2.0", 00:30:52.247 "id": 1, 00:30:52.247 "result": true 00:30:52.247 } 00:30:52.247 00:30:52.247 INFO: response: 00:30:52.247 { 00:30:52.247 "jsonrpc": "2.0", 00:30:52.247 "id": 1, 00:30:52.247 "result": true 00:30:52.247 } 00:30:52.247 00:30:52.247 02:13:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:52.247 02:13:26 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:52.247 02:13:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:52.247 02:13:26 -- common/autotest_common.sh@10 -- # set +x 00:30:52.247 INFO: Setting log level to 40 00:30:52.247 INFO: Setting log level to 40 00:30:52.247 INFO: Setting log level to 40 00:30:52.247 [2024-11-18 02:13:26.512748] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:52.247 02:13:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:52.247 02:13:26 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:30:52.247 02:13:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:52.247 02:13:26 -- common/autotest_common.sh@10 -- # set +x 00:30:52.247 02:13:26 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:30:52.247 02:13:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:52.247 02:13:26 -- common/autotest_common.sh@10 -- # set +x 00:30:55.528 Nvme0n1 00:30:55.528 02:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.528 02:13:29 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:30:55.528 02:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:55.528 02:13:29 -- common/autotest_common.sh@10 -- # set +x 00:30:55.528 02:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.528 02:13:29 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:30:55.528 02:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:55.528 02:13:29 -- common/autotest_common.sh@10 -- # set +x 00:30:55.528 02:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.528 02:13:29 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:55.528 02:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:55.528 02:13:29 -- common/autotest_common.sh@10 -- # set +x 00:30:55.528 [2024-11-18 02:13:29.407394] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:55.528 02:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.528 02:13:29 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:30:55.528 02:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:55.528 02:13:29 -- common/autotest_common.sh@10 -- # set +x 00:30:55.528 [2024-11-18 02:13:29.415106] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:55.528 [ 00:30:55.528 { 00:30:55.528 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:30:55.528 "subtype": "Discovery", 00:30:55.528 "listen_addresses": [], 00:30:55.528 "allow_any_host": true, 00:30:55.528 "hosts": [] 00:30:55.528 }, 00:30:55.528 { 00:30:55.528 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:30:55.528 "subtype": "NVMe", 00:30:55.528 "listen_addresses": [ 00:30:55.528 { 00:30:55.528 "transport": "TCP", 00:30:55.528 "trtype": "TCP", 00:30:55.528 "adrfam": "IPv4", 00:30:55.528 "traddr": "10.0.0.2", 00:30:55.528 "trsvcid": "4420" 00:30:55.528 } 00:30:55.528 ], 00:30:55.528 "allow_any_host": true, 00:30:55.528 "hosts": [], 00:30:55.528 "serial_number": "SPDK00000000000001", 00:30:55.528 "model_number": "SPDK bdev Controller", 00:30:55.528 "max_namespaces": 1, 00:30:55.528 "min_cntlid": 1, 00:30:55.528 "max_cntlid": 65519, 00:30:55.528 "namespaces": [ 00:30:55.528 { 00:30:55.528 "nsid": 1, 00:30:55.528 "bdev_name": "Nvme0n1", 00:30:55.528 "name": "Nvme0n1", 00:30:55.528 "nguid": "64F6CEAD3A7340ACA4FE647D645614B2", 00:30:55.528 "uuid": "64f6cead-3a73-40ac-a4fe-647d645614b2" 00:30:55.528 } 00:30:55.528 ] 00:30:55.528 } 00:30:55.528 ] 00:30:55.528 02:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.528 02:13:29 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:30:55.528 02:13:29 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:30:55.528 02:13:29 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:30:55.528 EAL: No free 2048 kB hugepages reported on node 1 00:30:55.528 02:13:29 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:30:55.528 02:13:29 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:30:55.528 02:13:29 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:30:55.528 02:13:29 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:30:55.528 EAL: No free 2048 kB hugepages reported on node 1 00:30:55.528 02:13:29 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:30:55.528 02:13:29 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:30:55.528 02:13:29 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:30:55.528 02:13:29 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:55.528 02:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:55.528 02:13:29 -- common/autotest_common.sh@10 -- # set +x 00:30:55.528 02:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.528 02:13:29 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:30:55.528 02:13:29 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:30:55.528 02:13:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:55.528 02:13:29 -- nvmf/common.sh@116 -- # sync 00:30:55.528 02:13:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:55.528 02:13:29 -- nvmf/common.sh@119 -- # set +e 00:30:55.528 02:13:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:55.528 02:13:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:55.528 rmmod nvme_tcp 00:30:55.528 rmmod nvme_fabrics 00:30:55.528 rmmod nvme_keyring 00:30:55.528 02:13:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:55.528 02:13:29 -- nvmf/common.sh@123 -- # set -e 00:30:55.528 02:13:29 -- nvmf/common.sh@124 -- # return 0 00:30:55.528 02:13:29 -- nvmf/common.sh@477 -- # '[' -n 1343417 ']' 00:30:55.528 02:13:29 -- nvmf/common.sh@478 -- # killprocess 1343417 00:30:55.528 02:13:29 -- common/autotest_common.sh@936 -- # '[' -z 1343417 ']' 00:30:55.528 02:13:29 -- common/autotest_common.sh@940 -- # kill -0 1343417 00:30:55.528 02:13:29 -- common/autotest_common.sh@941 -- # uname 00:30:55.528 02:13:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:55.528 02:13:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1343417 00:30:55.528 02:13:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:55.528 02:13:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:55.528 02:13:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1343417' 00:30:55.528 killing process with pid 1343417 00:30:55.528 02:13:29 -- common/autotest_common.sh@955 -- # kill 1343417 00:30:55.528 [2024-11-18 02:13:29.843182] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:55.528 02:13:29 -- common/autotest_common.sh@960 -- # wait 1343417 00:30:57.428 02:13:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:57.428 02:13:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:57.428 02:13:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:57.428 02:13:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:57.428 02:13:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:57.428 02:13:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:57.428 02:13:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:57.428 02:13:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:59.330 02:13:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:59.330 00:30:59.330 real 0m18.105s 00:30:59.330 user 0m26.774s 00:30:59.330 sys 0m2.311s 00:30:59.330 02:13:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:59.330 02:13:33 -- common/autotest_common.sh@10 -- # set +x 00:30:59.330 ************************************ 00:30:59.330 END TEST nvmf_identify_passthru 00:30:59.330 ************************************ 00:30:59.330 02:13:33 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:30:59.330 02:13:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:59.330 02:13:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:59.330 02:13:33 -- common/autotest_common.sh@10 -- # set +x 00:30:59.330 ************************************ 00:30:59.330 START TEST nvmf_dif 00:30:59.330 ************************************ 00:30:59.330 02:13:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:30:59.330 * Looking for test storage... 00:30:59.330 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:59.330 02:13:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:59.330 02:13:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:59.330 02:13:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:59.330 02:13:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:59.330 02:13:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:59.330 02:13:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:59.330 02:13:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:59.330 02:13:33 -- scripts/common.sh@335 -- # IFS=.-: 00:30:59.330 02:13:33 -- scripts/common.sh@335 -- # read -ra ver1 00:30:59.330 02:13:33 -- scripts/common.sh@336 -- # IFS=.-: 00:30:59.330 02:13:33 -- scripts/common.sh@336 -- # read -ra ver2 00:30:59.330 02:13:33 -- scripts/common.sh@337 -- # local 'op=<' 00:30:59.330 02:13:33 -- scripts/common.sh@339 -- # ver1_l=2 00:30:59.330 02:13:33 -- scripts/common.sh@340 -- # ver2_l=1 00:30:59.330 02:13:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:59.330 02:13:33 -- scripts/common.sh@343 -- # case "$op" in 00:30:59.330 02:13:33 -- scripts/common.sh@344 -- # : 1 00:30:59.330 02:13:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:59.330 02:13:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:59.330 02:13:33 -- scripts/common.sh@364 -- # decimal 1 00:30:59.330 02:13:33 -- scripts/common.sh@352 -- # local d=1 00:30:59.330 02:13:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:59.330 02:13:33 -- scripts/common.sh@354 -- # echo 1 00:30:59.330 02:13:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:59.330 02:13:33 -- scripts/common.sh@365 -- # decimal 2 00:30:59.330 02:13:33 -- scripts/common.sh@352 -- # local d=2 00:30:59.330 02:13:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:59.330 02:13:33 -- scripts/common.sh@354 -- # echo 2 00:30:59.330 02:13:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:59.330 02:13:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:59.330 02:13:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:59.330 02:13:33 -- scripts/common.sh@367 -- # return 0 00:30:59.330 02:13:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:59.330 02:13:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:59.330 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:59.330 --rc genhtml_branch_coverage=1 00:30:59.330 --rc genhtml_function_coverage=1 00:30:59.330 --rc genhtml_legend=1 00:30:59.330 --rc geninfo_all_blocks=1 00:30:59.330 --rc geninfo_unexecuted_blocks=1 00:30:59.330 00:30:59.330 ' 00:30:59.330 02:13:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:59.330 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:59.330 --rc genhtml_branch_coverage=1 00:30:59.330 --rc genhtml_function_coverage=1 00:30:59.330 --rc genhtml_legend=1 00:30:59.330 --rc geninfo_all_blocks=1 00:30:59.330 --rc geninfo_unexecuted_blocks=1 00:30:59.330 00:30:59.330 ' 00:30:59.330 02:13:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:59.330 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:59.330 --rc genhtml_branch_coverage=1 00:30:59.330 --rc genhtml_function_coverage=1 00:30:59.330 --rc genhtml_legend=1 00:30:59.330 --rc geninfo_all_blocks=1 00:30:59.330 --rc geninfo_unexecuted_blocks=1 00:30:59.330 00:30:59.330 ' 00:30:59.330 02:13:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:59.330 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:59.330 --rc genhtml_branch_coverage=1 00:30:59.330 --rc genhtml_function_coverage=1 00:30:59.330 --rc genhtml_legend=1 00:30:59.330 --rc geninfo_all_blocks=1 00:30:59.330 --rc geninfo_unexecuted_blocks=1 00:30:59.330 00:30:59.330 ' 00:30:59.330 02:13:33 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:59.330 02:13:33 -- nvmf/common.sh@7 -- # uname -s 00:30:59.330 02:13:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:59.330 02:13:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:59.330 02:13:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:59.330 02:13:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:59.330 02:13:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:59.330 02:13:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:59.330 02:13:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:59.330 02:13:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:59.330 02:13:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:59.330 02:13:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:59.330 02:13:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:59.330 02:13:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:59.330 02:13:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:59.330 02:13:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:59.330 02:13:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:59.331 02:13:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:59.331 02:13:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:59.331 02:13:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:59.331 02:13:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:59.331 02:13:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:59.331 02:13:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:59.331 02:13:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:59.331 02:13:33 -- paths/export.sh@5 -- # export PATH 00:30:59.331 02:13:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:59.331 02:13:33 -- nvmf/common.sh@46 -- # : 0 00:30:59.331 02:13:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:59.331 02:13:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:59.331 02:13:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:59.331 02:13:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:59.331 02:13:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:59.331 02:13:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:59.331 02:13:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:59.331 02:13:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:59.331 02:13:33 -- target/dif.sh@15 -- # NULL_META=16 00:30:59.331 02:13:33 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:30:59.331 02:13:33 -- target/dif.sh@15 -- # NULL_SIZE=64 00:30:59.331 02:13:33 -- target/dif.sh@15 -- # NULL_DIF=1 00:30:59.331 02:13:33 -- target/dif.sh@135 -- # nvmftestinit 00:30:59.331 02:13:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:59.331 02:13:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:59.331 02:13:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:59.331 02:13:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:59.331 02:13:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:59.331 02:13:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:59.331 02:13:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:59.331 02:13:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:59.331 02:13:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:59.331 02:13:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:59.331 02:13:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:59.331 02:13:33 -- common/autotest_common.sh@10 -- # set +x 00:31:01.232 02:13:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:01.232 02:13:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:01.232 02:13:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:01.232 02:13:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:01.232 02:13:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:01.232 02:13:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:01.232 02:13:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:01.232 02:13:35 -- nvmf/common.sh@294 -- # net_devs=() 00:31:01.232 02:13:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:01.232 02:13:35 -- nvmf/common.sh@295 -- # e810=() 00:31:01.232 02:13:35 -- nvmf/common.sh@295 -- # local -ga e810 00:31:01.232 02:13:35 -- nvmf/common.sh@296 -- # x722=() 00:31:01.232 02:13:35 -- nvmf/common.sh@296 -- # local -ga x722 00:31:01.232 02:13:35 -- nvmf/common.sh@297 -- # mlx=() 00:31:01.232 02:13:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:01.232 02:13:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:01.232 02:13:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:01.232 02:13:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:01.232 02:13:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:01.232 02:13:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:01.232 02:13:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:01.232 02:13:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:01.232 02:13:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:01.232 02:13:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:01.232 02:13:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:01.232 02:13:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:01.232 02:13:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:01.232 02:13:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:01.232 02:13:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:01.232 02:13:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:01.232 02:13:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:01.232 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:01.232 02:13:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:01.232 02:13:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:01.232 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:01.232 02:13:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:01.232 02:13:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:01.232 02:13:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:01.232 02:13:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:01.232 02:13:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:01.232 02:13:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:01.232 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:01.232 02:13:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:01.232 02:13:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:01.232 02:13:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:01.232 02:13:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:01.232 02:13:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:01.232 02:13:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:01.232 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:01.232 02:13:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:01.232 02:13:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:01.232 02:13:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:01.232 02:13:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:01.232 02:13:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:01.232 02:13:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:01.232 02:13:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:01.232 02:13:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:01.232 02:13:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:01.232 02:13:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:01.232 02:13:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:01.232 02:13:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:01.232 02:13:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:01.232 02:13:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:01.232 02:13:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:01.232 02:13:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:01.232 02:13:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:01.232 02:13:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:01.232 02:13:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:01.232 02:13:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:01.232 02:13:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:01.232 02:13:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:01.502 02:13:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:01.502 02:13:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:01.502 02:13:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:01.502 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:01.502 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.193 ms 00:31:01.502 00:31:01.502 --- 10.0.0.2 ping statistics --- 00:31:01.502 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:01.502 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:31:01.502 02:13:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:01.502 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:01.502 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:31:01.502 00:31:01.502 --- 10.0.0.1 ping statistics --- 00:31:01.502 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:01.502 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:31:01.502 02:13:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:01.502 02:13:35 -- nvmf/common.sh@410 -- # return 0 00:31:01.502 02:13:35 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:01.502 02:13:35 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:02.514 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:02.514 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:02.514 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:02.514 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:02.514 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:02.514 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:02.514 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:02.514 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:02.514 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:02.514 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:02.514 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:02.514 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:02.514 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:02.514 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:02.514 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:02.514 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:02.514 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:02.773 02:13:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:02.773 02:13:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:02.773 02:13:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:02.773 02:13:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:02.773 02:13:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:02.773 02:13:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:02.773 02:13:37 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:02.773 02:13:37 -- target/dif.sh@137 -- # nvmfappstart 00:31:02.773 02:13:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:02.773 02:13:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:02.773 02:13:37 -- common/autotest_common.sh@10 -- # set +x 00:31:02.773 02:13:37 -- nvmf/common.sh@469 -- # nvmfpid=1346742 00:31:02.773 02:13:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:02.773 02:13:37 -- nvmf/common.sh@470 -- # waitforlisten 1346742 00:31:02.773 02:13:37 -- common/autotest_common.sh@829 -- # '[' -z 1346742 ']' 00:31:02.773 02:13:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:02.773 02:13:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:02.773 02:13:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:02.773 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:02.773 02:13:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:02.773 02:13:37 -- common/autotest_common.sh@10 -- # set +x 00:31:02.773 [2024-11-18 02:13:37.064524] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:02.773 [2024-11-18 02:13:37.064613] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:02.773 EAL: No free 2048 kB hugepages reported on node 1 00:31:02.773 [2024-11-18 02:13:37.133425] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:03.032 [2024-11-18 02:13:37.224141] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:03.032 [2024-11-18 02:13:37.224298] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:03.032 [2024-11-18 02:13:37.224332] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:03.032 [2024-11-18 02:13:37.224363] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:03.032 [2024-11-18 02:13:37.224391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:03.965 02:13:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:03.965 02:13:38 -- common/autotest_common.sh@862 -- # return 0 00:31:03.965 02:13:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:03.965 02:13:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:03.965 02:13:38 -- common/autotest_common.sh@10 -- # set +x 00:31:03.965 02:13:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:03.965 02:13:38 -- target/dif.sh@139 -- # create_transport 00:31:03.965 02:13:38 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:03.965 02:13:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:03.965 02:13:38 -- common/autotest_common.sh@10 -- # set +x 00:31:03.965 [2024-11-18 02:13:38.098678] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:03.965 02:13:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:03.965 02:13:38 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:03.965 02:13:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:03.965 02:13:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:03.966 02:13:38 -- common/autotest_common.sh@10 -- # set +x 00:31:03.966 ************************************ 00:31:03.966 START TEST fio_dif_1_default 00:31:03.966 ************************************ 00:31:03.966 02:13:38 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:03.966 02:13:38 -- target/dif.sh@86 -- # create_subsystems 0 00:31:03.966 02:13:38 -- target/dif.sh@28 -- # local sub 00:31:03.966 02:13:38 -- target/dif.sh@30 -- # for sub in "$@" 00:31:03.966 02:13:38 -- target/dif.sh@31 -- # create_subsystem 0 00:31:03.966 02:13:38 -- target/dif.sh@18 -- # local sub_id=0 00:31:03.966 02:13:38 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:03.966 02:13:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:03.966 02:13:38 -- common/autotest_common.sh@10 -- # set +x 00:31:03.966 bdev_null0 00:31:03.966 02:13:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:03.966 02:13:38 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:03.966 02:13:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:03.966 02:13:38 -- common/autotest_common.sh@10 -- # set +x 00:31:03.966 02:13:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:03.966 02:13:38 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:03.966 02:13:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:03.966 02:13:38 -- common/autotest_common.sh@10 -- # set +x 00:31:03.966 02:13:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:03.966 02:13:38 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:03.966 02:13:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:03.966 02:13:38 -- common/autotest_common.sh@10 -- # set +x 00:31:03.966 [2024-11-18 02:13:38.138963] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:03.966 02:13:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:03.966 02:13:38 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:03.966 02:13:38 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:03.966 02:13:38 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:03.966 02:13:38 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:03.966 02:13:38 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:03.966 02:13:38 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:03.966 02:13:38 -- nvmf/common.sh@520 -- # config=() 00:31:03.966 02:13:38 -- target/dif.sh@82 -- # gen_fio_conf 00:31:03.966 02:13:38 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:03.966 02:13:38 -- nvmf/common.sh@520 -- # local subsystem config 00:31:03.966 02:13:38 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:03.966 02:13:38 -- target/dif.sh@54 -- # local file 00:31:03.966 02:13:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:03.966 02:13:38 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:03.966 02:13:38 -- target/dif.sh@56 -- # cat 00:31:03.966 02:13:38 -- common/autotest_common.sh@1330 -- # shift 00:31:03.966 02:13:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:03.966 { 00:31:03.966 "params": { 00:31:03.966 "name": "Nvme$subsystem", 00:31:03.966 "trtype": "$TEST_TRANSPORT", 00:31:03.966 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:03.966 "adrfam": "ipv4", 00:31:03.966 "trsvcid": "$NVMF_PORT", 00:31:03.966 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:03.966 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:03.966 "hdgst": ${hdgst:-false}, 00:31:03.966 "ddgst": ${ddgst:-false} 00:31:03.966 }, 00:31:03.966 "method": "bdev_nvme_attach_controller" 00:31:03.966 } 00:31:03.966 EOF 00:31:03.966 )") 00:31:03.966 02:13:38 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:03.966 02:13:38 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:03.966 02:13:38 -- nvmf/common.sh@542 -- # cat 00:31:03.966 02:13:38 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:03.966 02:13:38 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:03.966 02:13:38 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:03.966 02:13:38 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:03.966 02:13:38 -- target/dif.sh@72 -- # (( file <= files )) 00:31:03.966 02:13:38 -- nvmf/common.sh@544 -- # jq . 00:31:03.966 02:13:38 -- nvmf/common.sh@545 -- # IFS=, 00:31:03.966 02:13:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:03.966 "params": { 00:31:03.966 "name": "Nvme0", 00:31:03.966 "trtype": "tcp", 00:31:03.966 "traddr": "10.0.0.2", 00:31:03.966 "adrfam": "ipv4", 00:31:03.966 "trsvcid": "4420", 00:31:03.966 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:03.966 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:03.966 "hdgst": false, 00:31:03.966 "ddgst": false 00:31:03.966 }, 00:31:03.966 "method": "bdev_nvme_attach_controller" 00:31:03.966 }' 00:31:03.966 02:13:38 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:03.966 02:13:38 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:03.966 02:13:38 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:03.966 02:13:38 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:03.966 02:13:38 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:03.966 02:13:38 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:03.966 02:13:38 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:03.966 02:13:38 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:03.966 02:13:38 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:03.966 02:13:38 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:04.225 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:04.225 fio-3.35 00:31:04.225 Starting 1 thread 00:31:04.225 EAL: No free 2048 kB hugepages reported on node 1 00:31:04.483 [2024-11-18 02:13:38.826951] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:04.483 [2024-11-18 02:13:38.827015] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:16.679 00:31:16.679 filename0: (groupid=0, jobs=1): err= 0: pid=1347103: Mon Nov 18 02:13:48 2024 00:31:16.679 read: IOPS=98, BW=395KiB/s (404kB/s)(3952KiB/10016msec) 00:31:16.679 slat (nsec): min=4099, max=64011, avg=8510.35, stdev=3492.45 00:31:16.679 clat (usec): min=571, max=49416, avg=40521.28, stdev=4461.04 00:31:16.679 lat (usec): min=578, max=49441, avg=40529.79, stdev=4460.63 00:31:16.679 clat percentiles (usec): 00:31:16.679 | 1.00th=[ 619], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:16.679 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:16.679 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:16.679 | 99.00th=[41157], 99.50th=[41681], 99.90th=[49546], 99.95th=[49546], 00:31:16.679 | 99.99th=[49546] 00:31:16.679 bw ( KiB/s): min= 352, max= 448, per=99.60%, avg=393.60, stdev=21.02, samples=20 00:31:16.679 iops : min= 88, max= 112, avg=98.40, stdev= 5.26, samples=20 00:31:16.679 lat (usec) : 750=1.21% 00:31:16.679 lat (msec) : 50=98.79% 00:31:16.679 cpu : usr=92.14%, sys=7.59%, ctx=21, majf=0, minf=229 00:31:16.679 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:16.679 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:16.679 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:16.679 issued rwts: total=988,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:16.679 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:16.679 00:31:16.679 Run status group 0 (all jobs): 00:31:16.680 READ: bw=395KiB/s (404kB/s), 395KiB/s-395KiB/s (404kB/s-404kB/s), io=3952KiB (4047kB), run=10016-10016msec 00:31:16.680 02:13:49 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:16.680 02:13:49 -- target/dif.sh@43 -- # local sub 00:31:16.680 02:13:49 -- target/dif.sh@45 -- # for sub in "$@" 00:31:16.680 02:13:49 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:16.680 02:13:49 -- target/dif.sh@36 -- # local sub_id=0 00:31:16.680 02:13:49 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:16.680 02:13:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.680 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:31:16.680 02:13:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.680 02:13:49 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:16.680 02:13:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.680 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:31:16.680 02:13:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.680 00:31:16.680 real 0m11.111s 00:31:16.680 user 0m10.318s 00:31:16.680 sys 0m1.046s 00:31:16.680 02:13:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:16.680 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:31:16.680 ************************************ 00:31:16.680 END TEST fio_dif_1_default 00:31:16.680 ************************************ 00:31:16.680 02:13:49 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:16.680 02:13:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:16.680 02:13:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:16.680 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:31:16.680 ************************************ 00:31:16.680 START TEST fio_dif_1_multi_subsystems 00:31:16.680 ************************************ 00:31:16.680 02:13:49 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:16.680 02:13:49 -- target/dif.sh@92 -- # local files=1 00:31:16.680 02:13:49 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:16.680 02:13:49 -- target/dif.sh@28 -- # local sub 00:31:16.680 02:13:49 -- target/dif.sh@30 -- # for sub in "$@" 00:31:16.680 02:13:49 -- target/dif.sh@31 -- # create_subsystem 0 00:31:16.680 02:13:49 -- target/dif.sh@18 -- # local sub_id=0 00:31:16.680 02:13:49 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:16.680 02:13:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.680 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:31:16.680 bdev_null0 00:31:16.680 02:13:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.680 02:13:49 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:16.680 02:13:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.680 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:31:16.680 02:13:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.680 02:13:49 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:16.680 02:13:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.680 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:31:16.680 02:13:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.680 02:13:49 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:16.680 02:13:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.680 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:31:16.680 [2024-11-18 02:13:49.279055] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:16.680 02:13:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.680 02:13:49 -- target/dif.sh@30 -- # for sub in "$@" 00:31:16.680 02:13:49 -- target/dif.sh@31 -- # create_subsystem 1 00:31:16.680 02:13:49 -- target/dif.sh@18 -- # local sub_id=1 00:31:16.680 02:13:49 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:16.680 02:13:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.680 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:31:16.680 bdev_null1 00:31:16.680 02:13:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.680 02:13:49 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:16.680 02:13:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.680 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:31:16.680 02:13:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.680 02:13:49 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:16.680 02:13:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.680 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:31:16.680 02:13:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.680 02:13:49 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:16.680 02:13:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.680 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:31:16.680 02:13:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.680 02:13:49 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:16.680 02:13:49 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:16.680 02:13:49 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:16.680 02:13:49 -- nvmf/common.sh@520 -- # config=() 00:31:16.680 02:13:49 -- nvmf/common.sh@520 -- # local subsystem config 00:31:16.680 02:13:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:16.680 02:13:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:16.680 { 00:31:16.680 "params": { 00:31:16.680 "name": "Nvme$subsystem", 00:31:16.680 "trtype": "$TEST_TRANSPORT", 00:31:16.680 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:16.680 "adrfam": "ipv4", 00:31:16.680 "trsvcid": "$NVMF_PORT", 00:31:16.680 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:16.680 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:16.680 "hdgst": ${hdgst:-false}, 00:31:16.680 "ddgst": ${ddgst:-false} 00:31:16.680 }, 00:31:16.680 "method": "bdev_nvme_attach_controller" 00:31:16.680 } 00:31:16.680 EOF 00:31:16.680 )") 00:31:16.680 02:13:49 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:16.680 02:13:49 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:16.680 02:13:49 -- target/dif.sh@82 -- # gen_fio_conf 00:31:16.680 02:13:49 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:16.680 02:13:49 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:16.680 02:13:49 -- target/dif.sh@54 -- # local file 00:31:16.680 02:13:49 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:16.680 02:13:49 -- target/dif.sh@56 -- # cat 00:31:16.680 02:13:49 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:16.680 02:13:49 -- common/autotest_common.sh@1330 -- # shift 00:31:16.680 02:13:49 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:16.680 02:13:49 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:16.680 02:13:49 -- nvmf/common.sh@542 -- # cat 00:31:16.680 02:13:49 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:16.680 02:13:49 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:16.680 02:13:49 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:16.680 02:13:49 -- target/dif.sh@72 -- # (( file <= files )) 00:31:16.680 02:13:49 -- target/dif.sh@73 -- # cat 00:31:16.680 02:13:49 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:16.680 02:13:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:16.680 02:13:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:16.680 { 00:31:16.680 "params": { 00:31:16.680 "name": "Nvme$subsystem", 00:31:16.680 "trtype": "$TEST_TRANSPORT", 00:31:16.680 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:16.680 "adrfam": "ipv4", 00:31:16.680 "trsvcid": "$NVMF_PORT", 00:31:16.680 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:16.680 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:16.680 "hdgst": ${hdgst:-false}, 00:31:16.680 "ddgst": ${ddgst:-false} 00:31:16.680 }, 00:31:16.680 "method": "bdev_nvme_attach_controller" 00:31:16.680 } 00:31:16.680 EOF 00:31:16.680 )") 00:31:16.680 02:13:49 -- nvmf/common.sh@542 -- # cat 00:31:16.680 02:13:49 -- target/dif.sh@72 -- # (( file++ )) 00:31:16.680 02:13:49 -- target/dif.sh@72 -- # (( file <= files )) 00:31:16.680 02:13:49 -- nvmf/common.sh@544 -- # jq . 00:31:16.680 02:13:49 -- nvmf/common.sh@545 -- # IFS=, 00:31:16.680 02:13:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:16.680 "params": { 00:31:16.680 "name": "Nvme0", 00:31:16.680 "trtype": "tcp", 00:31:16.680 "traddr": "10.0.0.2", 00:31:16.680 "adrfam": "ipv4", 00:31:16.680 "trsvcid": "4420", 00:31:16.680 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:16.680 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:16.680 "hdgst": false, 00:31:16.680 "ddgst": false 00:31:16.680 }, 00:31:16.680 "method": "bdev_nvme_attach_controller" 00:31:16.680 },{ 00:31:16.680 "params": { 00:31:16.680 "name": "Nvme1", 00:31:16.681 "trtype": "tcp", 00:31:16.681 "traddr": "10.0.0.2", 00:31:16.681 "adrfam": "ipv4", 00:31:16.681 "trsvcid": "4420", 00:31:16.681 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:16.681 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:16.681 "hdgst": false, 00:31:16.681 "ddgst": false 00:31:16.681 }, 00:31:16.681 "method": "bdev_nvme_attach_controller" 00:31:16.681 }' 00:31:16.681 02:13:49 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:16.681 02:13:49 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:16.681 02:13:49 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:16.681 02:13:49 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:16.681 02:13:49 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:16.681 02:13:49 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:16.681 02:13:49 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:16.681 02:13:49 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:16.681 02:13:49 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:16.681 02:13:49 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:16.681 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:16.681 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:16.681 fio-3.35 00:31:16.681 Starting 2 threads 00:31:16.681 EAL: No free 2048 kB hugepages reported on node 1 00:31:16.681 [2024-11-18 02:13:50.216445] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:16.681 [2024-11-18 02:13:50.216508] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:26.650 00:31:26.650 filename0: (groupid=0, jobs=1): err= 0: pid=1348544: Mon Nov 18 02:14:00 2024 00:31:26.650 read: IOPS=98, BW=393KiB/s (403kB/s)(3936KiB/10011msec) 00:31:26.650 slat (nsec): min=6784, max=68268, avg=8640.61, stdev=3116.07 00:31:26.650 clat (usec): min=603, max=45180, avg=40665.02, stdev=3623.32 00:31:26.650 lat (usec): min=610, max=45207, avg=40673.66, stdev=3622.74 00:31:26.650 clat percentiles (usec): 00:31:26.650 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:26.650 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:26.650 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:26.650 | 99.00th=[41157], 99.50th=[41157], 99.90th=[45351], 99.95th=[45351], 00:31:26.650 | 99.99th=[45351] 00:31:26.650 bw ( KiB/s): min= 384, max= 448, per=49.86%, avg=392.00, stdev=17.60, samples=20 00:31:26.650 iops : min= 96, max= 112, avg=98.00, stdev= 4.40, samples=20 00:31:26.650 lat (usec) : 750=0.41%, 1000=0.41% 00:31:26.650 lat (msec) : 50=99.19% 00:31:26.650 cpu : usr=95.91%, sys=3.79%, ctx=13, majf=0, minf=209 00:31:26.650 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:26.650 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:26.650 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:26.650 issued rwts: total=984,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:26.650 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:26.650 filename1: (groupid=0, jobs=1): err= 0: pid=1348545: Mon Nov 18 02:14:00 2024 00:31:26.650 read: IOPS=98, BW=393KiB/s (403kB/s)(3936KiB/10012msec) 00:31:26.650 slat (nsec): min=7029, max=20173, avg=8569.05, stdev=2149.66 00:31:26.650 clat (usec): min=804, max=46174, avg=40669.46, stdev=3620.23 00:31:26.650 lat (usec): min=811, max=46194, avg=40678.03, stdev=3620.20 00:31:26.650 clat percentiles (usec): 00:31:26.650 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:26.650 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:26.650 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:26.650 | 99.00th=[41157], 99.50th=[41157], 99.90th=[46400], 99.95th=[46400], 00:31:26.650 | 99.99th=[46400] 00:31:26.650 bw ( KiB/s): min= 384, max= 448, per=49.86%, avg=392.00, stdev=17.60, samples=20 00:31:26.650 iops : min= 96, max= 112, avg=98.00, stdev= 4.40, samples=20 00:31:26.650 lat (usec) : 1000=0.81% 00:31:26.650 lat (msec) : 50=99.19% 00:31:26.650 cpu : usr=95.56%, sys=4.13%, ctx=16, majf=0, minf=194 00:31:26.650 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:26.650 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:26.650 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:26.650 issued rwts: total=984,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:26.650 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:26.650 00:31:26.650 Run status group 0 (all jobs): 00:31:26.650 READ: bw=786KiB/s (805kB/s), 393KiB/s-393KiB/s (403kB/s-403kB/s), io=7872KiB (8061kB), run=10011-10012msec 00:31:26.650 02:14:00 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:26.650 02:14:00 -- target/dif.sh@43 -- # local sub 00:31:26.650 02:14:00 -- target/dif.sh@45 -- # for sub in "$@" 00:31:26.650 02:14:00 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:26.650 02:14:00 -- target/dif.sh@36 -- # local sub_id=0 00:31:26.650 02:14:00 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:26.650 02:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.650 02:14:00 -- common/autotest_common.sh@10 -- # set +x 00:31:26.650 02:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.650 02:14:00 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:26.650 02:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.650 02:14:00 -- common/autotest_common.sh@10 -- # set +x 00:31:26.650 02:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.650 02:14:00 -- target/dif.sh@45 -- # for sub in "$@" 00:31:26.650 02:14:00 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:26.650 02:14:00 -- target/dif.sh@36 -- # local sub_id=1 00:31:26.650 02:14:00 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:26.650 02:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.650 02:14:00 -- common/autotest_common.sh@10 -- # set +x 00:31:26.650 02:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.650 02:14:00 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:26.650 02:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.650 02:14:00 -- common/autotest_common.sh@10 -- # set +x 00:31:26.650 02:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.650 00:31:26.650 real 0m11.325s 00:31:26.650 user 0m20.486s 00:31:26.650 sys 0m1.074s 00:31:26.650 02:14:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:26.650 02:14:00 -- common/autotest_common.sh@10 -- # set +x 00:31:26.650 ************************************ 00:31:26.650 END TEST fio_dif_1_multi_subsystems 00:31:26.650 ************************************ 00:31:26.650 02:14:00 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:26.650 02:14:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:26.650 02:14:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:26.650 02:14:00 -- common/autotest_common.sh@10 -- # set +x 00:31:26.650 ************************************ 00:31:26.650 START TEST fio_dif_rand_params 00:31:26.650 ************************************ 00:31:26.650 02:14:00 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:31:26.650 02:14:00 -- target/dif.sh@100 -- # local NULL_DIF 00:31:26.650 02:14:00 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:26.650 02:14:00 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:26.650 02:14:00 -- target/dif.sh@103 -- # bs=128k 00:31:26.650 02:14:00 -- target/dif.sh@103 -- # numjobs=3 00:31:26.650 02:14:00 -- target/dif.sh@103 -- # iodepth=3 00:31:26.650 02:14:00 -- target/dif.sh@103 -- # runtime=5 00:31:26.650 02:14:00 -- target/dif.sh@105 -- # create_subsystems 0 00:31:26.650 02:14:00 -- target/dif.sh@28 -- # local sub 00:31:26.650 02:14:00 -- target/dif.sh@30 -- # for sub in "$@" 00:31:26.650 02:14:00 -- target/dif.sh@31 -- # create_subsystem 0 00:31:26.650 02:14:00 -- target/dif.sh@18 -- # local sub_id=0 00:31:26.651 02:14:00 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:26.651 02:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.651 02:14:00 -- common/autotest_common.sh@10 -- # set +x 00:31:26.651 bdev_null0 00:31:26.651 02:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.651 02:14:00 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:26.651 02:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.651 02:14:00 -- common/autotest_common.sh@10 -- # set +x 00:31:26.651 02:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.651 02:14:00 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:26.651 02:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.651 02:14:00 -- common/autotest_common.sh@10 -- # set +x 00:31:26.651 02:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.651 02:14:00 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:26.651 02:14:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.651 02:14:00 -- common/autotest_common.sh@10 -- # set +x 00:31:26.651 [2024-11-18 02:14:00.634888] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:26.651 02:14:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.651 02:14:00 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:26.651 02:14:00 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:26.651 02:14:00 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:26.651 02:14:00 -- nvmf/common.sh@520 -- # config=() 00:31:26.651 02:14:00 -- nvmf/common.sh@520 -- # local subsystem config 00:31:26.651 02:14:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:26.651 02:14:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:26.651 { 00:31:26.651 "params": { 00:31:26.651 "name": "Nvme$subsystem", 00:31:26.651 "trtype": "$TEST_TRANSPORT", 00:31:26.651 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:26.651 "adrfam": "ipv4", 00:31:26.651 "trsvcid": "$NVMF_PORT", 00:31:26.651 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:26.651 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:26.651 "hdgst": ${hdgst:-false}, 00:31:26.651 "ddgst": ${ddgst:-false} 00:31:26.651 }, 00:31:26.651 "method": "bdev_nvme_attach_controller" 00:31:26.651 } 00:31:26.651 EOF 00:31:26.651 )") 00:31:26.651 02:14:00 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:26.651 02:14:00 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:26.651 02:14:00 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:26.651 02:14:00 -- target/dif.sh@82 -- # gen_fio_conf 00:31:26.651 02:14:00 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:26.651 02:14:00 -- target/dif.sh@54 -- # local file 00:31:26.651 02:14:00 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:26.651 02:14:00 -- target/dif.sh@56 -- # cat 00:31:26.651 02:14:00 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:26.651 02:14:00 -- common/autotest_common.sh@1330 -- # shift 00:31:26.651 02:14:00 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:26.651 02:14:00 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:26.651 02:14:00 -- nvmf/common.sh@542 -- # cat 00:31:26.651 02:14:00 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:26.651 02:14:00 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:26.651 02:14:00 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:26.651 02:14:00 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:26.651 02:14:00 -- target/dif.sh@72 -- # (( file <= files )) 00:31:26.651 02:14:00 -- nvmf/common.sh@544 -- # jq . 00:31:26.651 02:14:00 -- nvmf/common.sh@545 -- # IFS=, 00:31:26.651 02:14:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:26.651 "params": { 00:31:26.651 "name": "Nvme0", 00:31:26.651 "trtype": "tcp", 00:31:26.651 "traddr": "10.0.0.2", 00:31:26.651 "adrfam": "ipv4", 00:31:26.651 "trsvcid": "4420", 00:31:26.651 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:26.651 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:26.651 "hdgst": false, 00:31:26.651 "ddgst": false 00:31:26.651 }, 00:31:26.651 "method": "bdev_nvme_attach_controller" 00:31:26.651 }' 00:31:26.651 02:14:00 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:26.651 02:14:00 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:26.651 02:14:00 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:26.651 02:14:00 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:26.651 02:14:00 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:26.651 02:14:00 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:26.651 02:14:00 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:26.651 02:14:00 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:26.651 02:14:00 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:26.651 02:14:00 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:26.651 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:26.651 ... 00:31:26.651 fio-3.35 00:31:26.651 Starting 3 threads 00:31:26.651 EAL: No free 2048 kB hugepages reported on node 1 00:31:27.217 [2024-11-18 02:14:01.315904] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:27.217 [2024-11-18 02:14:01.315973] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:32.538 00:31:32.538 filename0: (groupid=0, jobs=1): err= 0: pid=1349979: Mon Nov 18 02:14:06 2024 00:31:32.538 read: IOPS=239, BW=30.0MiB/s (31.4MB/s)(151MiB/5039msec) 00:31:32.538 slat (usec): min=7, max=120, avg=16.01, stdev= 5.81 00:31:32.538 clat (usec): min=4406, max=54644, avg=12482.04, stdev=6962.93 00:31:32.538 lat (usec): min=4417, max=54661, avg=12498.05, stdev=6963.07 00:31:32.538 clat percentiles (usec): 00:31:32.538 | 1.00th=[ 5473], 5.00th=[ 7570], 10.00th=[ 8356], 20.00th=[ 9896], 00:31:32.538 | 30.00th=[11076], 40.00th=[11469], 50.00th=[11731], 60.00th=[12125], 00:31:32.538 | 70.00th=[12387], 80.00th=[12780], 90.00th=[13435], 95.00th=[14222], 00:31:32.538 | 99.00th=[52167], 99.50th=[52691], 99.90th=[54789], 99.95th=[54789], 00:31:32.538 | 99.99th=[54789] 00:31:32.538 bw ( KiB/s): min=20736, max=38144, per=34.31%, avg=30873.60, stdev=5720.77, samples=10 00:31:32.538 iops : min= 162, max= 298, avg=241.20, stdev=44.69, samples=10 00:31:32.538 lat (msec) : 10=20.26%, 20=76.51%, 50=1.32%, 100=1.90% 00:31:32.538 cpu : usr=92.97%, sys=5.56%, ctx=193, majf=0, minf=156 00:31:32.538 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:32.538 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:32.538 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:32.538 issued rwts: total=1209,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:32.538 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:32.538 filename0: (groupid=0, jobs=1): err= 0: pid=1349980: Mon Nov 18 02:14:06 2024 00:31:32.538 read: IOPS=216, BW=27.1MiB/s (28.4MB/s)(137MiB/5046msec) 00:31:32.538 slat (nsec): min=7540, max=41959, avg=14747.27, stdev=3947.34 00:31:32.538 clat (usec): min=5637, max=53719, avg=13803.81, stdev=9709.07 00:31:32.538 lat (usec): min=5652, max=53732, avg=13818.56, stdev=9708.51 00:31:32.538 clat percentiles (usec): 00:31:32.538 | 1.00th=[ 7111], 5.00th=[ 8029], 10.00th=[ 9372], 20.00th=[10683], 00:31:32.538 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11600], 60.00th=[11994], 00:31:32.538 | 70.00th=[12256], 80.00th=[12518], 90.00th=[13304], 95.00th=[49546], 00:31:32.538 | 99.00th=[52691], 99.50th=[52691], 99.90th=[53216], 99.95th=[53740], 00:31:32.538 | 99.99th=[53740] 00:31:32.538 bw ( KiB/s): min=14080, max=37376, per=30.98%, avg=27878.40, stdev=7588.86, samples=10 00:31:32.538 iops : min= 110, max= 292, avg=217.80, stdev=59.29, samples=10 00:31:32.538 lat (msec) : 10=12.36%, 20=81.41%, 50=1.56%, 100=4.67% 00:31:32.538 cpu : usr=94.55%, sys=4.90%, ctx=14, majf=0, minf=81 00:31:32.538 IO depths : 1=1.1%, 2=98.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:32.538 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:32.538 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:32.538 issued rwts: total=1092,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:32.538 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:32.538 filename0: (groupid=0, jobs=1): err= 0: pid=1349981: Mon Nov 18 02:14:06 2024 00:31:32.538 read: IOPS=247, BW=30.9MiB/s (32.4MB/s)(156MiB/5044msec) 00:31:32.538 slat (nsec): min=7784, max=42263, avg=16138.48, stdev=4643.02 00:31:32.538 clat (usec): min=4370, max=47758, avg=12090.64, stdev=4016.72 00:31:32.538 lat (usec): min=4382, max=47776, avg=12106.78, stdev=4017.80 00:31:32.538 clat percentiles (usec): 00:31:32.538 | 1.00th=[ 5211], 5.00th=[ 7111], 10.00th=[ 7963], 20.00th=[ 8848], 00:31:32.538 | 30.00th=[10159], 40.00th=[11600], 50.00th=[12256], 60.00th=[12780], 00:31:32.538 | 70.00th=[13829], 80.00th=[14746], 90.00th=[15664], 95.00th=[16188], 00:31:32.538 | 99.00th=[17433], 99.50th=[45876], 99.90th=[47449], 99.95th=[47973], 00:31:32.538 | 99.99th=[47973] 00:31:32.538 bw ( KiB/s): min=26880, max=39936, per=35.37%, avg=31828.30, stdev=4162.55, samples=10 00:31:32.538 iops : min= 210, max= 312, avg=248.60, stdev=32.43, samples=10 00:31:32.538 lat (msec) : 10=28.49%, 20=70.87%, 50=0.64% 00:31:32.538 cpu : usr=93.24%, sys=5.51%, ctx=110, majf=0, minf=143 00:31:32.538 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:32.538 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:32.538 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:32.538 issued rwts: total=1246,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:32.538 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:32.538 00:31:32.538 Run status group 0 (all jobs): 00:31:32.538 READ: bw=87.9MiB/s (92.1MB/s), 27.1MiB/s-30.9MiB/s (28.4MB/s-32.4MB/s), io=443MiB (465MB), run=5039-5046msec 00:31:32.538 02:14:06 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:32.538 02:14:06 -- target/dif.sh@43 -- # local sub 00:31:32.538 02:14:06 -- target/dif.sh@45 -- # for sub in "$@" 00:31:32.538 02:14:06 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:32.538 02:14:06 -- target/dif.sh@36 -- # local sub_id=0 00:31:32.538 02:14:06 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:32.538 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.538 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.538 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.538 02:14:06 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:32.538 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.538 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.538 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.538 02:14:06 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:32.538 02:14:06 -- target/dif.sh@109 -- # bs=4k 00:31:32.538 02:14:06 -- target/dif.sh@109 -- # numjobs=8 00:31:32.538 02:14:06 -- target/dif.sh@109 -- # iodepth=16 00:31:32.538 02:14:06 -- target/dif.sh@109 -- # runtime= 00:31:32.538 02:14:06 -- target/dif.sh@109 -- # files=2 00:31:32.538 02:14:06 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:32.538 02:14:06 -- target/dif.sh@28 -- # local sub 00:31:32.538 02:14:06 -- target/dif.sh@30 -- # for sub in "$@" 00:31:32.538 02:14:06 -- target/dif.sh@31 -- # create_subsystem 0 00:31:32.538 02:14:06 -- target/dif.sh@18 -- # local sub_id=0 00:31:32.538 02:14:06 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:32.538 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.538 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.538 bdev_null0 00:31:32.538 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.538 02:14:06 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:32.538 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.538 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.538 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.538 02:14:06 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:32.538 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.538 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.538 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.538 02:14:06 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:32.538 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.538 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.538 [2024-11-18 02:14:06.722920] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:32.538 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.538 02:14:06 -- target/dif.sh@30 -- # for sub in "$@" 00:31:32.538 02:14:06 -- target/dif.sh@31 -- # create_subsystem 1 00:31:32.538 02:14:06 -- target/dif.sh@18 -- # local sub_id=1 00:31:32.538 02:14:06 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:32.538 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.538 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.538 bdev_null1 00:31:32.538 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.538 02:14:06 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:32.538 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.538 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.538 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.539 02:14:06 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:32.539 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.539 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.539 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.539 02:14:06 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:32.539 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.539 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.539 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.539 02:14:06 -- target/dif.sh@30 -- # for sub in "$@" 00:31:32.539 02:14:06 -- target/dif.sh@31 -- # create_subsystem 2 00:31:32.539 02:14:06 -- target/dif.sh@18 -- # local sub_id=2 00:31:32.539 02:14:06 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:32.539 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.539 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.539 bdev_null2 00:31:32.539 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.539 02:14:06 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:32.539 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.539 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.539 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.539 02:14:06 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:32.539 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.539 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.539 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.539 02:14:06 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:32.539 02:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:32.539 02:14:06 -- common/autotest_common.sh@10 -- # set +x 00:31:32.539 02:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:32.539 02:14:06 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:32.539 02:14:06 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:32.539 02:14:06 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:32.539 02:14:06 -- nvmf/common.sh@520 -- # config=() 00:31:32.539 02:14:06 -- nvmf/common.sh@520 -- # local subsystem config 00:31:32.539 02:14:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:32.539 02:14:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:32.539 { 00:31:32.539 "params": { 00:31:32.539 "name": "Nvme$subsystem", 00:31:32.539 "trtype": "$TEST_TRANSPORT", 00:31:32.539 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:32.539 "adrfam": "ipv4", 00:31:32.539 "trsvcid": "$NVMF_PORT", 00:31:32.539 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:32.539 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:32.539 "hdgst": ${hdgst:-false}, 00:31:32.539 "ddgst": ${ddgst:-false} 00:31:32.539 }, 00:31:32.539 "method": "bdev_nvme_attach_controller" 00:31:32.539 } 00:31:32.539 EOF 00:31:32.539 )") 00:31:32.539 02:14:06 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:32.539 02:14:06 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:32.539 02:14:06 -- target/dif.sh@82 -- # gen_fio_conf 00:31:32.539 02:14:06 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:32.539 02:14:06 -- target/dif.sh@54 -- # local file 00:31:32.539 02:14:06 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:32.539 02:14:06 -- target/dif.sh@56 -- # cat 00:31:32.539 02:14:06 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:32.539 02:14:06 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:32.539 02:14:06 -- common/autotest_common.sh@1330 -- # shift 00:31:32.539 02:14:06 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:32.539 02:14:06 -- nvmf/common.sh@542 -- # cat 00:31:32.539 02:14:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:32.539 02:14:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:32.539 02:14:06 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:32.539 02:14:06 -- target/dif.sh@72 -- # (( file <= files )) 00:31:32.539 02:14:06 -- target/dif.sh@73 -- # cat 00:31:32.539 02:14:06 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:32.539 02:14:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:32.539 02:14:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:32.539 02:14:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:32.539 { 00:31:32.539 "params": { 00:31:32.539 "name": "Nvme$subsystem", 00:31:32.539 "trtype": "$TEST_TRANSPORT", 00:31:32.539 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:32.539 "adrfam": "ipv4", 00:31:32.539 "trsvcid": "$NVMF_PORT", 00:31:32.539 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:32.539 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:32.539 "hdgst": ${hdgst:-false}, 00:31:32.539 "ddgst": ${ddgst:-false} 00:31:32.539 }, 00:31:32.539 "method": "bdev_nvme_attach_controller" 00:31:32.539 } 00:31:32.539 EOF 00:31:32.539 )") 00:31:32.539 02:14:06 -- nvmf/common.sh@542 -- # cat 00:31:32.539 02:14:06 -- target/dif.sh@72 -- # (( file++ )) 00:31:32.539 02:14:06 -- target/dif.sh@72 -- # (( file <= files )) 00:31:32.539 02:14:06 -- target/dif.sh@73 -- # cat 00:31:32.539 02:14:06 -- target/dif.sh@72 -- # (( file++ )) 00:31:32.539 02:14:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:32.539 02:14:06 -- target/dif.sh@72 -- # (( file <= files )) 00:31:32.539 02:14:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:32.539 { 00:31:32.539 "params": { 00:31:32.539 "name": "Nvme$subsystem", 00:31:32.539 "trtype": "$TEST_TRANSPORT", 00:31:32.539 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:32.539 "adrfam": "ipv4", 00:31:32.539 "trsvcid": "$NVMF_PORT", 00:31:32.539 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:32.539 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:32.539 "hdgst": ${hdgst:-false}, 00:31:32.539 "ddgst": ${ddgst:-false} 00:31:32.539 }, 00:31:32.539 "method": "bdev_nvme_attach_controller" 00:31:32.539 } 00:31:32.539 EOF 00:31:32.539 )") 00:31:32.539 02:14:06 -- nvmf/common.sh@542 -- # cat 00:31:32.539 02:14:06 -- nvmf/common.sh@544 -- # jq . 00:31:32.540 02:14:06 -- nvmf/common.sh@545 -- # IFS=, 00:31:32.540 02:14:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:32.540 "params": { 00:31:32.540 "name": "Nvme0", 00:31:32.540 "trtype": "tcp", 00:31:32.540 "traddr": "10.0.0.2", 00:31:32.540 "adrfam": "ipv4", 00:31:32.540 "trsvcid": "4420", 00:31:32.540 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:32.540 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:32.540 "hdgst": false, 00:31:32.540 "ddgst": false 00:31:32.540 }, 00:31:32.540 "method": "bdev_nvme_attach_controller" 00:31:32.540 },{ 00:31:32.540 "params": { 00:31:32.540 "name": "Nvme1", 00:31:32.540 "trtype": "tcp", 00:31:32.540 "traddr": "10.0.0.2", 00:31:32.540 "adrfam": "ipv4", 00:31:32.540 "trsvcid": "4420", 00:31:32.540 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:32.540 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:32.540 "hdgst": false, 00:31:32.540 "ddgst": false 00:31:32.540 }, 00:31:32.540 "method": "bdev_nvme_attach_controller" 00:31:32.540 },{ 00:31:32.540 "params": { 00:31:32.540 "name": "Nvme2", 00:31:32.540 "trtype": "tcp", 00:31:32.540 "traddr": "10.0.0.2", 00:31:32.540 "adrfam": "ipv4", 00:31:32.540 "trsvcid": "4420", 00:31:32.540 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:32.540 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:32.540 "hdgst": false, 00:31:32.540 "ddgst": false 00:31:32.540 }, 00:31:32.540 "method": "bdev_nvme_attach_controller" 00:31:32.540 }' 00:31:32.540 02:14:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:32.540 02:14:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:32.540 02:14:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:32.540 02:14:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:32.540 02:14:06 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:32.540 02:14:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:32.540 02:14:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:32.540 02:14:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:32.540 02:14:06 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:32.540 02:14:06 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:32.798 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:32.798 ... 00:31:32.798 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:32.798 ... 00:31:32.798 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:32.798 ... 00:31:32.798 fio-3.35 00:31:32.798 Starting 24 threads 00:31:32.798 EAL: No free 2048 kB hugepages reported on node 1 00:31:33.732 [2024-11-18 02:14:07.907060] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:33.732 [2024-11-18 02:14:07.907118] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:43.707 00:31:43.707 filename0: (groupid=0, jobs=1): err= 0: pid=1350753: Mon Nov 18 02:14:18 2024 00:31:43.707 read: IOPS=503, BW=2014KiB/s (2062kB/s)(19.7MiB/10011msec) 00:31:43.707 slat (usec): min=8, max=127, avg=33.16, stdev= 9.40 00:31:43.707 clat (usec): min=14490, max=69786, avg=31484.80, stdev=2334.79 00:31:43.707 lat (usec): min=14528, max=69830, avg=31517.96, stdev=2334.66 00:31:43.707 clat percentiles (usec): 00:31:43.707 | 1.00th=[30278], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:43.707 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.707 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:31:43.707 | 99.00th=[39584], 99.50th=[46924], 99.90th=[55837], 99.95th=[55837], 00:31:43.707 | 99.99th=[69731] 00:31:43.707 bw ( KiB/s): min= 1792, max= 2052, per=4.15%, avg=2010.20, stdev=73.46, samples=20 00:31:43.707 iops : min= 448, max= 513, avg=502.55, stdev=18.37, samples=20 00:31:43.707 lat (msec) : 20=0.56%, 50=99.09%, 100=0.36% 00:31:43.707 cpu : usr=97.72%, sys=1.50%, ctx=119, majf=0, minf=9 00:31:43.707 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:43.707 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.707 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.707 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.707 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.707 filename0: (groupid=0, jobs=1): err= 0: pid=1350754: Mon Nov 18 02:14:18 2024 00:31:43.707 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10005msec) 00:31:43.707 slat (nsec): min=9348, max=94618, avg=39410.75, stdev=11931.04 00:31:43.707 clat (usec): min=26704, max=65933, avg=31496.87, stdev=2023.98 00:31:43.707 lat (usec): min=26727, max=65951, avg=31536.28, stdev=2023.22 00:31:43.707 clat percentiles (usec): 00:31:43.707 | 1.00th=[30540], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:31:43.707 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:31:43.707 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32637], 00:31:43.707 | 99.00th=[38536], 99.50th=[40109], 99.90th=[60556], 99.95th=[60556], 00:31:43.707 | 99.99th=[65799] 00:31:43.707 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2007.58, stdev=74.55, samples=19 00:31:43.707 iops : min= 448, max= 512, avg=501.89, stdev=18.64, samples=19 00:31:43.707 lat (msec) : 50=99.68%, 100=0.32% 00:31:43.707 cpu : usr=98.37%, sys=1.14%, ctx=58, majf=0, minf=9 00:31:43.707 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:43.707 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.707 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.707 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.707 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.707 filename0: (groupid=0, jobs=1): err= 0: pid=1350755: Mon Nov 18 02:14:18 2024 00:31:43.707 read: IOPS=503, BW=2014KiB/s (2062kB/s)(19.7MiB/10006msec) 00:31:43.707 slat (usec): min=8, max=176, avg=48.29, stdev=33.15 00:31:43.707 clat (usec): min=14478, max=65288, avg=31349.10, stdev=2546.58 00:31:43.707 lat (usec): min=14518, max=65303, avg=31397.39, stdev=2541.95 00:31:43.707 clat percentiles (usec): 00:31:43.707 | 1.00th=[28705], 5.00th=[30016], 10.00th=[30540], 20.00th=[30802], 00:31:43.707 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:31:43.707 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:31:43.707 | 99.00th=[38536], 99.50th=[39584], 99.90th=[65274], 99.95th=[65274], 00:31:43.707 | 99.99th=[65274] 00:31:43.707 bw ( KiB/s): min= 1776, max= 2048, per=4.15%, avg=2006.74, stdev=77.16, samples=19 00:31:43.707 iops : min= 444, max= 512, avg=501.68, stdev=19.29, samples=19 00:31:43.707 lat (msec) : 20=0.60%, 50=99.09%, 100=0.32% 00:31:43.707 cpu : usr=98.88%, sys=0.72%, ctx=9, majf=0, minf=9 00:31:43.707 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:43.707 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.707 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.707 issued rwts: total=5038,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.707 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.707 filename0: (groupid=0, jobs=1): err= 0: pid=1350756: Mon Nov 18 02:14:18 2024 00:31:43.707 read: IOPS=506, BW=2027KiB/s (2075kB/s)(19.8MiB/10006msec) 00:31:43.707 slat (usec): min=3, max=181, avg=45.49, stdev=42.77 00:31:43.707 clat (usec): min=5082, max=45495, avg=31185.35, stdev=2611.92 00:31:43.707 lat (usec): min=5098, max=45503, avg=31230.84, stdev=2608.45 00:31:43.707 clat percentiles (usec): 00:31:43.707 | 1.00th=[18482], 5.00th=[29754], 10.00th=[30278], 20.00th=[30802], 00:31:43.707 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.707 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32637], 00:31:43.707 | 99.00th=[38011], 99.50th=[40109], 99.90th=[44303], 99.95th=[44827], 00:31:43.707 | 99.99th=[45351] 00:31:43.707 bw ( KiB/s): min= 1920, max= 2160, per=4.19%, avg=2026.95, stdev=62.21, samples=19 00:31:43.707 iops : min= 480, max= 540, avg=506.74, stdev=15.55, samples=19 00:31:43.707 lat (msec) : 10=0.63%, 20=0.47%, 50=98.90% 00:31:43.707 cpu : usr=98.28%, sys=1.31%, ctx=17, majf=0, minf=9 00:31:43.708 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:43.708 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 issued rwts: total=5070,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.708 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.708 filename0: (groupid=0, jobs=1): err= 0: pid=1350757: Mon Nov 18 02:14:18 2024 00:31:43.708 read: IOPS=503, BW=2016KiB/s (2064kB/s)(19.7MiB/10004msec) 00:31:43.708 slat (usec): min=8, max=111, avg=38.23, stdev=16.26 00:31:43.708 clat (usec): min=13369, max=49532, avg=31379.20, stdev=2411.92 00:31:43.708 lat (usec): min=13392, max=49570, avg=31417.42, stdev=2413.08 00:31:43.708 clat percentiles (usec): 00:31:43.708 | 1.00th=[23725], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:31:43.708 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:31:43.708 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32900], 00:31:43.708 | 99.00th=[40633], 99.50th=[46400], 99.90th=[49546], 99.95th=[49546], 00:31:43.708 | 99.99th=[49546] 00:31:43.708 bw ( KiB/s): min= 1792, max= 2096, per=4.15%, avg=2008.42, stdev=76.24, samples=19 00:31:43.708 iops : min= 448, max= 524, avg=502.11, stdev=19.06, samples=19 00:31:43.708 lat (msec) : 20=0.63%, 50=99.37% 00:31:43.708 cpu : usr=96.54%, sys=2.13%, ctx=278, majf=0, minf=9 00:31:43.708 IO depths : 1=5.5%, 2=11.5%, 4=24.2%, 8=51.7%, 16=7.1%, 32=0.0%, >=64=0.0% 00:31:43.708 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 complete : 0=0.0%, 4=93.9%, 8=0.3%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 issued rwts: total=5042,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.708 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.708 filename0: (groupid=0, jobs=1): err= 0: pid=1350758: Mon Nov 18 02:14:18 2024 00:31:43.708 read: IOPS=504, BW=2017KiB/s (2066kB/s)(19.8MiB/10026msec) 00:31:43.708 slat (usec): min=9, max=134, avg=40.78, stdev=20.76 00:31:43.708 clat (usec): min=19577, max=40713, avg=31301.96, stdev=1296.63 00:31:43.708 lat (usec): min=19596, max=40747, avg=31342.74, stdev=1299.55 00:31:43.708 clat percentiles (usec): 00:31:43.708 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:31:43.708 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:31:43.708 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:31:43.708 | 99.00th=[38011], 99.50th=[38536], 99.90th=[40633], 99.95th=[40633], 00:31:43.708 | 99.99th=[40633] 00:31:43.708 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=2016.15, stdev=56.60, samples=20 00:31:43.708 iops : min= 480, max= 512, avg=504.00, stdev=14.22, samples=20 00:31:43.708 lat (msec) : 20=0.32%, 50=99.68% 00:31:43.708 cpu : usr=96.72%, sys=1.82%, ctx=176, majf=0, minf=9 00:31:43.708 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:43.708 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.708 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.708 filename0: (groupid=0, jobs=1): err= 0: pid=1350759: Mon Nov 18 02:14:18 2024 00:31:43.708 read: IOPS=503, BW=2014KiB/s (2062kB/s)(19.7MiB/10011msec) 00:31:43.708 slat (nsec): min=6342, max=98618, avg=31519.04, stdev=8121.41 00:31:43.708 clat (usec): min=14493, max=55948, avg=31502.45, stdev=2068.79 00:31:43.708 lat (usec): min=14514, max=55964, avg=31533.97, stdev=2067.89 00:31:43.708 clat percentiles (usec): 00:31:43.708 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:43.708 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.708 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:31:43.708 | 99.00th=[39584], 99.50th=[39584], 99.90th=[55837], 99.95th=[55837], 00:31:43.708 | 99.99th=[55837] 00:31:43.708 bw ( KiB/s): min= 1792, max= 2052, per=4.15%, avg=2010.20, stdev=73.46, samples=20 00:31:43.708 iops : min= 448, max= 513, avg=502.55, stdev=18.37, samples=20 00:31:43.708 lat (msec) : 20=0.40%, 50=99.29%, 100=0.32% 00:31:43.708 cpu : usr=96.65%, sys=1.98%, ctx=311, majf=0, minf=9 00:31:43.708 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:43.708 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.708 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.708 filename0: (groupid=0, jobs=1): err= 0: pid=1350760: Mon Nov 18 02:14:18 2024 00:31:43.708 read: IOPS=504, BW=2017KiB/s (2065kB/s)(19.8MiB/10029msec) 00:31:43.708 slat (nsec): min=3975, max=84394, avg=38197.59, stdev=12069.29 00:31:43.708 clat (usec): min=22554, max=40710, avg=31420.65, stdev=1231.12 00:31:43.708 lat (usec): min=22558, max=40733, avg=31458.84, stdev=1231.49 00:31:43.708 clat percentiles (usec): 00:31:43.708 | 1.00th=[29492], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:31:43.708 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.708 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:31:43.708 | 99.00th=[38011], 99.50th=[38536], 99.90th=[40633], 99.95th=[40633], 00:31:43.708 | 99.99th=[40633] 00:31:43.708 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2015.55, stdev=56.63, samples=20 00:31:43.708 iops : min= 480, max= 512, avg=503.85, stdev=14.14, samples=20 00:31:43.708 lat (msec) : 50=100.00% 00:31:43.708 cpu : usr=97.54%, sys=1.57%, ctx=154, majf=0, minf=9 00:31:43.708 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:31:43.708 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.708 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.708 filename1: (groupid=0, jobs=1): err= 0: pid=1350761: Mon Nov 18 02:14:18 2024 00:31:43.708 read: IOPS=504, BW=2017KiB/s (2065kB/s)(19.8MiB/10027msec) 00:31:43.708 slat (nsec): min=4959, max=93721, avg=38880.73, stdev=11826.38 00:31:43.708 clat (usec): min=20517, max=40762, avg=31388.77, stdev=1272.46 00:31:43.708 lat (usec): min=20526, max=40799, avg=31427.65, stdev=1273.21 00:31:43.708 clat percentiles (usec): 00:31:43.708 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:31:43.708 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.708 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:31:43.708 | 99.00th=[38011], 99.50th=[38536], 99.90th=[40633], 99.95th=[40633], 00:31:43.708 | 99.99th=[40633] 00:31:43.708 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=2016.00, stdev=56.87, samples=20 00:31:43.708 iops : min= 480, max= 512, avg=504.00, stdev=14.22, samples=20 00:31:43.708 lat (msec) : 50=100.00% 00:31:43.708 cpu : usr=95.84%, sys=2.50%, ctx=337, majf=0, minf=9 00:31:43.708 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:43.708 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.708 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.708 filename1: (groupid=0, jobs=1): err= 0: pid=1350762: Mon Nov 18 02:14:18 2024 00:31:43.708 read: IOPS=505, BW=2022KiB/s (2070kB/s)(19.8MiB/10003msec) 00:31:43.708 slat (usec): min=6, max=104, avg=33.15, stdev=13.13 00:31:43.708 clat (usec): min=9646, max=40793, avg=31388.21, stdev=1850.63 00:31:43.708 lat (usec): min=9656, max=40817, avg=31421.36, stdev=1850.86 00:31:43.708 clat percentiles (usec): 00:31:43.708 | 1.00th=[30278], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:43.708 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:31:43.708 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:31:43.708 | 99.00th=[38011], 99.50th=[39060], 99.90th=[40633], 99.95th=[40633], 00:31:43.708 | 99.99th=[40633] 00:31:43.708 bw ( KiB/s): min= 1920, max= 2048, per=4.18%, avg=2021.05, stdev=53.61, samples=19 00:31:43.708 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:31:43.708 lat (msec) : 10=0.14%, 20=0.49%, 50=99.37% 00:31:43.708 cpu : usr=96.23%, sys=2.17%, ctx=173, majf=0, minf=9 00:31:43.708 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:43.708 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.708 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.708 filename1: (groupid=0, jobs=1): err= 0: pid=1350763: Mon Nov 18 02:14:18 2024 00:31:43.708 read: IOPS=504, BW=2018KiB/s (2066kB/s)(19.7MiB/10002msec) 00:31:43.708 slat (usec): min=8, max=106, avg=35.01, stdev=12.93 00:31:43.708 clat (usec): min=13298, max=53553, avg=31397.97, stdev=2339.51 00:31:43.708 lat (usec): min=13331, max=53587, avg=31432.98, stdev=2340.56 00:31:43.708 clat percentiles (usec): 00:31:43.708 | 1.00th=[22938], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:43.708 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.708 | 70.00th=[31589], 80.00th=[31589], 90.00th=[31851], 95.00th=[32637], 00:31:43.708 | 99.00th=[39584], 99.50th=[49021], 99.90th=[53216], 99.95th=[53740], 00:31:43.708 | 99.99th=[53740] 00:31:43.708 bw ( KiB/s): min= 1792, max= 2096, per=4.15%, avg=2010.11, stdev=76.77, samples=19 00:31:43.708 iops : min= 448, max= 524, avg=502.53, stdev=19.19, samples=19 00:31:43.708 lat (msec) : 20=0.71%, 50=99.09%, 100=0.20% 00:31:43.708 cpu : usr=98.72%, sys=0.88%, ctx=12, majf=0, minf=9 00:31:43.708 IO depths : 1=6.1%, 2=12.2%, 4=24.7%, 8=50.5%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:43.708 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 complete : 0=0.0%, 4=94.0%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.708 issued rwts: total=5046,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.708 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.708 filename1: (groupid=0, jobs=1): err= 0: pid=1350764: Mon Nov 18 02:14:18 2024 00:31:43.708 read: IOPS=503, BW=2014KiB/s (2063kB/s)(19.7MiB/10009msec) 00:31:43.708 slat (usec): min=6, max=107, avg=32.78, stdev=13.77 00:31:43.708 clat (usec): min=14417, max=53812, avg=31486.39, stdev=1922.68 00:31:43.708 lat (usec): min=14432, max=53827, avg=31519.17, stdev=1921.07 00:31:43.708 clat percentiles (usec): 00:31:43.708 | 1.00th=[30278], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:43.709 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.709 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:31:43.709 | 99.00th=[38011], 99.50th=[39584], 99.90th=[53740], 99.95th=[53740], 00:31:43.709 | 99.99th=[53740] 00:31:43.709 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2007.58, stdev=74.55, samples=19 00:31:43.709 iops : min= 448, max= 512, avg=501.89, stdev=18.64, samples=19 00:31:43.709 lat (msec) : 20=0.32%, 50=99.37%, 100=0.32% 00:31:43.709 cpu : usr=98.56%, sys=1.01%, ctx=13, majf=0, minf=9 00:31:43.709 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:43.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.709 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.709 filename1: (groupid=0, jobs=1): err= 0: pid=1350765: Mon Nov 18 02:14:18 2024 00:31:43.709 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10005msec) 00:31:43.709 slat (usec): min=8, max=136, avg=22.87, stdev=13.68 00:31:43.709 clat (usec): min=15692, max=61392, avg=31698.70, stdev=2040.14 00:31:43.709 lat (usec): min=15701, max=61450, avg=31721.57, stdev=2040.18 00:31:43.709 clat percentiles (usec): 00:31:43.709 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:31:43.709 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:43.709 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32637], 00:31:43.709 | 99.00th=[38536], 99.50th=[40109], 99.90th=[61080], 99.95th=[61080], 00:31:43.709 | 99.99th=[61604] 00:31:43.709 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2006.74, stdev=70.01, samples=19 00:31:43.709 iops : min= 448, max= 512, avg=501.68, stdev=17.50, samples=19 00:31:43.709 lat (msec) : 20=0.04%, 50=99.64%, 100=0.32% 00:31:43.709 cpu : usr=98.69%, sys=0.89%, ctx=19, majf=0, minf=10 00:31:43.709 IO depths : 1=0.3%, 2=6.6%, 4=25.0%, 8=55.9%, 16=12.2%, 32=0.0%, >=64=0.0% 00:31:43.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.709 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.709 filename1: (groupid=0, jobs=1): err= 0: pid=1350766: Mon Nov 18 02:14:18 2024 00:31:43.709 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10005msec) 00:31:43.709 slat (nsec): min=9266, max=89786, avg=35933.01, stdev=8630.44 00:31:43.709 clat (usec): min=27911, max=65951, avg=31531.06, stdev=2010.89 00:31:43.709 lat (usec): min=27932, max=65968, avg=31566.99, stdev=2010.18 00:31:43.709 clat percentiles (usec): 00:31:43.709 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[30802], 00:31:43.709 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.709 | 70.00th=[31589], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:31:43.709 | 99.00th=[38536], 99.50th=[40109], 99.90th=[60556], 99.95th=[60556], 00:31:43.709 | 99.99th=[65799] 00:31:43.709 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2007.58, stdev=74.55, samples=19 00:31:43.709 iops : min= 448, max= 512, avg=501.89, stdev=18.64, samples=19 00:31:43.709 lat (msec) : 50=99.68%, 100=0.32% 00:31:43.709 cpu : usr=98.63%, sys=0.91%, ctx=13, majf=0, minf=9 00:31:43.709 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:43.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.709 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.709 filename1: (groupid=0, jobs=1): err= 0: pid=1350767: Mon Nov 18 02:14:18 2024 00:31:43.709 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10005msec) 00:31:43.709 slat (usec): min=8, max=158, avg=55.89, stdev=34.14 00:31:43.709 clat (usec): min=27518, max=60931, avg=31330.67, stdev=2038.04 00:31:43.709 lat (usec): min=27543, max=60943, avg=31386.56, stdev=2033.52 00:31:43.709 clat percentiles (usec): 00:31:43.709 | 1.00th=[29492], 5.00th=[30016], 10.00th=[30540], 20.00th=[30802], 00:31:43.709 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:31:43.709 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:31:43.709 | 99.00th=[38536], 99.50th=[40633], 99.90th=[61080], 99.95th=[61080], 00:31:43.709 | 99.99th=[61080] 00:31:43.709 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2007.58, stdev=74.55, samples=19 00:31:43.709 iops : min= 448, max= 512, avg=501.89, stdev=18.64, samples=19 00:31:43.709 lat (msec) : 50=99.68%, 100=0.32% 00:31:43.709 cpu : usr=97.45%, sys=1.49%, ctx=57, majf=0, minf=9 00:31:43.709 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:43.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.709 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.709 filename1: (groupid=0, jobs=1): err= 0: pid=1350768: Mon Nov 18 02:14:18 2024 00:31:43.709 read: IOPS=504, BW=2017KiB/s (2066kB/s)(19.8MiB/10026msec) 00:31:43.709 slat (nsec): min=6125, max=86698, avg=35698.20, stdev=8545.40 00:31:43.709 clat (usec): min=19119, max=47694, avg=31415.75, stdev=1349.30 00:31:43.709 lat (usec): min=19173, max=47707, avg=31451.45, stdev=1349.60 00:31:43.709 clat percentiles (usec): 00:31:43.709 | 1.00th=[30016], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:43.709 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.709 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:31:43.709 | 99.00th=[38011], 99.50th=[39060], 99.90th=[40633], 99.95th=[40633], 00:31:43.709 | 99.99th=[47449] 00:31:43.709 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=2016.15, stdev=56.60, samples=20 00:31:43.709 iops : min= 480, max= 512, avg=504.00, stdev=14.22, samples=20 00:31:43.709 lat (msec) : 20=0.32%, 50=99.68% 00:31:43.709 cpu : usr=98.70%, sys=0.92%, ctx=12, majf=0, minf=9 00:31:43.709 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:43.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.709 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.709 filename2: (groupid=0, jobs=1): err= 0: pid=1350769: Mon Nov 18 02:14:18 2024 00:31:43.709 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10005msec) 00:31:43.709 slat (nsec): min=8478, max=94102, avg=38508.96, stdev=14007.48 00:31:43.709 clat (usec): min=27025, max=60746, avg=31497.08, stdev=1989.78 00:31:43.709 lat (usec): min=27035, max=60779, avg=31535.59, stdev=1989.75 00:31:43.709 clat percentiles (usec): 00:31:43.709 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:31:43.709 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.709 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:31:43.709 | 99.00th=[38536], 99.50th=[40109], 99.90th=[60556], 99.95th=[60556], 00:31:43.709 | 99.99th=[60556] 00:31:43.709 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2007.58, stdev=74.55, samples=19 00:31:43.709 iops : min= 448, max= 512, avg=501.89, stdev=18.64, samples=19 00:31:43.709 lat (msec) : 50=99.68%, 100=0.32% 00:31:43.709 cpu : usr=98.45%, sys=1.10%, ctx=31, majf=0, minf=9 00:31:43.709 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:31:43.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.709 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.709 filename2: (groupid=0, jobs=1): err= 0: pid=1350770: Mon Nov 18 02:14:18 2024 00:31:43.709 read: IOPS=503, BW=2014KiB/s (2062kB/s)(19.7MiB/10010msec) 00:31:43.709 slat (nsec): min=8262, max=78636, avg=32445.89, stdev=8270.17 00:31:43.709 clat (usec): min=14384, max=53737, avg=31481.77, stdev=1910.28 00:31:43.709 lat (usec): min=14429, max=53775, avg=31514.22, stdev=1910.02 00:31:43.709 clat percentiles (usec): 00:31:43.709 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:43.709 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.709 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:31:43.709 | 99.00th=[38011], 99.50th=[39584], 99.90th=[53740], 99.95th=[53740], 00:31:43.709 | 99.99th=[53740] 00:31:43.709 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2007.58, stdev=74.55, samples=19 00:31:43.709 iops : min= 448, max= 512, avg=501.89, stdev=18.64, samples=19 00:31:43.709 lat (msec) : 20=0.32%, 50=99.37%, 100=0.32% 00:31:43.709 cpu : usr=98.29%, sys=1.11%, ctx=68, majf=0, minf=9 00:31:43.709 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:43.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.709 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.709 filename2: (groupid=0, jobs=1): err= 0: pid=1350771: Mon Nov 18 02:14:18 2024 00:31:43.709 read: IOPS=506, BW=2024KiB/s (2073kB/s)(19.8MiB/10022msec) 00:31:43.709 slat (nsec): min=6593, max=71605, avg=16129.67, stdev=7029.60 00:31:43.709 clat (usec): min=9674, max=42490, avg=31461.24, stdev=2114.19 00:31:43.709 lat (usec): min=9683, max=42508, avg=31477.37, stdev=2114.15 00:31:43.709 clat percentiles (usec): 00:31:43.709 | 1.00th=[20579], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:43.709 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:31:43.709 | 70.00th=[31589], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:43.709 | 99.00th=[38011], 99.50th=[41157], 99.90th=[41157], 99.95th=[42206], 00:31:43.709 | 99.99th=[42730] 00:31:43.709 bw ( KiB/s): min= 1920, max= 2176, per=4.18%, avg=2022.40, stdev=66.96, samples=20 00:31:43.709 iops : min= 480, max= 544, avg=505.60, stdev=16.74, samples=20 00:31:43.709 lat (msec) : 10=0.32%, 20=0.63%, 50=99.05% 00:31:43.709 cpu : usr=98.54%, sys=1.04%, ctx=15, majf=0, minf=9 00:31:43.709 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:43.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.709 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.710 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.710 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.710 filename2: (groupid=0, jobs=1): err= 0: pid=1350772: Mon Nov 18 02:14:18 2024 00:31:43.710 read: IOPS=530, BW=2122KiB/s (2173kB/s)(20.7MiB/10003msec) 00:31:43.710 slat (usec): min=7, max=161, avg=30.77, stdev=34.18 00:31:43.710 clat (usec): min=13303, max=65312, avg=29976.15, stdev=6078.55 00:31:43.710 lat (usec): min=13336, max=65325, avg=30006.92, stdev=6084.14 00:31:43.710 clat percentiles (usec): 00:31:43.710 | 1.00th=[16712], 5.00th=[16909], 10.00th=[22152], 20.00th=[25297], 00:31:43.710 | 30.00th=[30278], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:31:43.710 | 70.00th=[31327], 80.00th=[31851], 90.00th=[34866], 95.00th=[39584], 00:31:43.710 | 99.00th=[47449], 99.50th=[54789], 99.90th=[65274], 99.95th=[65274], 00:31:43.710 | 99.99th=[65274] 00:31:43.710 bw ( KiB/s): min= 1776, max= 2336, per=4.38%, avg=2119.58, stdev=179.55, samples=19 00:31:43.710 iops : min= 444, max= 584, avg=529.89, stdev=44.89, samples=19 00:31:43.710 lat (msec) : 20=6.94%, 50=92.56%, 100=0.51% 00:31:43.710 cpu : usr=98.57%, sys=1.03%, ctx=12, majf=0, minf=9 00:31:43.710 IO depths : 1=1.3%, 2=3.4%, 4=10.9%, 8=71.5%, 16=12.9%, 32=0.0%, >=64=0.0% 00:31:43.710 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.710 complete : 0=0.0%, 4=90.6%, 8=5.5%, 16=3.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.710 issued rwts: total=5306,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.710 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.710 filename2: (groupid=0, jobs=1): err= 0: pid=1350773: Mon Nov 18 02:14:18 2024 00:31:43.710 read: IOPS=503, BW=2015KiB/s (2063kB/s)(19.7MiB/10006msec) 00:31:43.710 slat (nsec): min=8402, max=85085, avg=31211.46, stdev=11846.81 00:31:43.710 clat (usec): min=14362, max=51828, avg=31494.61, stdev=1892.81 00:31:43.710 lat (usec): min=14401, max=51865, avg=31525.82, stdev=1892.38 00:31:43.710 clat percentiles (usec): 00:31:43.710 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:43.710 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.710 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:31:43.710 | 99.00th=[38536], 99.50th=[39584], 99.90th=[51643], 99.95th=[51643], 00:31:43.710 | 99.99th=[51643] 00:31:43.710 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2007.58, stdev=74.55, samples=19 00:31:43.710 iops : min= 448, max= 512, avg=501.89, stdev=18.64, samples=19 00:31:43.710 lat (msec) : 20=0.36%, 50=99.33%, 100=0.32% 00:31:43.710 cpu : usr=98.53%, sys=1.04%, ctx=15, majf=0, minf=9 00:31:43.710 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:43.710 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.710 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.710 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.710 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.710 filename2: (groupid=0, jobs=1): err= 0: pid=1350774: Mon Nov 18 02:14:18 2024 00:31:43.710 read: IOPS=504, BW=2017KiB/s (2065kB/s)(19.8MiB/10027msec) 00:31:43.710 slat (nsec): min=6216, max=69047, avg=30506.18, stdev=10079.82 00:31:43.710 clat (usec): min=20502, max=40710, avg=31479.53, stdev=1277.03 00:31:43.710 lat (usec): min=20508, max=40733, avg=31510.03, stdev=1276.84 00:31:43.710 clat percentiles (usec): 00:31:43.710 | 1.00th=[29492], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:43.710 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:31:43.710 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32637], 00:31:43.710 | 99.00th=[38011], 99.50th=[38536], 99.90th=[40633], 99.95th=[40633], 00:31:43.710 | 99.99th=[40633] 00:31:43.710 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=2016.00, stdev=56.87, samples=20 00:31:43.710 iops : min= 480, max= 512, avg=504.00, stdev=14.22, samples=20 00:31:43.710 lat (msec) : 50=100.00% 00:31:43.710 cpu : usr=98.57%, sys=0.98%, ctx=14, majf=0, minf=11 00:31:43.710 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:43.710 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.710 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.710 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.710 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.710 filename2: (groupid=0, jobs=1): err= 0: pid=1350775: Mon Nov 18 02:14:18 2024 00:31:43.710 read: IOPS=504, BW=2017KiB/s (2065kB/s)(19.8MiB/10027msec) 00:31:43.710 slat (nsec): min=7764, max=78439, avg=37273.25, stdev=9304.12 00:31:43.710 clat (usec): min=19557, max=42693, avg=31398.23, stdev=1325.51 00:31:43.710 lat (usec): min=19566, max=42715, avg=31435.50, stdev=1326.02 00:31:43.710 clat percentiles (usec): 00:31:43.710 | 1.00th=[30278], 5.00th=[30802], 10.00th=[30802], 20.00th=[30802], 00:31:43.710 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:43.710 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:31:43.710 | 99.00th=[38011], 99.50th=[39060], 99.90th=[40633], 99.95th=[40633], 00:31:43.710 | 99.99th=[42730] 00:31:43.710 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=2016.15, stdev=56.60, samples=20 00:31:43.710 iops : min= 480, max= 512, avg=504.00, stdev=14.22, samples=20 00:31:43.710 lat (msec) : 20=0.32%, 50=99.68% 00:31:43.710 cpu : usr=97.33%, sys=1.75%, ctx=148, majf=0, minf=9 00:31:43.710 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:43.710 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.710 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.710 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.710 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.710 filename2: (groupid=0, jobs=1): err= 0: pid=1350776: Mon Nov 18 02:14:18 2024 00:31:43.710 read: IOPS=503, BW=2014KiB/s (2063kB/s)(19.7MiB/10004msec) 00:31:43.710 slat (usec): min=8, max=154, avg=17.43, stdev=13.58 00:31:43.710 clat (usec): min=11212, max=63591, avg=31646.16, stdev=2572.94 00:31:43.710 lat (usec): min=11220, max=63626, avg=31663.59, stdev=2574.01 00:31:43.710 clat percentiles (usec): 00:31:43.710 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:31:43.710 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:43.710 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:31:43.710 | 99.00th=[39060], 99.50th=[41157], 99.90th=[63177], 99.95th=[63701], 00:31:43.710 | 99.99th=[63701] 00:31:43.710 bw ( KiB/s): min= 1792, max= 2048, per=4.13%, avg=2000.84, stdev=71.05, samples=19 00:31:43.710 iops : min= 448, max= 512, avg=500.21, stdev=17.76, samples=19 00:31:43.710 lat (msec) : 20=0.60%, 50=99.09%, 100=0.32% 00:31:43.710 cpu : usr=98.56%, sys=1.03%, ctx=13, majf=0, minf=9 00:31:43.710 IO depths : 1=0.3%, 2=6.5%, 4=25.0%, 8=56.0%, 16=12.2%, 32=0.0%, >=64=0.0% 00:31:43.710 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.710 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.710 issued rwts: total=5038,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.710 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:43.710 00:31:43.710 Run status group 0 (all jobs): 00:31:43.710 READ: bw=47.3MiB/s (49.6MB/s), 2009KiB/s-2122KiB/s (2057kB/s-2173kB/s), io=474MiB (497MB), run=10002-10029msec 00:31:44.276 02:14:18 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:31:44.276 02:14:18 -- target/dif.sh@43 -- # local sub 00:31:44.276 02:14:18 -- target/dif.sh@45 -- # for sub in "$@" 00:31:44.276 02:14:18 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:44.276 02:14:18 -- target/dif.sh@36 -- # local sub_id=0 00:31:44.276 02:14:18 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:44.276 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.276 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.276 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.276 02:14:18 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:44.276 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.276 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.276 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.276 02:14:18 -- target/dif.sh@45 -- # for sub in "$@" 00:31:44.276 02:14:18 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:44.276 02:14:18 -- target/dif.sh@36 -- # local sub_id=1 00:31:44.276 02:14:18 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:44.276 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.276 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.276 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.276 02:14:18 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:44.276 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.276 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.276 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.276 02:14:18 -- target/dif.sh@45 -- # for sub in "$@" 00:31:44.276 02:14:18 -- target/dif.sh@46 -- # destroy_subsystem 2 00:31:44.276 02:14:18 -- target/dif.sh@36 -- # local sub_id=2 00:31:44.276 02:14:18 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:31:44.276 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.276 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.276 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.276 02:14:18 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:31:44.276 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.276 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.276 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.276 02:14:18 -- target/dif.sh@115 -- # NULL_DIF=1 00:31:44.276 02:14:18 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:31:44.276 02:14:18 -- target/dif.sh@115 -- # numjobs=2 00:31:44.276 02:14:18 -- target/dif.sh@115 -- # iodepth=8 00:31:44.276 02:14:18 -- target/dif.sh@115 -- # runtime=5 00:31:44.276 02:14:18 -- target/dif.sh@115 -- # files=1 00:31:44.276 02:14:18 -- target/dif.sh@117 -- # create_subsystems 0 1 00:31:44.276 02:14:18 -- target/dif.sh@28 -- # local sub 00:31:44.276 02:14:18 -- target/dif.sh@30 -- # for sub in "$@" 00:31:44.276 02:14:18 -- target/dif.sh@31 -- # create_subsystem 0 00:31:44.276 02:14:18 -- target/dif.sh@18 -- # local sub_id=0 00:31:44.276 02:14:18 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:44.276 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.277 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.277 bdev_null0 00:31:44.277 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.277 02:14:18 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:44.277 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.277 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.277 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.277 02:14:18 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:44.277 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.277 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.277 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.277 02:14:18 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:44.277 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.277 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.277 [2024-11-18 02:14:18.485950] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:44.277 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.277 02:14:18 -- target/dif.sh@30 -- # for sub in "$@" 00:31:44.277 02:14:18 -- target/dif.sh@31 -- # create_subsystem 1 00:31:44.277 02:14:18 -- target/dif.sh@18 -- # local sub_id=1 00:31:44.277 02:14:18 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:44.277 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.277 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.277 bdev_null1 00:31:44.277 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.277 02:14:18 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:44.277 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.277 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.277 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.277 02:14:18 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:44.277 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.277 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.277 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.277 02:14:18 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:44.277 02:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.277 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:31:44.277 02:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.277 02:14:18 -- target/dif.sh@118 -- # fio /dev/fd/62 00:31:44.277 02:14:18 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:31:44.277 02:14:18 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:44.277 02:14:18 -- nvmf/common.sh@520 -- # config=() 00:31:44.277 02:14:18 -- nvmf/common.sh@520 -- # local subsystem config 00:31:44.277 02:14:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:44.277 02:14:18 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.277 02:14:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:44.277 { 00:31:44.277 "params": { 00:31:44.277 "name": "Nvme$subsystem", 00:31:44.277 "trtype": "$TEST_TRANSPORT", 00:31:44.277 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:44.277 "adrfam": "ipv4", 00:31:44.277 "trsvcid": "$NVMF_PORT", 00:31:44.277 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:44.277 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:44.277 "hdgst": ${hdgst:-false}, 00:31:44.277 "ddgst": ${ddgst:-false} 00:31:44.277 }, 00:31:44.277 "method": "bdev_nvme_attach_controller" 00:31:44.277 } 00:31:44.277 EOF 00:31:44.277 )") 00:31:44.277 02:14:18 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.277 02:14:18 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:44.277 02:14:18 -- target/dif.sh@82 -- # gen_fio_conf 00:31:44.277 02:14:18 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:44.277 02:14:18 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:44.277 02:14:18 -- target/dif.sh@54 -- # local file 00:31:44.277 02:14:18 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.277 02:14:18 -- target/dif.sh@56 -- # cat 00:31:44.277 02:14:18 -- common/autotest_common.sh@1330 -- # shift 00:31:44.277 02:14:18 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:44.277 02:14:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:44.277 02:14:18 -- nvmf/common.sh@542 -- # cat 00:31:44.277 02:14:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.277 02:14:18 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:44.277 02:14:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:44.277 02:14:18 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:44.277 02:14:18 -- target/dif.sh@72 -- # (( file <= files )) 00:31:44.277 02:14:18 -- target/dif.sh@73 -- # cat 00:31:44.277 02:14:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:44.277 02:14:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:44.277 { 00:31:44.277 "params": { 00:31:44.277 "name": "Nvme$subsystem", 00:31:44.277 "trtype": "$TEST_TRANSPORT", 00:31:44.277 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:44.277 "adrfam": "ipv4", 00:31:44.277 "trsvcid": "$NVMF_PORT", 00:31:44.277 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:44.277 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:44.277 "hdgst": ${hdgst:-false}, 00:31:44.277 "ddgst": ${ddgst:-false} 00:31:44.277 }, 00:31:44.277 "method": "bdev_nvme_attach_controller" 00:31:44.277 } 00:31:44.277 EOF 00:31:44.277 )") 00:31:44.277 02:14:18 -- nvmf/common.sh@542 -- # cat 00:31:44.277 02:14:18 -- target/dif.sh@72 -- # (( file++ )) 00:31:44.277 02:14:18 -- target/dif.sh@72 -- # (( file <= files )) 00:31:44.277 02:14:18 -- nvmf/common.sh@544 -- # jq . 00:31:44.277 02:14:18 -- nvmf/common.sh@545 -- # IFS=, 00:31:44.277 02:14:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:44.277 "params": { 00:31:44.277 "name": "Nvme0", 00:31:44.277 "trtype": "tcp", 00:31:44.277 "traddr": "10.0.0.2", 00:31:44.277 "adrfam": "ipv4", 00:31:44.277 "trsvcid": "4420", 00:31:44.277 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:44.277 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:44.277 "hdgst": false, 00:31:44.277 "ddgst": false 00:31:44.277 }, 00:31:44.277 "method": "bdev_nvme_attach_controller" 00:31:44.277 },{ 00:31:44.277 "params": { 00:31:44.277 "name": "Nvme1", 00:31:44.277 "trtype": "tcp", 00:31:44.277 "traddr": "10.0.0.2", 00:31:44.277 "adrfam": "ipv4", 00:31:44.277 "trsvcid": "4420", 00:31:44.277 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:44.277 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:44.277 "hdgst": false, 00:31:44.277 "ddgst": false 00:31:44.277 }, 00:31:44.277 "method": "bdev_nvme_attach_controller" 00:31:44.277 }' 00:31:44.277 02:14:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:44.277 02:14:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:44.277 02:14:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:44.277 02:14:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.277 02:14:18 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:44.277 02:14:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:44.277 02:14:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:44.277 02:14:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:44.277 02:14:18 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:44.277 02:14:18 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.535 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:44.535 ... 00:31:44.535 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:44.535 ... 00:31:44.535 fio-3.35 00:31:44.535 Starting 4 threads 00:31:44.535 EAL: No free 2048 kB hugepages reported on node 1 00:31:45.101 [2024-11-18 02:14:19.482180] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:45.101 [2024-11-18 02:14:19.482256] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:50.363 00:31:50.363 filename0: (groupid=0, jobs=1): err= 0: pid=1352191: Mon Nov 18 02:14:24 2024 00:31:50.363 read: IOPS=1905, BW=14.9MiB/s (15.6MB/s)(74.5MiB/5002msec) 00:31:50.363 slat (nsec): min=3954, max=67432, avg=17539.13, stdev=9276.17 00:31:50.363 clat (usec): min=746, max=7803, avg=4137.93, stdev=638.88 00:31:50.363 lat (usec): min=768, max=7820, avg=4155.47, stdev=638.45 00:31:50.363 clat percentiles (usec): 00:31:50.363 | 1.00th=[ 2606], 5.00th=[ 3261], 10.00th=[ 3523], 20.00th=[ 3785], 00:31:50.363 | 30.00th=[ 3916], 40.00th=[ 3982], 50.00th=[ 4080], 60.00th=[ 4178], 00:31:50.363 | 70.00th=[ 4293], 80.00th=[ 4424], 90.00th=[ 4817], 95.00th=[ 5276], 00:31:50.363 | 99.00th=[ 6390], 99.50th=[ 6849], 99.90th=[ 7439], 99.95th=[ 7635], 00:31:50.363 | 99.99th=[ 7832] 00:31:50.363 bw ( KiB/s): min=14016, max=15840, per=24.58%, avg=15201.78, stdev=691.41, samples=9 00:31:50.363 iops : min= 1752, max= 1980, avg=1900.22, stdev=86.43, samples=9 00:31:50.363 lat (usec) : 750=0.01%, 1000=0.05% 00:31:50.363 lat (msec) : 2=0.30%, 4=41.40%, 10=58.24% 00:31:50.363 cpu : usr=95.78%, sys=3.74%, ctx=6, majf=0, minf=42 00:31:50.363 IO depths : 1=0.1%, 2=11.8%, 4=59.9%, 8=28.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:50.363 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.363 complete : 0=0.0%, 4=92.7%, 8=7.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.363 issued rwts: total=9532,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.363 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:50.363 filename0: (groupid=0, jobs=1): err= 0: pid=1352192: Mon Nov 18 02:14:24 2024 00:31:50.363 read: IOPS=1966, BW=15.4MiB/s (16.1MB/s)(76.8MiB/5001msec) 00:31:50.363 slat (nsec): min=3778, max=61850, avg=16551.88, stdev=8502.44 00:31:50.363 clat (usec): min=1012, max=9690, avg=4013.45, stdev=585.60 00:31:50.363 lat (usec): min=1031, max=9702, avg=4030.00, stdev=585.72 00:31:50.363 clat percentiles (usec): 00:31:50.363 | 1.00th=[ 2409], 5.00th=[ 3064], 10.00th=[ 3326], 20.00th=[ 3654], 00:31:50.363 | 30.00th=[ 3851], 40.00th=[ 3949], 50.00th=[ 4047], 60.00th=[ 4113], 00:31:50.363 | 70.00th=[ 4228], 80.00th=[ 4359], 90.00th=[ 4555], 95.00th=[ 4817], 00:31:50.363 | 99.00th=[ 5800], 99.50th=[ 6259], 99.90th=[ 7242], 99.95th=[ 7635], 00:31:50.363 | 99.99th=[ 9634] 00:31:50.363 bw ( KiB/s): min=14688, max=16352, per=25.37%, avg=15686.78, stdev=593.06, samples=9 00:31:50.363 iops : min= 1836, max= 2044, avg=1960.78, stdev=74.25, samples=9 00:31:50.363 lat (msec) : 2=0.54%, 4=44.35%, 10=55.11% 00:31:50.363 cpu : usr=96.38%, sys=3.14%, ctx=8, majf=0, minf=55 00:31:50.363 IO depths : 1=0.2%, 2=11.0%, 4=60.6%, 8=28.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:50.363 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.363 complete : 0=0.0%, 4=92.8%, 8=7.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.363 issued rwts: total=9834,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.363 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:50.363 filename1: (groupid=0, jobs=1): err= 0: pid=1352193: Mon Nov 18 02:14:24 2024 00:31:50.363 read: IOPS=1953, BW=15.3MiB/s (16.0MB/s)(76.3MiB/5002msec) 00:31:50.363 slat (nsec): min=3901, max=64842, avg=16075.04, stdev=9235.27 00:31:50.363 clat (usec): min=872, max=10987, avg=4043.09, stdev=650.58 00:31:50.363 lat (usec): min=887, max=11013, avg=4059.16, stdev=650.76 00:31:50.363 clat percentiles (usec): 00:31:50.363 | 1.00th=[ 2311], 5.00th=[ 3097], 10.00th=[ 3326], 20.00th=[ 3654], 00:31:50.363 | 30.00th=[ 3851], 40.00th=[ 3949], 50.00th=[ 4047], 60.00th=[ 4113], 00:31:50.363 | 70.00th=[ 4228], 80.00th=[ 4359], 90.00th=[ 4621], 95.00th=[ 5080], 00:31:50.363 | 99.00th=[ 6194], 99.50th=[ 6587], 99.90th=[ 7570], 99.95th=[ 8029], 00:31:50.363 | 99.99th=[10945] 00:31:50.363 bw ( KiB/s): min=14576, max=16160, per=25.24%, avg=15608.89, stdev=597.82, samples=9 00:31:50.363 iops : min= 1822, max= 2020, avg=1951.11, stdev=74.73, samples=9 00:31:50.363 lat (usec) : 1000=0.02% 00:31:50.363 lat (msec) : 2=0.54%, 4=45.48%, 10=53.95%, 20=0.01% 00:31:50.363 cpu : usr=95.64%, sys=3.88%, ctx=6, majf=0, minf=93 00:31:50.363 IO depths : 1=0.2%, 2=9.7%, 4=61.1%, 8=29.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:50.363 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.363 complete : 0=0.0%, 4=93.5%, 8=6.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.363 issued rwts: total=9771,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.363 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:50.363 filename1: (groupid=0, jobs=1): err= 0: pid=1352194: Mon Nov 18 02:14:24 2024 00:31:50.363 read: IOPS=1905, BW=14.9MiB/s (15.6MB/s)(74.4MiB/5001msec) 00:31:50.363 slat (usec): min=3, max=110, avg=18.79, stdev= 9.87 00:31:50.363 clat (usec): min=674, max=7470, avg=4133.29, stdev=623.83 00:31:50.363 lat (usec): min=688, max=7495, avg=4152.08, stdev=623.64 00:31:50.363 clat percentiles (usec): 00:31:50.363 | 1.00th=[ 2343], 5.00th=[ 3261], 10.00th=[ 3556], 20.00th=[ 3818], 00:31:50.363 | 30.00th=[ 3916], 40.00th=[ 3982], 50.00th=[ 4080], 60.00th=[ 4178], 00:31:50.363 | 70.00th=[ 4293], 80.00th=[ 4424], 90.00th=[ 4752], 95.00th=[ 5211], 00:31:50.363 | 99.00th=[ 6325], 99.50th=[ 6652], 99.90th=[ 7111], 99.95th=[ 7177], 00:31:50.363 | 99.99th=[ 7439] 00:31:50.363 bw ( KiB/s): min=14144, max=15680, per=24.62%, avg=15224.44, stdev=556.92, samples=9 00:31:50.363 iops : min= 1768, max= 1960, avg=1903.00, stdev=69.70, samples=9 00:31:50.363 lat (usec) : 750=0.02%, 1000=0.05% 00:31:50.363 lat (msec) : 2=0.51%, 4=39.68%, 10=59.73% 00:31:50.363 cpu : usr=89.40%, sys=6.84%, ctx=154, majf=0, minf=42 00:31:50.363 IO depths : 1=0.1%, 2=12.2%, 4=59.7%, 8=28.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:50.363 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.363 complete : 0=0.0%, 4=92.5%, 8=7.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.363 issued rwts: total=9529,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.363 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:50.363 00:31:50.363 Run status group 0 (all jobs): 00:31:50.363 READ: bw=60.4MiB/s (63.3MB/s), 14.9MiB/s-15.4MiB/s (15.6MB/s-16.1MB/s), io=302MiB (317MB), run=5001-5002msec 00:31:50.622 02:14:24 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:31:50.622 02:14:24 -- target/dif.sh@43 -- # local sub 00:31:50.622 02:14:24 -- target/dif.sh@45 -- # for sub in "$@" 00:31:50.622 02:14:24 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:50.622 02:14:24 -- target/dif.sh@36 -- # local sub_id=0 00:31:50.622 02:14:24 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:50.622 02:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.622 02:14:24 -- common/autotest_common.sh@10 -- # set +x 00:31:50.622 02:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.622 02:14:24 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:50.622 02:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.622 02:14:24 -- common/autotest_common.sh@10 -- # set +x 00:31:50.622 02:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.622 02:14:24 -- target/dif.sh@45 -- # for sub in "$@" 00:31:50.622 02:14:24 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:50.622 02:14:24 -- target/dif.sh@36 -- # local sub_id=1 00:31:50.622 02:14:24 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:50.622 02:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.622 02:14:24 -- common/autotest_common.sh@10 -- # set +x 00:31:50.622 02:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.622 02:14:24 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:50.622 02:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.622 02:14:24 -- common/autotest_common.sh@10 -- # set +x 00:31:50.622 02:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.622 00:31:50.622 real 0m24.241s 00:31:50.622 user 4m33.000s 00:31:50.622 sys 0m5.836s 00:31:50.622 02:14:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:50.622 02:14:24 -- common/autotest_common.sh@10 -- # set +x 00:31:50.622 ************************************ 00:31:50.622 END TEST fio_dif_rand_params 00:31:50.622 ************************************ 00:31:50.622 02:14:24 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:31:50.622 02:14:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:50.622 02:14:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:50.622 02:14:24 -- common/autotest_common.sh@10 -- # set +x 00:31:50.622 ************************************ 00:31:50.622 START TEST fio_dif_digest 00:31:50.622 ************************************ 00:31:50.622 02:14:24 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:31:50.622 02:14:24 -- target/dif.sh@123 -- # local NULL_DIF 00:31:50.622 02:14:24 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:31:50.622 02:14:24 -- target/dif.sh@125 -- # local hdgst ddgst 00:31:50.622 02:14:24 -- target/dif.sh@127 -- # NULL_DIF=3 00:31:50.622 02:14:24 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:31:50.622 02:14:24 -- target/dif.sh@127 -- # numjobs=3 00:31:50.622 02:14:24 -- target/dif.sh@127 -- # iodepth=3 00:31:50.622 02:14:24 -- target/dif.sh@127 -- # runtime=10 00:31:50.622 02:14:24 -- target/dif.sh@128 -- # hdgst=true 00:31:50.622 02:14:24 -- target/dif.sh@128 -- # ddgst=true 00:31:50.622 02:14:24 -- target/dif.sh@130 -- # create_subsystems 0 00:31:50.622 02:14:24 -- target/dif.sh@28 -- # local sub 00:31:50.622 02:14:24 -- target/dif.sh@30 -- # for sub in "$@" 00:31:50.622 02:14:24 -- target/dif.sh@31 -- # create_subsystem 0 00:31:50.622 02:14:24 -- target/dif.sh@18 -- # local sub_id=0 00:31:50.622 02:14:24 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:50.622 02:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.622 02:14:24 -- common/autotest_common.sh@10 -- # set +x 00:31:50.622 bdev_null0 00:31:50.622 02:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.622 02:14:24 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:50.622 02:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.622 02:14:24 -- common/autotest_common.sh@10 -- # set +x 00:31:50.622 02:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.622 02:14:24 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:50.622 02:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.622 02:14:24 -- common/autotest_common.sh@10 -- # set +x 00:31:50.622 02:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.622 02:14:24 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:50.622 02:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.622 02:14:24 -- common/autotest_common.sh@10 -- # set +x 00:31:50.622 [2024-11-18 02:14:24.901781] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:50.622 02:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.622 02:14:24 -- target/dif.sh@131 -- # fio /dev/fd/62 00:31:50.622 02:14:24 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:31:50.622 02:14:24 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:50.622 02:14:24 -- nvmf/common.sh@520 -- # config=() 00:31:50.622 02:14:24 -- nvmf/common.sh@520 -- # local subsystem config 00:31:50.622 02:14:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:50.623 02:14:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:50.623 { 00:31:50.623 "params": { 00:31:50.623 "name": "Nvme$subsystem", 00:31:50.623 "trtype": "$TEST_TRANSPORT", 00:31:50.623 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:50.623 "adrfam": "ipv4", 00:31:50.623 "trsvcid": "$NVMF_PORT", 00:31:50.623 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:50.623 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:50.623 "hdgst": ${hdgst:-false}, 00:31:50.623 "ddgst": ${ddgst:-false} 00:31:50.623 }, 00:31:50.623 "method": "bdev_nvme_attach_controller" 00:31:50.623 } 00:31:50.623 EOF 00:31:50.623 )") 00:31:50.623 02:14:24 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:50.623 02:14:24 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:50.623 02:14:24 -- target/dif.sh@82 -- # gen_fio_conf 00:31:50.623 02:14:24 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:50.623 02:14:24 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:50.623 02:14:24 -- target/dif.sh@54 -- # local file 00:31:50.623 02:14:24 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:50.623 02:14:24 -- target/dif.sh@56 -- # cat 00:31:50.623 02:14:24 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:50.623 02:14:24 -- common/autotest_common.sh@1330 -- # shift 00:31:50.623 02:14:24 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:50.623 02:14:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:50.623 02:14:24 -- nvmf/common.sh@542 -- # cat 00:31:50.623 02:14:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:50.623 02:14:24 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:50.623 02:14:24 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:50.623 02:14:24 -- target/dif.sh@72 -- # (( file <= files )) 00:31:50.623 02:14:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:50.623 02:14:24 -- nvmf/common.sh@544 -- # jq . 00:31:50.623 02:14:24 -- nvmf/common.sh@545 -- # IFS=, 00:31:50.623 02:14:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:50.623 "params": { 00:31:50.623 "name": "Nvme0", 00:31:50.623 "trtype": "tcp", 00:31:50.623 "traddr": "10.0.0.2", 00:31:50.623 "adrfam": "ipv4", 00:31:50.623 "trsvcid": "4420", 00:31:50.623 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:50.623 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:50.623 "hdgst": true, 00:31:50.623 "ddgst": true 00:31:50.623 }, 00:31:50.623 "method": "bdev_nvme_attach_controller" 00:31:50.623 }' 00:31:50.623 02:14:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:50.623 02:14:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:50.623 02:14:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:50.623 02:14:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:50.623 02:14:24 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:50.623 02:14:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:50.623 02:14:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:50.623 02:14:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:50.623 02:14:24 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:50.623 02:14:24 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:50.882 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:50.882 ... 00:31:50.882 fio-3.35 00:31:50.882 Starting 3 threads 00:31:50.882 EAL: No free 2048 kB hugepages reported on node 1 00:31:51.449 [2024-11-18 02:14:25.565998] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:51.449 [2024-11-18 02:14:25.566076] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:01.419 00:32:01.419 filename0: (groupid=0, jobs=1): err= 0: pid=1352967: Mon Nov 18 02:14:35 2024 00:32:01.419 read: IOPS=200, BW=25.0MiB/s (26.2MB/s)(250MiB/10005msec) 00:32:01.419 slat (nsec): min=4750, max=53807, avg=15815.81, stdev=4718.48 00:32:01.419 clat (usec): min=5382, max=61037, avg=14971.20, stdev=2089.95 00:32:01.419 lat (usec): min=5400, max=61049, avg=14987.02, stdev=2089.67 00:32:01.419 clat percentiles (usec): 00:32:01.419 | 1.00th=[12518], 5.00th=[13173], 10.00th=[13566], 20.00th=[13960], 00:32:01.419 | 30.00th=[14353], 40.00th=[14615], 50.00th=[14877], 60.00th=[15139], 00:32:01.419 | 70.00th=[15401], 80.00th=[15795], 90.00th=[16319], 95.00th=[16712], 00:32:01.419 | 99.00th=[17695], 99.50th=[17695], 99.90th=[61080], 99.95th=[61080], 00:32:01.419 | 99.99th=[61080] 00:32:01.419 bw ( KiB/s): min=22016, max=27136, per=32.85%, avg=25600.00, stdev=1297.40, samples=20 00:32:01.419 iops : min= 172, max= 212, avg=200.00, stdev=10.14, samples=20 00:32:01.419 lat (msec) : 10=0.05%, 20=99.80%, 100=0.15% 00:32:01.419 cpu : usr=95.14%, sys=4.38%, ctx=18, majf=0, minf=187 00:32:01.419 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:01.419 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:01.419 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:01.419 issued rwts: total=2002,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:01.419 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:01.419 filename0: (groupid=0, jobs=1): err= 0: pid=1352968: Mon Nov 18 02:14:35 2024 00:32:01.419 read: IOPS=194, BW=24.4MiB/s (25.6MB/s)(245MiB/10044msec) 00:32:01.419 slat (nsec): min=4257, max=47835, avg=20033.40, stdev=4299.72 00:32:01.419 clat (usec): min=9560, max=54612, avg=15343.58, stdev=1599.77 00:32:01.419 lat (usec): min=9572, max=54631, avg=15363.61, stdev=1600.04 00:32:01.419 clat percentiles (usec): 00:32:01.419 | 1.00th=[12780], 5.00th=[13566], 10.00th=[13960], 20.00th=[14353], 00:32:01.419 | 30.00th=[14746], 40.00th=[15008], 50.00th=[15270], 60.00th=[15533], 00:32:01.419 | 70.00th=[15926], 80.00th=[16188], 90.00th=[16712], 95.00th=[17171], 00:32:01.419 | 99.00th=[18220], 99.50th=[18482], 99.90th=[46924], 99.95th=[54789], 00:32:01.419 | 99.99th=[54789] 00:32:01.419 bw ( KiB/s): min=24064, max=26368, per=32.13%, avg=25039.25, stdev=784.76, samples=20 00:32:01.419 iops : min= 188, max= 206, avg=195.60, stdev= 6.14, samples=20 00:32:01.419 lat (msec) : 10=0.05%, 20=99.85%, 50=0.05%, 100=0.05% 00:32:01.419 cpu : usr=95.56%, sys=3.93%, ctx=32, majf=0, minf=208 00:32:01.419 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:01.419 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:01.419 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:01.419 issued rwts: total=1958,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:01.419 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:01.419 filename0: (groupid=0, jobs=1): err= 0: pid=1352969: Mon Nov 18 02:14:35 2024 00:32:01.419 read: IOPS=214, BW=26.8MiB/s (28.1MB/s)(269MiB/10045msec) 00:32:01.419 slat (nsec): min=4615, max=58185, avg=16133.90, stdev=4688.18 00:32:01.419 clat (usec): min=9348, max=50704, avg=13943.69, stdev=1549.63 00:32:01.419 lat (usec): min=9361, max=50722, avg=13959.82, stdev=1549.71 00:32:01.419 clat percentiles (usec): 00:32:01.419 | 1.00th=[11207], 5.00th=[12125], 10.00th=[12518], 20.00th=[13042], 00:32:01.419 | 30.00th=[13304], 40.00th=[13566], 50.00th=[13960], 60.00th=[14222], 00:32:01.419 | 70.00th=[14484], 80.00th=[14877], 90.00th=[15270], 95.00th=[15664], 00:32:01.419 | 99.00th=[16450], 99.50th=[16909], 99.90th=[19006], 99.95th=[48497], 00:32:01.419 | 99.99th=[50594] 00:32:01.419 bw ( KiB/s): min=25600, max=29440, per=35.37%, avg=27558.40, stdev=1279.39, samples=20 00:32:01.419 iops : min= 200, max= 230, avg=215.30, stdev=10.00, samples=20 00:32:01.419 lat (msec) : 10=0.32%, 20=99.58%, 50=0.05%, 100=0.05% 00:32:01.419 cpu : usr=94.85%, sys=4.65%, ctx=26, majf=0, minf=269 00:32:01.419 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:01.419 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:01.419 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:01.419 issued rwts: total=2155,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:01.419 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:01.419 00:32:01.419 Run status group 0 (all jobs): 00:32:01.419 READ: bw=76.1MiB/s (79.8MB/s), 24.4MiB/s-26.8MiB/s (25.6MB/s-28.1MB/s), io=764MiB (802MB), run=10005-10045msec 00:32:01.677 02:14:35 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:01.677 02:14:35 -- target/dif.sh@43 -- # local sub 00:32:01.677 02:14:35 -- target/dif.sh@45 -- # for sub in "$@" 00:32:01.677 02:14:35 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:01.677 02:14:35 -- target/dif.sh@36 -- # local sub_id=0 00:32:01.677 02:14:35 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:01.677 02:14:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:01.677 02:14:35 -- common/autotest_common.sh@10 -- # set +x 00:32:01.677 02:14:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:01.677 02:14:36 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:01.677 02:14:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:01.677 02:14:36 -- common/autotest_common.sh@10 -- # set +x 00:32:01.677 02:14:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:01.677 00:32:01.677 real 0m11.142s 00:32:01.677 user 0m29.909s 00:32:01.677 sys 0m1.555s 00:32:01.677 02:14:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:01.677 02:14:36 -- common/autotest_common.sh@10 -- # set +x 00:32:01.677 ************************************ 00:32:01.677 END TEST fio_dif_digest 00:32:01.677 ************************************ 00:32:01.677 02:14:36 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:01.677 02:14:36 -- target/dif.sh@147 -- # nvmftestfini 00:32:01.677 02:14:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:01.677 02:14:36 -- nvmf/common.sh@116 -- # sync 00:32:01.677 02:14:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:01.677 02:14:36 -- nvmf/common.sh@119 -- # set +e 00:32:01.677 02:14:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:01.677 02:14:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:01.677 rmmod nvme_tcp 00:32:01.677 rmmod nvme_fabrics 00:32:01.677 rmmod nvme_keyring 00:32:01.935 02:14:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:01.935 02:14:36 -- nvmf/common.sh@123 -- # set -e 00:32:01.935 02:14:36 -- nvmf/common.sh@124 -- # return 0 00:32:01.935 02:14:36 -- nvmf/common.sh@477 -- # '[' -n 1346742 ']' 00:32:01.935 02:14:36 -- nvmf/common.sh@478 -- # killprocess 1346742 00:32:01.935 02:14:36 -- common/autotest_common.sh@936 -- # '[' -z 1346742 ']' 00:32:01.935 02:14:36 -- common/autotest_common.sh@940 -- # kill -0 1346742 00:32:01.935 02:14:36 -- common/autotest_common.sh@941 -- # uname 00:32:01.935 02:14:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:01.935 02:14:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1346742 00:32:01.935 02:14:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:01.935 02:14:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:01.935 02:14:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1346742' 00:32:01.935 killing process with pid 1346742 00:32:01.935 02:14:36 -- common/autotest_common.sh@955 -- # kill 1346742 00:32:01.935 02:14:36 -- common/autotest_common.sh@960 -- # wait 1346742 00:32:02.193 02:14:36 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:02.193 02:14:36 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:03.127 Waiting for block devices as requested 00:32:03.385 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:03.385 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:03.385 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:03.643 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:03.643 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:03.643 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:03.643 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:03.902 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:03.902 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:03.902 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:03.902 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:04.161 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:04.161 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:04.161 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:04.419 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:04.419 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:04.419 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:04.676 02:14:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:04.676 02:14:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:04.676 02:14:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:04.676 02:14:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:04.676 02:14:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:04.676 02:14:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:04.676 02:14:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:06.574 02:14:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:06.574 00:32:06.574 real 1m7.426s 00:32:06.574 user 6m31.485s 00:32:06.574 sys 0m16.345s 00:32:06.574 02:14:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:06.574 02:14:40 -- common/autotest_common.sh@10 -- # set +x 00:32:06.574 ************************************ 00:32:06.574 END TEST nvmf_dif 00:32:06.574 ************************************ 00:32:06.574 02:14:40 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:06.574 02:14:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:06.574 02:14:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:06.574 02:14:40 -- common/autotest_common.sh@10 -- # set +x 00:32:06.574 ************************************ 00:32:06.574 START TEST nvmf_abort_qd_sizes 00:32:06.574 ************************************ 00:32:06.574 02:14:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:06.574 * Looking for test storage... 00:32:06.574 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:06.574 02:14:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:06.574 02:14:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:06.574 02:14:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:06.832 02:14:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:06.832 02:14:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:06.832 02:14:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:06.832 02:14:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:06.832 02:14:41 -- scripts/common.sh@335 -- # IFS=.-: 00:32:06.832 02:14:41 -- scripts/common.sh@335 -- # read -ra ver1 00:32:06.832 02:14:41 -- scripts/common.sh@336 -- # IFS=.-: 00:32:06.832 02:14:41 -- scripts/common.sh@336 -- # read -ra ver2 00:32:06.832 02:14:41 -- scripts/common.sh@337 -- # local 'op=<' 00:32:06.832 02:14:41 -- scripts/common.sh@339 -- # ver1_l=2 00:32:06.832 02:14:41 -- scripts/common.sh@340 -- # ver2_l=1 00:32:06.832 02:14:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:06.832 02:14:41 -- scripts/common.sh@343 -- # case "$op" in 00:32:06.832 02:14:41 -- scripts/common.sh@344 -- # : 1 00:32:06.832 02:14:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:06.832 02:14:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:06.832 02:14:41 -- scripts/common.sh@364 -- # decimal 1 00:32:06.832 02:14:41 -- scripts/common.sh@352 -- # local d=1 00:32:06.832 02:14:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:06.832 02:14:41 -- scripts/common.sh@354 -- # echo 1 00:32:06.832 02:14:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:06.832 02:14:41 -- scripts/common.sh@365 -- # decimal 2 00:32:06.832 02:14:41 -- scripts/common.sh@352 -- # local d=2 00:32:06.832 02:14:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:06.832 02:14:41 -- scripts/common.sh@354 -- # echo 2 00:32:06.832 02:14:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:06.832 02:14:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:06.832 02:14:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:06.832 02:14:41 -- scripts/common.sh@367 -- # return 0 00:32:06.832 02:14:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:06.832 02:14:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:06.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:06.832 --rc genhtml_branch_coverage=1 00:32:06.832 --rc genhtml_function_coverage=1 00:32:06.832 --rc genhtml_legend=1 00:32:06.832 --rc geninfo_all_blocks=1 00:32:06.832 --rc geninfo_unexecuted_blocks=1 00:32:06.832 00:32:06.832 ' 00:32:06.832 02:14:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:06.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:06.832 --rc genhtml_branch_coverage=1 00:32:06.833 --rc genhtml_function_coverage=1 00:32:06.833 --rc genhtml_legend=1 00:32:06.833 --rc geninfo_all_blocks=1 00:32:06.833 --rc geninfo_unexecuted_blocks=1 00:32:06.833 00:32:06.833 ' 00:32:06.833 02:14:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:06.833 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:06.833 --rc genhtml_branch_coverage=1 00:32:06.833 --rc genhtml_function_coverage=1 00:32:06.833 --rc genhtml_legend=1 00:32:06.833 --rc geninfo_all_blocks=1 00:32:06.833 --rc geninfo_unexecuted_blocks=1 00:32:06.833 00:32:06.833 ' 00:32:06.833 02:14:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:06.833 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:06.833 --rc genhtml_branch_coverage=1 00:32:06.833 --rc genhtml_function_coverage=1 00:32:06.833 --rc genhtml_legend=1 00:32:06.833 --rc geninfo_all_blocks=1 00:32:06.833 --rc geninfo_unexecuted_blocks=1 00:32:06.833 00:32:06.833 ' 00:32:06.833 02:14:41 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:06.833 02:14:41 -- nvmf/common.sh@7 -- # uname -s 00:32:06.833 02:14:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:06.833 02:14:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:06.833 02:14:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:06.833 02:14:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:06.833 02:14:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:06.833 02:14:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:06.833 02:14:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:06.833 02:14:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:06.833 02:14:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:06.833 02:14:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:06.833 02:14:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:06.833 02:14:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:06.833 02:14:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:06.833 02:14:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:06.833 02:14:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:06.833 02:14:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:06.833 02:14:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:06.833 02:14:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:06.833 02:14:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:06.833 02:14:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:06.833 02:14:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:06.833 02:14:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:06.833 02:14:41 -- paths/export.sh@5 -- # export PATH 00:32:06.833 02:14:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:06.833 02:14:41 -- nvmf/common.sh@46 -- # : 0 00:32:06.833 02:14:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:06.833 02:14:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:06.833 02:14:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:06.833 02:14:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:06.833 02:14:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:06.833 02:14:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:06.833 02:14:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:06.833 02:14:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:06.833 02:14:41 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:06.833 02:14:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:06.833 02:14:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:06.833 02:14:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:06.833 02:14:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:06.833 02:14:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:06.833 02:14:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:06.833 02:14:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:06.833 02:14:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:06.833 02:14:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:06.833 02:14:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:06.833 02:14:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:06.833 02:14:41 -- common/autotest_common.sh@10 -- # set +x 00:32:08.733 02:14:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:08.733 02:14:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:08.733 02:14:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:08.733 02:14:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:08.733 02:14:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:08.733 02:14:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:08.733 02:14:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:08.733 02:14:43 -- nvmf/common.sh@294 -- # net_devs=() 00:32:08.733 02:14:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:08.733 02:14:43 -- nvmf/common.sh@295 -- # e810=() 00:32:08.733 02:14:43 -- nvmf/common.sh@295 -- # local -ga e810 00:32:08.733 02:14:43 -- nvmf/common.sh@296 -- # x722=() 00:32:08.733 02:14:43 -- nvmf/common.sh@296 -- # local -ga x722 00:32:08.733 02:14:43 -- nvmf/common.sh@297 -- # mlx=() 00:32:08.733 02:14:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:08.733 02:14:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:08.733 02:14:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:08.733 02:14:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:08.733 02:14:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:08.733 02:14:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:08.733 02:14:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:08.733 02:14:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:08.733 02:14:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:08.733 02:14:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:08.734 02:14:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:08.734 02:14:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:08.734 02:14:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:08.734 02:14:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:08.734 02:14:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:08.734 02:14:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:08.734 02:14:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:08.734 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:08.734 02:14:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:08.734 02:14:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:08.734 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:08.734 02:14:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:08.734 02:14:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:08.734 02:14:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:08.734 02:14:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:08.734 02:14:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:08.734 02:14:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:08.734 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:08.734 02:14:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:08.734 02:14:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:08.734 02:14:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:08.734 02:14:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:08.734 02:14:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:08.734 02:14:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:08.734 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:08.734 02:14:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:08.734 02:14:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:08.734 02:14:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:08.734 02:14:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:08.734 02:14:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:08.734 02:14:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:08.734 02:14:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:08.734 02:14:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:08.734 02:14:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:08.734 02:14:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:08.734 02:14:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:08.734 02:14:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:08.734 02:14:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:08.734 02:14:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:08.734 02:14:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:08.734 02:14:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:08.734 02:14:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:08.734 02:14:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:08.734 02:14:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:08.734 02:14:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:08.734 02:14:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:08.734 02:14:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:08.734 02:14:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:08.734 02:14:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:08.734 02:14:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:08.992 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:08.992 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:32:08.992 00:32:08.992 --- 10.0.0.2 ping statistics --- 00:32:08.992 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:08.992 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:32:08.992 02:14:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:08.993 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:08.993 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:32:08.993 00:32:08.993 --- 10.0.0.1 ping statistics --- 00:32:08.993 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:08.993 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:32:08.993 02:14:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:08.993 02:14:43 -- nvmf/common.sh@410 -- # return 0 00:32:08.993 02:14:43 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:08.993 02:14:43 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:09.928 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:09.928 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:09.928 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:10.187 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:10.187 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:10.187 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:10.187 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:10.187 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:10.187 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:10.187 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:10.187 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:10.187 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:10.187 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:10.187 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:10.187 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:10.187 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:11.122 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:11.122 02:14:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:11.122 02:14:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:11.122 02:14:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:11.122 02:14:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:11.122 02:14:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:11.122 02:14:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:11.122 02:14:45 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:11.122 02:14:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:11.122 02:14:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:11.122 02:14:45 -- common/autotest_common.sh@10 -- # set +x 00:32:11.387 02:14:45 -- nvmf/common.sh@469 -- # nvmfpid=1357987 00:32:11.387 02:14:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:11.387 02:14:45 -- nvmf/common.sh@470 -- # waitforlisten 1357987 00:32:11.387 02:14:45 -- common/autotest_common.sh@829 -- # '[' -z 1357987 ']' 00:32:11.387 02:14:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:11.387 02:14:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:11.387 02:14:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:11.387 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:11.387 02:14:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:11.387 02:14:45 -- common/autotest_common.sh@10 -- # set +x 00:32:11.387 [2024-11-18 02:14:45.567303] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:32:11.387 [2024-11-18 02:14:45.567384] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:11.387 EAL: No free 2048 kB hugepages reported on node 1 00:32:11.387 [2024-11-18 02:14:45.637262] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:11.387 [2024-11-18 02:14:45.728942] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:11.387 [2024-11-18 02:14:45.729120] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:11.387 [2024-11-18 02:14:45.729140] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:11.387 [2024-11-18 02:14:45.729154] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:11.387 [2024-11-18 02:14:45.729211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:11.387 [2024-11-18 02:14:45.729268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:11.387 [2024-11-18 02:14:45.729369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:11.387 [2024-11-18 02:14:45.729374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:12.323 02:14:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:12.323 02:14:46 -- common/autotest_common.sh@862 -- # return 0 00:32:12.323 02:14:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:12.323 02:14:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:12.323 02:14:46 -- common/autotest_common.sh@10 -- # set +x 00:32:12.323 02:14:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:12.323 02:14:46 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:12.323 02:14:46 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:12.323 02:14:46 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:12.323 02:14:46 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:12.323 02:14:46 -- scripts/common.sh@312 -- # local nvmes 00:32:12.323 02:14:46 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:12.323 02:14:46 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:12.323 02:14:46 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:12.323 02:14:46 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:12.323 02:14:46 -- scripts/common.sh@322 -- # uname -s 00:32:12.323 02:14:46 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:12.323 02:14:46 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:12.323 02:14:46 -- scripts/common.sh@327 -- # (( 1 )) 00:32:12.323 02:14:46 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:12.323 02:14:46 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:12.323 02:14:46 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:12.323 02:14:46 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:12.323 02:14:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:12.323 02:14:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:12.323 02:14:46 -- common/autotest_common.sh@10 -- # set +x 00:32:12.323 ************************************ 00:32:12.323 START TEST spdk_target_abort 00:32:12.323 ************************************ 00:32:12.323 02:14:46 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:12.323 02:14:46 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:12.323 02:14:46 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:12.323 02:14:46 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:12.323 02:14:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.323 02:14:46 -- common/autotest_common.sh@10 -- # set +x 00:32:15.605 spdk_targetn1 00:32:15.605 02:14:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:15.605 02:14:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.605 02:14:49 -- common/autotest_common.sh@10 -- # set +x 00:32:15.605 [2024-11-18 02:14:49.394489] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:15.605 02:14:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:15.605 02:14:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.605 02:14:49 -- common/autotest_common.sh@10 -- # set +x 00:32:15.605 02:14:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:15.605 02:14:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.605 02:14:49 -- common/autotest_common.sh@10 -- # set +x 00:32:15.605 02:14:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:15.605 02:14:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.605 02:14:49 -- common/autotest_common.sh@10 -- # set +x 00:32:15.605 [2024-11-18 02:14:49.426792] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:15.605 02:14:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:15.605 02:14:49 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:15.605 EAL: No free 2048 kB hugepages reported on node 1 00:32:18.887 Initializing NVMe Controllers 00:32:18.887 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:18.887 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:18.887 Initialization complete. Launching workers. 00:32:18.887 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12288, failed: 0 00:32:18.887 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1272, failed to submit 11016 00:32:18.887 success 714, unsuccess 558, failed 0 00:32:18.887 02:14:52 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:18.887 02:14:52 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:18.887 EAL: No free 2048 kB hugepages reported on node 1 00:32:22.168 Initializing NVMe Controllers 00:32:22.168 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:22.168 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:22.168 Initialization complete. Launching workers. 00:32:22.168 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8686, failed: 0 00:32:22.168 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1223, failed to submit 7463 00:32:22.168 success 351, unsuccess 872, failed 0 00:32:22.168 02:14:56 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:22.168 02:14:56 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:22.168 EAL: No free 2048 kB hugepages reported on node 1 00:32:25.450 Initializing NVMe Controllers 00:32:25.450 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:25.450 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:25.450 Initialization complete. Launching workers. 00:32:25.450 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32646, failed: 0 00:32:25.450 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2817, failed to submit 29829 00:32:25.450 success 544, unsuccess 2273, failed 0 00:32:25.450 02:14:59 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:25.450 02:14:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:25.450 02:14:59 -- common/autotest_common.sh@10 -- # set +x 00:32:25.450 02:14:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:25.450 02:14:59 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:25.450 02:14:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:25.450 02:14:59 -- common/autotest_common.sh@10 -- # set +x 00:32:26.384 02:15:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:26.384 02:15:00 -- target/abort_qd_sizes.sh@62 -- # killprocess 1357987 00:32:26.384 02:15:00 -- common/autotest_common.sh@936 -- # '[' -z 1357987 ']' 00:32:26.384 02:15:00 -- common/autotest_common.sh@940 -- # kill -0 1357987 00:32:26.384 02:15:00 -- common/autotest_common.sh@941 -- # uname 00:32:26.384 02:15:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:26.384 02:15:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1357987 00:32:26.384 02:15:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:26.384 02:15:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:26.384 02:15:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1357987' 00:32:26.384 killing process with pid 1357987 00:32:26.384 02:15:00 -- common/autotest_common.sh@955 -- # kill 1357987 00:32:26.384 02:15:00 -- common/autotest_common.sh@960 -- # wait 1357987 00:32:26.384 00:32:26.384 real 0m14.169s 00:32:26.384 user 0m56.200s 00:32:26.384 sys 0m2.542s 00:32:26.384 02:15:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:26.384 02:15:00 -- common/autotest_common.sh@10 -- # set +x 00:32:26.384 ************************************ 00:32:26.384 END TEST spdk_target_abort 00:32:26.384 ************************************ 00:32:26.384 02:15:00 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:26.384 02:15:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:26.384 02:15:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:26.384 02:15:00 -- common/autotest_common.sh@10 -- # set +x 00:32:26.384 ************************************ 00:32:26.384 START TEST kernel_target_abort 00:32:26.384 ************************************ 00:32:26.384 02:15:00 -- common/autotest_common.sh@1114 -- # kernel_target 00:32:26.384 02:15:00 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:26.384 02:15:00 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:26.384 02:15:00 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:26.384 02:15:00 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:26.384 02:15:00 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:26.384 02:15:00 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:26.384 02:15:00 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:26.384 02:15:00 -- nvmf/common.sh@627 -- # local block nvme 00:32:26.384 02:15:00 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:26.384 02:15:00 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:26.384 02:15:00 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:26.384 02:15:00 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:27.755 Waiting for block devices as requested 00:32:27.755 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:27.755 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:28.012 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:28.012 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:28.012 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:28.012 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:28.270 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:28.270 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:28.270 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:28.270 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:28.529 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:28.529 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:28.529 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:28.529 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:28.787 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:28.787 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:28.787 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:29.046 02:15:03 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:29.046 02:15:03 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:29.046 02:15:03 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:29.046 02:15:03 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:29.046 02:15:03 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:29.046 No valid GPT data, bailing 00:32:29.046 02:15:03 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:29.046 02:15:03 -- scripts/common.sh@393 -- # pt= 00:32:29.046 02:15:03 -- scripts/common.sh@394 -- # return 1 00:32:29.046 02:15:03 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:29.046 02:15:03 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:29.046 02:15:03 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:29.046 02:15:03 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:29.046 02:15:03 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:29.046 02:15:03 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:29.046 02:15:03 -- nvmf/common.sh@654 -- # echo 1 00:32:29.046 02:15:03 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:29.046 02:15:03 -- nvmf/common.sh@656 -- # echo 1 00:32:29.046 02:15:03 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:29.046 02:15:03 -- nvmf/common.sh@663 -- # echo tcp 00:32:29.046 02:15:03 -- nvmf/common.sh@664 -- # echo 4420 00:32:29.046 02:15:03 -- nvmf/common.sh@665 -- # echo ipv4 00:32:29.046 02:15:03 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:29.046 02:15:03 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:29.046 00:32:29.046 Discovery Log Number of Records 2, Generation counter 2 00:32:29.046 =====Discovery Log Entry 0====== 00:32:29.046 trtype: tcp 00:32:29.046 adrfam: ipv4 00:32:29.046 subtype: current discovery subsystem 00:32:29.046 treq: not specified, sq flow control disable supported 00:32:29.046 portid: 1 00:32:29.046 trsvcid: 4420 00:32:29.046 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:29.046 traddr: 10.0.0.1 00:32:29.046 eflags: none 00:32:29.046 sectype: none 00:32:29.046 =====Discovery Log Entry 1====== 00:32:29.046 trtype: tcp 00:32:29.046 adrfam: ipv4 00:32:29.046 subtype: nvme subsystem 00:32:29.046 treq: not specified, sq flow control disable supported 00:32:29.046 portid: 1 00:32:29.046 trsvcid: 4420 00:32:29.046 subnqn: kernel_target 00:32:29.046 traddr: 10.0.0.1 00:32:29.046 eflags: none 00:32:29.046 sectype: none 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:29.046 02:15:03 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:29.046 EAL: No free 2048 kB hugepages reported on node 1 00:32:32.325 Initializing NVMe Controllers 00:32:32.325 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:32.325 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:32.325 Initialization complete. Launching workers. 00:32:32.325 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 46430, failed: 0 00:32:32.325 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 46430, failed to submit 0 00:32:32.325 success 0, unsuccess 46430, failed 0 00:32:32.325 02:15:06 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:32.325 02:15:06 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:32.325 EAL: No free 2048 kB hugepages reported on node 1 00:32:35.606 Initializing NVMe Controllers 00:32:35.606 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:35.606 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:35.606 Initialization complete. Launching workers. 00:32:35.606 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 83111, failed: 0 00:32:35.606 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20934, failed to submit 62177 00:32:35.606 success 0, unsuccess 20934, failed 0 00:32:35.606 02:15:09 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:35.606 02:15:09 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:35.606 EAL: No free 2048 kB hugepages reported on node 1 00:32:38.886 Initializing NVMe Controllers 00:32:38.886 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:38.886 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:38.886 Initialization complete. Launching workers. 00:32:38.886 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 85204, failed: 0 00:32:38.886 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 21294, failed to submit 63910 00:32:38.886 success 0, unsuccess 21294, failed 0 00:32:38.886 02:15:12 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:32:38.886 02:15:12 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:32:38.886 02:15:12 -- nvmf/common.sh@677 -- # echo 0 00:32:38.886 02:15:12 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:32:38.886 02:15:12 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:38.886 02:15:12 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:38.886 02:15:12 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:38.886 02:15:12 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:32:38.886 02:15:12 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:32:38.886 00:32:38.886 real 0m12.011s 00:32:38.886 user 0m5.945s 00:32:38.886 sys 0m2.399s 00:32:38.886 02:15:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:38.886 02:15:12 -- common/autotest_common.sh@10 -- # set +x 00:32:38.886 ************************************ 00:32:38.886 END TEST kernel_target_abort 00:32:38.886 ************************************ 00:32:38.886 02:15:12 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:32:38.886 02:15:12 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:32:38.886 02:15:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:38.886 02:15:12 -- nvmf/common.sh@116 -- # sync 00:32:38.886 02:15:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:38.886 02:15:12 -- nvmf/common.sh@119 -- # set +e 00:32:38.886 02:15:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:38.886 02:15:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:38.886 rmmod nvme_tcp 00:32:38.886 rmmod nvme_fabrics 00:32:38.886 rmmod nvme_keyring 00:32:38.886 02:15:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:38.886 02:15:12 -- nvmf/common.sh@123 -- # set -e 00:32:38.886 02:15:12 -- nvmf/common.sh@124 -- # return 0 00:32:38.886 02:15:12 -- nvmf/common.sh@477 -- # '[' -n 1357987 ']' 00:32:38.886 02:15:12 -- nvmf/common.sh@478 -- # killprocess 1357987 00:32:38.886 02:15:12 -- common/autotest_common.sh@936 -- # '[' -z 1357987 ']' 00:32:38.886 02:15:12 -- common/autotest_common.sh@940 -- # kill -0 1357987 00:32:38.886 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1357987) - No such process 00:32:38.886 02:15:12 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1357987 is not found' 00:32:38.886 Process with pid 1357987 is not found 00:32:38.886 02:15:12 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:38.886 02:15:12 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:39.821 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:39.821 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:39.821 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:39.821 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:39.821 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:39.821 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:39.821 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:39.821 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:39.821 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:39.821 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:39.821 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:39.821 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:39.821 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:39.821 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:39.821 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:39.821 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:39.821 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:40.080 02:15:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:40.080 02:15:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:40.080 02:15:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:40.080 02:15:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:40.080 02:15:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:40.080 02:15:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:40.080 02:15:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:41.985 02:15:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:41.985 00:32:41.985 real 0m35.387s 00:32:41.985 user 1m4.616s 00:32:41.985 sys 0m8.256s 00:32:41.985 02:15:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:41.985 02:15:16 -- common/autotest_common.sh@10 -- # set +x 00:32:41.985 ************************************ 00:32:41.985 END TEST nvmf_abort_qd_sizes 00:32:41.985 ************************************ 00:32:41.985 02:15:16 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:32:41.985 02:15:16 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:32:41.985 02:15:16 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:32:41.985 02:15:16 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:32:41.985 02:15:16 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:32:41.985 02:15:16 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:32:41.985 02:15:16 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:32:41.985 02:15:16 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:32:41.985 02:15:16 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:32:41.985 02:15:16 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:32:41.985 02:15:16 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:32:41.985 02:15:16 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:32:41.985 02:15:16 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:32:41.985 02:15:16 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:32:41.985 02:15:16 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:32:41.985 02:15:16 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:32:41.985 02:15:16 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:32:41.985 02:15:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:41.985 02:15:16 -- common/autotest_common.sh@10 -- # set +x 00:32:41.985 02:15:16 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:32:41.985 02:15:16 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:32:41.985 02:15:16 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:32:41.985 02:15:16 -- common/autotest_common.sh@10 -- # set +x 00:32:43.921 INFO: APP EXITING 00:32:43.921 INFO: killing all VMs 00:32:43.921 INFO: killing vhost app 00:32:43.921 INFO: EXIT DONE 00:32:44.906 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:44.906 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:44.906 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:44.906 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:44.906 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:44.906 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:44.906 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:44.906 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:45.165 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:45.165 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:45.165 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:45.165 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:45.165 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:45.165 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:45.165 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:45.165 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:45.165 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:46.540 Cleaning 00:32:46.540 Removing: /var/run/dpdk/spdk0/config 00:32:46.540 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:32:46.540 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:32:46.540 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:32:46.540 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:32:46.540 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:32:46.540 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:32:46.540 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:32:46.540 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:32:46.540 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:32:46.540 Removing: /var/run/dpdk/spdk0/hugepage_info 00:32:46.540 Removing: /var/run/dpdk/spdk1/config 00:32:46.540 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:32:46.540 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:32:46.540 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:32:46.540 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:32:46.540 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:32:46.540 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:32:46.540 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:32:46.540 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:32:46.540 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:32:46.540 Removing: /var/run/dpdk/spdk1/hugepage_info 00:32:46.540 Removing: /var/run/dpdk/spdk1/mp_socket 00:32:46.540 Removing: /var/run/dpdk/spdk2/config 00:32:46.540 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:32:46.540 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:32:46.540 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:32:46.540 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:32:46.540 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:32:46.540 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:32:46.540 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:32:46.540 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:32:46.540 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:32:46.540 Removing: /var/run/dpdk/spdk2/hugepage_info 00:32:46.540 Removing: /var/run/dpdk/spdk3/config 00:32:46.540 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:32:46.540 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:32:46.540 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:32:46.540 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:32:46.540 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:32:46.540 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:32:46.540 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:32:46.540 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:32:46.540 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:32:46.540 Removing: /var/run/dpdk/spdk3/hugepage_info 00:32:46.540 Removing: /var/run/dpdk/spdk4/config 00:32:46.540 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:32:46.540 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:32:46.540 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:32:46.540 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:32:46.540 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:32:46.540 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:32:46.540 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:32:46.540 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:32:46.540 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:32:46.540 Removing: /var/run/dpdk/spdk4/hugepage_info 00:32:46.540 Removing: /dev/shm/bdev_svc_trace.1 00:32:46.540 Removing: /dev/shm/nvmf_trace.0 00:32:46.540 Removing: /dev/shm/spdk_tgt_trace.pid1078728 00:32:46.540 Removing: /var/run/dpdk/spdk0 00:32:46.540 Removing: /var/run/dpdk/spdk1 00:32:46.540 Removing: /var/run/dpdk/spdk2 00:32:46.540 Removing: /var/run/dpdk/spdk3 00:32:46.540 Removing: /var/run/dpdk/spdk4 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1077003 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1077779 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1078728 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1079236 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1080456 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1081646 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1081998 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1082673 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1082909 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1083227 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1083386 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1083540 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1083778 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1084325 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1086875 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1087053 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1087347 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1087487 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1087798 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1087937 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1088252 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1088392 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1088679 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1088707 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1088989 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1089014 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1089510 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1089672 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1089876 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1090178 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1090198 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1090256 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1090525 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1090683 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1090829 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1090987 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1091248 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1091410 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1091548 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1091713 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1091975 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1092131 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1092275 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1092434 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1092698 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1092858 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1092996 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1093157 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1093419 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1093585 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1093723 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1093878 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1094145 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1094304 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1094450 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1094603 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1094864 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1095031 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1095175 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1095334 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1095593 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1095755 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1095902 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1096055 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1096323 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1096488 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1096632 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1096794 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1097053 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1097221 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1097362 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1097554 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1097717 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1097930 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1100136 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1157122 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1159855 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1166972 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1170800 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1173334 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1173761 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1177772 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1177775 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1178342 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1179011 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1179689 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1180096 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1180108 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1180253 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1180386 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1180393 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1181066 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1181687 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1182301 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1182710 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1182718 00:32:46.540 Removing: /var/run/dpdk/spdk_pid1182981 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1184041 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1184920 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1190418 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1190700 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1193386 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1197292 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1199642 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1206897 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1212200 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1213540 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1214227 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1224760 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1227112 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1229948 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1231170 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1232544 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1232705 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1232972 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1233130 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1233722 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1235132 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1236540 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1237179 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1240800 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1244383 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1248030 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1272452 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1275292 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1279267 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1280242 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1281506 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1284085 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1286624 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1291018 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1291026 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1293970 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1294110 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1294367 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1294643 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1294656 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1295769 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1297111 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1298435 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1300153 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1301372 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1302590 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1306480 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1306939 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1308263 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1309026 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1312816 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1314982 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1318587 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1322232 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1325873 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1326317 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1326749 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1327161 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1327761 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1328421 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1328970 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1330034 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1332705 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1332854 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1336732 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1336912 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1338686 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1343847 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1343866 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1346921 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1348357 00:32:46.800 Removing: /var/run/dpdk/spdk_pid1349794 00:32:46.801 Removing: /var/run/dpdk/spdk_pid1350583 00:32:46.801 Removing: /var/run/dpdk/spdk_pid1352006 00:32:46.801 Removing: /var/run/dpdk/spdk_pid1352899 00:32:46.801 Removing: /var/run/dpdk/spdk_pid1358432 00:32:46.801 Removing: /var/run/dpdk/spdk_pid1358831 00:32:46.801 Removing: /var/run/dpdk/spdk_pid1359231 00:32:46.801 Removing: /var/run/dpdk/spdk_pid1360822 00:32:46.801 Removing: /var/run/dpdk/spdk_pid1361229 00:32:46.801 Removing: /var/run/dpdk/spdk_pid1362144 00:32:46.801 Clean 00:32:46.801 killing process with pid 1048901 00:32:54.921 killing process with pid 1048898 00:32:55.181 killing process with pid 1048900 00:32:55.181 killing process with pid 1048899 00:32:55.181 02:15:29 -- common/autotest_common.sh@1446 -- # return 0 00:32:55.181 02:15:29 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:32:55.181 02:15:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:55.181 02:15:29 -- common/autotest_common.sh@10 -- # set +x 00:32:55.441 02:15:29 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:32:55.441 02:15:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:55.441 02:15:29 -- common/autotest_common.sh@10 -- # set +x 00:32:55.441 02:15:29 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:32:55.441 02:15:29 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:32:55.441 02:15:29 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:32:55.441 02:15:29 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:32:55.441 02:15:29 -- spdk/autotest.sh@383 -- # hostname 00:32:55.441 02:15:29 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:32:55.441 geninfo: WARNING: invalid characters removed from testname! 00:33:27.546 02:15:57 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:27.546 02:16:01 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:30.089 02:16:04 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:33.388 02:16:07 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:35.930 02:16:09 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:38.472 02:16:12 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:41.012 02:16:15 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:33:41.272 02:16:15 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:33:41.272 02:16:15 -- common/autotest_common.sh@1690 -- $ lcov --version 00:33:41.272 02:16:15 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:33:41.272 02:16:15 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:33:41.272 02:16:15 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:33:41.272 02:16:15 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:33:41.272 02:16:15 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:33:41.272 02:16:15 -- scripts/common.sh@335 -- $ IFS=.-: 00:33:41.272 02:16:15 -- scripts/common.sh@335 -- $ read -ra ver1 00:33:41.272 02:16:15 -- scripts/common.sh@336 -- $ IFS=.-: 00:33:41.272 02:16:15 -- scripts/common.sh@336 -- $ read -ra ver2 00:33:41.272 02:16:15 -- scripts/common.sh@337 -- $ local 'op=<' 00:33:41.272 02:16:15 -- scripts/common.sh@339 -- $ ver1_l=2 00:33:41.272 02:16:15 -- scripts/common.sh@340 -- $ ver2_l=1 00:33:41.273 02:16:15 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:33:41.273 02:16:15 -- scripts/common.sh@343 -- $ case "$op" in 00:33:41.273 02:16:15 -- scripts/common.sh@344 -- $ : 1 00:33:41.273 02:16:15 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:33:41.273 02:16:15 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:33:41.273 02:16:15 -- scripts/common.sh@364 -- $ decimal 1 00:33:41.273 02:16:15 -- scripts/common.sh@352 -- $ local d=1 00:33:41.273 02:16:15 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:33:41.273 02:16:15 -- scripts/common.sh@354 -- $ echo 1 00:33:41.273 02:16:15 -- scripts/common.sh@364 -- $ ver1[v]=1 00:33:41.273 02:16:15 -- scripts/common.sh@365 -- $ decimal 2 00:33:41.273 02:16:15 -- scripts/common.sh@352 -- $ local d=2 00:33:41.273 02:16:15 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:33:41.273 02:16:15 -- scripts/common.sh@354 -- $ echo 2 00:33:41.273 02:16:15 -- scripts/common.sh@365 -- $ ver2[v]=2 00:33:41.273 02:16:15 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:33:41.273 02:16:15 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:33:41.273 02:16:15 -- scripts/common.sh@367 -- $ return 0 00:33:41.273 02:16:15 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:33:41.273 02:16:15 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:33:41.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:41.273 --rc genhtml_branch_coverage=1 00:33:41.273 --rc genhtml_function_coverage=1 00:33:41.273 --rc genhtml_legend=1 00:33:41.273 --rc geninfo_all_blocks=1 00:33:41.273 --rc geninfo_unexecuted_blocks=1 00:33:41.273 00:33:41.273 ' 00:33:41.273 02:16:15 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:33:41.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:41.273 --rc genhtml_branch_coverage=1 00:33:41.273 --rc genhtml_function_coverage=1 00:33:41.273 --rc genhtml_legend=1 00:33:41.273 --rc geninfo_all_blocks=1 00:33:41.273 --rc geninfo_unexecuted_blocks=1 00:33:41.273 00:33:41.273 ' 00:33:41.273 02:16:15 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:33:41.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:41.273 --rc genhtml_branch_coverage=1 00:33:41.273 --rc genhtml_function_coverage=1 00:33:41.273 --rc genhtml_legend=1 00:33:41.273 --rc geninfo_all_blocks=1 00:33:41.273 --rc geninfo_unexecuted_blocks=1 00:33:41.273 00:33:41.273 ' 00:33:41.273 02:16:15 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:33:41.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:41.273 --rc genhtml_branch_coverage=1 00:33:41.273 --rc genhtml_function_coverage=1 00:33:41.273 --rc genhtml_legend=1 00:33:41.273 --rc geninfo_all_blocks=1 00:33:41.273 --rc geninfo_unexecuted_blocks=1 00:33:41.273 00:33:41.273 ' 00:33:41.273 02:16:15 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:33:41.273 02:16:15 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:33:41.273 02:16:15 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:41.273 02:16:15 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:41.273 02:16:15 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:41.273 02:16:15 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:41.273 02:16:15 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:41.273 02:16:15 -- paths/export.sh@5 -- $ export PATH 00:33:41.273 02:16:15 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:41.273 02:16:15 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:33:41.273 02:16:15 -- common/autobuild_common.sh@440 -- $ date +%s 00:33:41.273 02:16:15 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1731892575.XXXXXX 00:33:41.273 02:16:15 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1731892575.E3xT8W 00:33:41.273 02:16:15 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:33:41.273 02:16:15 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:33:41.273 02:16:15 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:33:41.273 02:16:15 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:33:41.273 02:16:15 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:33:41.273 02:16:15 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:33:41.273 02:16:15 -- common/autobuild_common.sh@456 -- $ get_config_params 00:33:41.273 02:16:15 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:33:41.273 02:16:15 -- common/autotest_common.sh@10 -- $ set +x 00:33:41.273 02:16:15 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:33:41.273 02:16:15 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:33:41.273 02:16:15 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:41.273 02:16:15 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:33:41.273 02:16:15 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:33:41.273 02:16:15 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:33:41.273 02:16:15 -- spdk/autopackage.sh@19 -- $ timing_finish 00:33:41.273 02:16:15 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:33:41.273 02:16:15 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:33:41.273 02:16:15 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:41.273 02:16:15 -- spdk/autopackage.sh@20 -- $ exit 0 00:33:41.273 + [[ -n 994105 ]] 00:33:41.273 + sudo kill 994105 00:33:41.284 [Pipeline] } 00:33:41.300 [Pipeline] // stage 00:33:41.305 [Pipeline] } 00:33:41.319 [Pipeline] // timeout 00:33:41.324 [Pipeline] } 00:33:41.338 [Pipeline] // catchError 00:33:41.343 [Pipeline] } 00:33:41.358 [Pipeline] // wrap 00:33:41.364 [Pipeline] } 00:33:41.378 [Pipeline] // catchError 00:33:41.387 [Pipeline] stage 00:33:41.389 [Pipeline] { (Epilogue) 00:33:41.402 [Pipeline] catchError 00:33:41.404 [Pipeline] { 00:33:41.417 [Pipeline] echo 00:33:41.419 Cleanup processes 00:33:41.425 [Pipeline] sh 00:33:41.713 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:41.713 1374449 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:41.728 [Pipeline] sh 00:33:42.015 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:42.015 ++ grep -v 'sudo pgrep' 00:33:42.015 ++ awk '{print $1}' 00:33:42.015 + sudo kill -9 00:33:42.015 + true 00:33:42.028 [Pipeline] sh 00:33:42.390 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:33:52.373 [Pipeline] sh 00:33:52.661 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:33:52.661 Artifacts sizes are good 00:33:52.677 [Pipeline] archiveArtifacts 00:33:52.684 Archiving artifacts 00:33:52.856 [Pipeline] sh 00:33:53.141 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:33:53.156 [Pipeline] cleanWs 00:33:53.165 [WS-CLEANUP] Deleting project workspace... 00:33:53.165 [WS-CLEANUP] Deferred wipeout is used... 00:33:53.171 [WS-CLEANUP] done 00:33:53.173 [Pipeline] } 00:33:53.190 [Pipeline] // catchError 00:33:53.201 [Pipeline] sh 00:33:53.482 + logger -p user.info -t JENKINS-CI 00:33:53.490 [Pipeline] } 00:33:53.504 [Pipeline] // stage 00:33:53.509 [Pipeline] } 00:33:53.523 [Pipeline] // node 00:33:53.528 [Pipeline] End of Pipeline 00:33:53.570 Finished: SUCCESS